spanglish
Improving Bilingual Capabilities of Language Models to Support Diverse Linguistic Practices in Education
Syamkumar, Anand, Tseng, Nora, Barron, Kaycie, Yang, Shanglin, Karumbaiah, Shamya, Uppal, Rheeya, Hu, Junjie
Large language models (LLMs) offer promise in generating educational content, providing instructor feedback, and reducing teacher workload on assessments. While prior studies have focused on studying LLM-powered learning analytics, limited research has examined how effective LLMs are in a bilingual context. In this paper, we study the effectiveness of multilingual large language models (MLLMs) across monolingual (English-only, Spanish-only) and bilingual (Spanglish) student writing. We present a learning analytics use case that details LLM performance in assessing acceptable and unacceptable explanations of Science and Social Science concepts. Our findings reveal a significant bias in the grading performance of pre-trained models for bilingual writing compared to English-only and Spanish-only writing. Following this, we fine-tune open-source MLLMs including Llama 3.1 and Mistral NeMo using synthetic datasets generated in English, Spanish, and Spanglish. Our experiments indicate that the models perform significantly better for all three languages after fine-tuning with bilingual data. This study highlights the potential of enhancing MLLM effectiveness to support authentic language practices amongst bilingual learners. It also aims to illustrate the value of incorporating non-English languages into the design and implementation of language models in education.
- North America > United States > Wisconsin > Dane County > Madison (0.16)
- North America > United States > New York > Suffolk County > Stony Brook (0.04)
- Asia > Indonesia > Bali (0.04)
- (4 more...)
- Education > Educational Technology > Educational Software (0.47)
- Education > Educational Setting (0.46)
Can English remain the 'world's favourite' language?
English is spoken by hundreds of millions of people worldwide, but do the development of translation technology and "hybrid" languages threaten its status? Which country boasts the most English speakers, or people learning to speak English? According to a study published by Cambridge University Press, up to 350 million people there have at least some knowledge of English - and at least another 100 million in India. There are probably more people in China who speak English as a second language than there are Americans who speak it as their first. But for how much longer will English qualify as the "world's favourite language"?
- Asia > China (0.29)
- Asia > India (0.26)
- Europe > United Kingdom > England > Cambridgeshire > Cambridge (0.25)
- (5 more...)