AsyncSwitch: Asynchronous Text-Speech Adaptation for Code-Switched ASR
–arXiv.org Artificial Intelligence
--Developing code-switched ASR systems is challenging due to language ambiguity and limited exposure to multilingual, code-switched data, while collecting such speech is costly. Prior work generates synthetic audio from text, but these methods are computationally intensive and hard to scale. We introduce AsyncSwitch, a novel asynchronous adaptation framework that leverages large-scale, text-rich web data to pre-expose ASR models to diverse code-switched domains before fine-tuning on paired speech-text corpora. Experiments with Whisper on Malay-English code-switching demonstrate a 9.02% relative WER reduction, while improving monolingual performance in Singlish, Malay, and other English variants. Code-switching--switching between languages within the same conversation--is a common and natural way of speaking in many multilingual communities.
arXiv.org Artificial Intelligence
Jun-18-2025
- Country:
- Asia
- Singapore (0.06)
- Southeast Asia (0.04)
- Europe > Slovenia (0.04)
- Asia
- Genre:
- Research Report (0.65)
- Technology:
- Information Technology > Artificial Intelligence
- Machine Learning (1.00)
- Natural Language (1.00)
- Speech > Speech Recognition (1.00)
- Information Technology > Artificial Intelligence