ASCEND: A Spontaneous Chinese-English Dataset for Code-switching in Multi-turn Conversation
Lovenia, Holy, Cahyawijaya, Samuel, Winata, Genta Indra, Xu, Peng, Yan, Xu, Liu, Zihan, Frieske, Rita, Yu, Tiezheng, Dai, Wenliang, Barezi, Elham J., Chen, Qifeng, Ma, Xiaojuan, Shi, Bertram E., Fung, Pascale
–arXiv.org Artificial Intelligence
Code-switching is a speech phenomenon occurring when a speaker switches language during a conversation. Despite the spontaneous nature of code-switching in conversational spoken language, most existing works collect code-switching data from read speech instead of spontaneous speech. ASCEND (A Spontaneous Chinese-English Dataset) is a high-quality Mandarin Chinese-English code-switching corpus built on spontaneous multi-turn conversational dialogue sources collected in Hong Kong. We report ASCEND's design and procedure for collecting the speech data, including annotations. ASCEND consists of 10.62 hours of clean speech, collected from 23 bilingual speakers of Chinese and English. Furthermore, we conduct baseline experiments using pre-trained wav2vec 2.0 models, achieving a best performance of 22.69\% character error rate and 27.05% mixed error rate.
arXiv.org Artificial Intelligence
May-3-2022
- Country:
- Asia
- China > Hong Kong (0.26)
- East Asia (0.04)
- Malaysia (0.04)
- Middle East > Republic of Türkiye
- Istanbul Province > Istanbul (0.04)
- Singapore (0.04)
- Taiwan > Taiwan Province
- Taipei (0.04)
- Europe
- France > Provence-Alpes-Côte d'Azur
- Bouches-du-Rhône > Marseille (0.04)
- Iceland > Capital Region
- Reykjavik (0.04)
- Middle East > Republic of Türkiye
- Istanbul Province > Istanbul (0.04)
- France > Provence-Alpes-Côte d'Azur
- North America > United States
- New Mexico > Santa Fe County > Santa Fe (0.04)
- Oceania > Australia
- Asia
- Genre:
- Research Report (0.50)
- Technology:
- Information Technology > Artificial Intelligence
- Machine Learning (1.00)
- Natural Language (1.00)
- Speech > Speech Recognition (0.70)
- Information Technology > Artificial Intelligence