Zero-Shot Cross-Lingual NER Using Phonemic Representations for Low-Resource Languages
Sohn, Jimin, Jung, Haeji, Cheng, Alex, Kang, Jooeon, Du, Yilin, Mortensen, David R.
–arXiv.org Artificial Intelligence
Existing zero-shot cross-lingual NER approaches require substantial prior knowledge of the target language, which is impractical for low-resource languages. In this paper, we propose a novel approach to NER using phonemic representation based on the International Phonetic Alphabet (IPA) to bridge the gap between representations of different languages. Our experiments show that our method significantly outperforms baseline models in extremely low-resource languages, with the highest average F-1 score (46.38%) and lowest standard deviation (12.67), particularly demonstrating its robustness with non-Latin scripts.
arXiv.org Artificial Intelligence
Jun-23-2024
- Country:
- North America
- United States
- Texas > Travis County
- Austin (0.04)
- Minnesota > Hennepin County
- Minneapolis (0.14)
- Texas > Travis County
- Canada
- Ontario > Toronto (0.04)
- British Columbia > Metro Vancouver Regional District
- Vancouver (0.04)
- United States
- Europe
- Russia (0.05)
- Ireland > Leinster
- County Dublin > Dublin (0.04)
- France > Île-de-France
- Belgium > Brussels-Capital Region
- Brussels (0.04)
- Asia
- South Korea (0.05)
- Russia (0.05)
- China (0.05)
- Singapore (0.04)
- North America
- Genre:
- Research Report > Promising Solution (0.34)
- Technology: