Krey\`ol-MT: Building MT for Latin American, Caribbean and Colonial African Creole Languages
Robinson, Nathaniel R., Dabre, Raj, Shurtz, Ammon, Dent, Rasul, Onesi, Onenamiyi, Monroc, Claire Bizon, Grobol, Loïc, Muhammad, Hasan, Garg, Ashi, Etori, Naome A., Tiyyala, Vijay Murari, Samuel, Olanrewaju, Stutzman, Matthew Dean, Odoom, Bismarck Bamfo, Khudanpur, Sanjeev, Richardson, Stephen D., Murray, Kenton
–arXiv.org Artificial Intelligence
A majority of language technologies are tailored for a small number of high-resource languages, while relatively many low-resource languages are neglected. One such group, Creole languages, have long been marginalized in academic study, though their speakers could benefit from machine translation (MT). These languages are predominantly used in much of Latin America, Africa and the Caribbean. We present the largest cumulative dataset to date for Creole language MT, including 14.5M unique Creole sentences with parallel translations -- 11.6M of which we release publicly, and the largest bitexts gathered to date for 41 languages -- the first ever for 21. In addition, we provide MT models supporting all 41 Creole languages in 172 translation directions. Given our diverse dataset, we produce a model for Creole language MT exposed to more genre diversity than ever before, which outperforms a genre-specific Creole MT model on its own benchmark for 26 of 34 translation directions.
arXiv.org Artificial Intelligence
May-13-2024
- Country:
- Africa
- Niger (0.04)
- South Africa (0.04)
- Nigeria (0.04)
- Ghana (0.04)
- Seychelles (0.28)
- Equatorial Guinea (0.04)
- Central Africa (0.04)
- São Tomé and Príncipe (0.04)
- Cameroon (0.04)
- Guinea-Bissau (0.04)
- Mauritius (0.04)
- Cabo Verde > Sao Vicente
- Mindelo (0.04)
- Asia
- India > Maharashtra
- Mumbai (0.04)
- Japan (0.04)
- Middle East
- Republic of Türkiye > Istanbul Province
- Istanbul (0.04)
- UAE (0.04)
- Republic of Türkiye > Istanbul Province
- Singapore (0.04)
- India > Maharashtra
- Atlantic Ocean > Gulf of Mexico (0.04)
- Europe
- Belgium > Brussels-Capital Region
- Brussels (0.04)
- Middle East > Republic of Türkiye
- Istanbul Province > Istanbul (0.04)
- Estonia (0.04)
- France
- Portugal > Lisbon
- Lisbon (0.04)
- United Kingdom > England
- Oxfordshire > Oxford (0.04)
- Germany > Saxony
- Leipzig (0.04)
- Italy > Tuscany
- Florence (0.04)
- Iceland > Capital Region
- Reykjavik (0.04)
- Netherlands > North Holland
- Amsterdam (0.04)
- Belgium > Brussels-Capital Region
- Indian Ocean (0.04)
- North America
- Canada > Ontario
- Toronto (0.14)
- Haiti (0.14)
- The Bahamas (0.14)
- Saint Lucia (0.14)
- Central America (0.34)
- United States
- District of Columbia > Washington (0.04)
- Pennsylvania (0.04)
- Washington > King County
- Seattle (0.04)
- Louisiana (0.05)
- Georgia (0.04)
- Massachusetts > Middlesex County
- Cambridge (0.04)
- Minnesota (0.04)
- California > San Diego County
- San Diego (0.04)
- South Carolina (0.04)
- Jamaica (0.04)
- Mexico (0.14)
- Guadeloupe (0.04)
- Nicaragua (0.04)
- Belize (0.04)
- Antigua and Barbuda (0.04)
- Dominican Republic (0.04)
- Martinique (0.04)
- Costa Rica (0.04)
- Aruba (0.04)
- Panama (0.04)
- Curaçao (0.04)
- Canada > Ontario
- Oceania
- Australia > Victoria
- Melbourne (0.04)
- Papua New Guinea (0.04)
- Australia > Victoria
- South America
- Africa
- Genre:
- Research Report (1.00)
- Industry:
- Government > Regional Government (0.67)
- Technology: