Selecting Parallel In-domain Sentences for Neural Machine Translation Using Monolingual Texts
Sharami, Javad Pourmostafa Roshan, Shterionov, Dimitar, Spronck, Pieter
–arXiv.org Artificial Intelligence
Continuously-growing data volumes lead to larger generic models. Specific use-cases are usually left out, since generic models tend to perform poorly in domain-specific cases. Our work addresses this gap with a method for selecting in-domain data from generic-domain (parallel text) corpora, for the task of machine translation. The proposed method ranks sentences in parallel general-domain data according to their cosine similarity with a monolingual domain-specific data set. We then select the top K sentences with the highest similarity score to train a new machine translation system tuned to the specific in-domain data. Our experimental results show that models trained on this in-domain data outperform models trained on generic or a mixture of generic and domain data. That is, our method selects high-quality domain-specific training instances at low computational cost and data size.
arXiv.org Artificial Intelligence
Dec-20-2021
- Country:
- North America
- United States
- Texas > Travis County
- Austin (0.14)
- New York > New York County
- New York City (0.04)
- New Mexico > Santa Fe County
- Santa Fe (0.04)
- Minnesota > Hennepin County
- Minneapolis (0.14)
- Massachusetts > Middlesex County
- Cambridge (0.04)
- California
- San Francisco County > San Francisco (0.14)
- San Diego County > San Diego (0.04)
- Texas > Travis County
- Canada > British Columbia
- United States
- Europe
- Netherlands (0.04)
- Germany > Berlin (0.04)
- Denmark > Capital Region
- Copenhagen (0.04)
- Sweden > Uppsala County
- Uppsala (0.04)
- Bulgaria > Sofia City Province
- Sofia (0.04)
- Portugal > Lisbon
- Lisbon (0.04)
- Spain > Catalonia
- Barcelona Province > Barcelona (0.04)
- Middle East > Republic of Türkiye
- Istanbul Province > Istanbul (0.04)
- Belgium > Brussels-Capital Region
- Brussels (0.04)
- United Kingdom > Scotland
- City of Edinburgh > Edinburgh (0.04)
- Asia
- China > Hong Kong (0.04)
- Vietnam > Da Nang
- Da Nang (0.04)
- Thailand > Phuket
- Phuket (0.04)
- Middle East > Republic of Türkiye
- Istanbul Province > Istanbul (0.04)
- North America
- Genre:
- Research Report
- New Finding (1.00)
- Experimental Study > Negative Result (0.46)
- Research Report
- Technology: