Unveiling the Power of Source: Source-based Minimum Bayes Risk Decoding for Neural Machine Translation
Lyu, Boxuan, Kamigaito, Hidetaka, Funakoshi, Kotaro, Okumura, Manabu
–arXiv.org Artificial Intelligence
Maximum a posteriori decoding, a commonly used method for neural machine translation (NMT), aims to maximize the estimated posterior probability. However, high estimated probability does not always lead to high translation quality. Minimum Bayes Risk (MBR) decoding offers an alternative by seeking hypotheses with the highest expected utility. In this work, we show that Quality Estimation (QE) reranking, which uses a QE model as a reranker, can be viewed as a variant of MBR. Inspired by this, we propose source-based MBR (sMBR) decoding, a novel approach that utilizes synthetic sources generated by backward translation as ``support hypotheses'' and a reference-free quality estimation metric as the utility function, marking the first work to solely use sources in MBR decoding. Experiments show that sMBR significantly outperforms QE reranking and is competitive with standard MBR decoding. Furthermore, sMBR calls the utility function fewer times compared to MBR. Our findings suggest that sMBR is a promising approach for high-quality NMT decoding.
arXiv.org Artificial Intelligence
Jun-17-2024
- Country:
- North America > United States
- Washington > King County
- Seattle (0.04)
- Pennsylvania > Philadelphia County
- Philadelphia (0.04)
- New York > New York County
- New York City (0.04)
- Louisiana > Orleans Parish
- New Orleans (0.04)
- Hawaii > Honolulu County
- Honolulu (0.04)
- California
- San Francisco County > San Francisco (0.14)
- San Diego County > San Diego (0.04)
- Washington > King County
- Europe
- Germany > Berlin (0.04)
- Spain
- Valencian Community > Valencia Province
- Valencia (0.04)
- Catalonia > Barcelona Province
- Barcelona (0.04)
- Valencian Community > Valencia Province
- Italy > Tuscany
- Florence (0.04)
- Belgium > Brussels-Capital Region
- Brussels (0.04)
- Asia
- Singapore (0.04)
- China > Hong Kong (0.04)
- Middle East
- Japan > Honshū
- Kantō > Tokyo Metropolis Prefecture
- Tokyo (0.04)
- Chūbu > Aichi Prefecture
- Nagoya (0.04)
- Kantō > Tokyo Metropolis Prefecture
- North America > United States
- Genre:
- Research Report > New Finding (1.00)
- Technology: