Improve Sentence Alignment by Divide-and-conquer
–arXiv.org Artificial Intelligence
In this paper, we introduce a divide-and-conquer algorithm to improve sentence alignment speed. We utilize external bilingual sentence embeddings to find accurate hard delimiters for the parallel texts to be aligned. We use Monte Carlo simulation to show experimentally that using this divide-and-conquer algorithm, we can turn any quadratic time complexity sentence alignment algorithm into an algorithm with average time complexity of O(NlogN). On a standard OCR-generated dataset, our method improves the Bleualign baseline by 3 F1 points. Besides, when computational resources are restricted, our algorithm is faster than Vecalign in practice.
arXiv.org Artificial Intelligence
Jan-18-2022
- Country:
- North America > United States
- Pennsylvania > Philadelphia County
- Philadelphia (0.04)
- Ohio > Franklin County
- Columbus (0.04)
- New Mexico > Doña Ana County
- Las Cruces (0.04)
- California
- Los Angeles County > Santa Monica (0.04)
- Alameda County > Berkeley (0.04)
- Pennsylvania > Philadelphia County
- Europe
- Germany > Berlin (0.04)
- Middle East > Malta
- Port Region > Southern Harbour District > Valletta (0.04)
- Italy > Tuscany
- Florence (0.05)
- Belgium > Brussels-Capital Region
- Brussels (0.04)
- Asia > China
- North America > United States
- Genre:
- Research Report (0.40)
- Technology: