Compositional Generalization for Data-to-Text Generation
Xu, Xinnuo, Titov, Ivan, Lapata, Mirella
–arXiv.org Artificial Intelligence
Data-to-text generation involves transforming structured data, often represented as predicate-argument tuples, into coherent textual descriptions. Despite recent advances, systems still struggle when confronted with unseen combinations of predicates, producing unfaithful descriptions (e.g. hallucinations or omissions). We refer to this issue as compositional generalisation, and it encouraged us to create a benchmark for assessing the performance of different approaches on this specific problem. Furthermore, we propose a novel model that addresses compositional generalization by clustering predicates into groups. Our model generates text in a sentence-by-sentence manner, relying on one cluster of predicates at a time. This approach significantly outperforms T5~baselines across all evaluation metrics.Notably, it achieved a 31% improvement over T5 in terms of a metric focused on maintaining faithfulness to the input.
arXiv.org Artificial Intelligence
Dec-5-2023
- Country:
- Asia
- India > Karnataka
- Bengaluru (0.04)
- Japan > Honshū
- Kantō > Tokyo Metropolis Prefecture > Tokyo (0.14)
- Middle East > Republic of Türkiye
- Ankara Province > Ankara (0.04)
- Istanbul Province > Istanbul (0.04)
- İzmir Province > İzmir (0.05)
- Singapore (0.04)
- India > Karnataka
- Europe
- Germany > Saarland
- Saarbrücken (0.04)
- United Kingdom > Scotland (0.04)
- Ireland > Leinster
- County Dublin > Dublin (0.04)
- Middle East > Republic of Türkiye
- Istanbul Province > Istanbul (0.04)
- Portugal > Lisbon
- Lisbon (0.04)
- Bulgaria > Sofia City Province
- Sofia (0.04)
- Sweden > Uppsala County
- Uppsala (0.04)
- Spain > Andalusia (0.04)
- Denmark > Capital Region
- Copenhagen (0.04)
- Italy > Tuscany
- Florence (0.04)
- Netherlands > North Holland
- Amsterdam (0.04)
- Germany > Saarland
- North America
- Canada > British Columbia
- United States
- California > San Diego County
- San Diego (0.04)
- Indiana > Fountain County (0.04)
- Massachusetts (0.04)
- Minnesota > Hennepin County
- Minneapolis (0.14)
- New Jersey (0.05)
- Pennsylvania > Indiana County (0.04)
- Texas (0.04)
- Washington > King County
- Seattle (0.04)
- California > San Diego County
- Asia
- Genre:
- Research Report > New Finding (0.67)
- Industry:
- Technology: