Natural Answer Generation: From Factoid Answer to Full-length Answer using Grammar Correction
Jain, Manas, Saha, Sriparna, Bhattacharyya, Pushpak, Chinnadurai, Gladvin, Vatsa, Manish Kumar
–arXiv.org Artificial Intelligence
Question Answering systems these days typically use template-based language generation. Though adequate for a domain-specific task, these systems are too restrictive and predefined for domain-independent systems. This paper proposes a system that outputs a full-length answer given a question and the extracted factoid answer (short spans such as named entities) as the input. Our system uses constituency and dependency parse trees of questions. A transformer-based Grammar Error Correction model GECToR (2020), is used as a post-processing step for better fluency. We compare our system with (i) Modified Pointer Generator (SOTA) and (ii) Fine-tuned DialoGPT for factoid questions. We also test our approach on existential (yes-no) questions with better results. Our model generates accurate and fluent answers than the state-of-the-art (SOTA) approaches. The evaluation is done on NewsQA and SqUAD datasets with an increment of 0.4 and 0.9 percentage points in ROUGE-1 score respectively. Also the inference time is reduced by 85\% as compared to the SOTA. The improved datasets used for our evaluation will be released as part of the research contribution.
arXiv.org Artificial Intelligence
Dec-7-2021
- Country:
- Oceania > Australia
- North America
- United States
- Texas (0.04)
- Pennsylvania (0.04)
- Washington > King County
- Seattle (0.04)
- New York > New York County
- New York City (0.04)
- Arizona > Maricopa County
- Phoenix (0.05)
- Canada > British Columbia
- United States
- Europe
- United Kingdom > Scotland
- City of Aberdeen > Aberdeen (0.04)
- Spain > Catalonia
- Barcelona Province > Barcelona (0.04)
- Ireland > Leinster
- County Dublin > Dublin (0.04)
- United Kingdom > Scotland
- Asia
- China > Hong Kong (0.04)
- India > Maharashtra
- Mumbai (0.04)
- Genre:
- Research Report (0.64)
- Technology: