Augmenting Query and Passage for Retrieval-Augmented Generation using LLMs for Open-Domain Question Answering
Kim, Minsang, Park, Cheoneum, Baek, Seungjun
–arXiv.org Artificial Intelligence
Retrieval-augmented generation (RAG) has received much attention for Open-domain question-answering (ODQA) tasks as a means to compensate for the parametric knowledge of large language models (LLMs). While previous approaches focused on processing retrieved passages to remove irrelevant context, they still rely heavily on the quality of retrieved passages which can degrade if the question is ambiguous or complex. In this paper, we propose a simple yet efficient method called question and passage augmentation via LLMs for open-domain QA. Our method first decomposes the original questions into multiple-step sub-questions. By augmenting the original question with detailed sub-questions and planning, we are able to make the query more specific on what needs to be retrieved, improving the retrieval performance. In addition, to compensate for the case where the retrieved passages contain distracting information or divided opinions, we augment the retrieved passages with self-generated passages by LLMs to guide the answer extraction. Experimental results show that the proposed scheme outperforms the previous state-of-the-art and achieves significant performance gain over existing RAG methods.
arXiv.org Artificial Intelligence
Jun-20-2024
- Country:
- Asia
- Middle East > Jordan (0.04)
- Myanmar > Tanintharyi Region
- Dawei (0.04)
- Russia (0.14)
- Europe
- Croatia > Zagreb County
- Zagreb (0.04)
- France > Île-de-France
- Germany (0.04)
- Italy > Lazio
- Rome (0.04)
- Latvia > Riga Municipality
- Riga (0.04)
- Russia
- United Kingdom
- England (0.04)
- North Sea > Central North Sea
- Moray Firth (0.14)
- Scotland > Berwickshire (0.04)
- Croatia > Zagreb County
- North America
- Canada > British Columbia (0.04)
- Cayman Islands (0.04)
- United States
- California
- Los Angeles County > Los Angeles (0.04)
- San Diego County > San Diego (0.04)
- Pennsylvania (0.04)
- Georgia > Fulton County
- Atlanta (0.14)
- Virginia (0.04)
- Louisiana > Orleans Parish
- New Orleans (0.04)
- New York (0.04)
- Florida > Hillsborough County
- Tampa (0.28)
- Alabama (0.04)
- Indiana > Marion County
- Indianapolis (0.04)
- California
- Asia
- Genre:
- Personal > Obituary (0.46)
- Research Report > New Finding (0.34)
- Industry:
- Education > Educational Setting (0.67)
- Government (0.93)
- Health & Medicine (0.68)
- Leisure & Entertainment > Sports
- Media
- Technology: