Enhancing Document-Level Question Answering via Multi-Hop Retrieval-Augmented Generation with LLaMA 3
Huang, Xinyue, Lin, Ziqi, Sun, Fang, Zhang, Wenchao, Tong, Kejian, Liu, Yunbo
–arXiv.org Artificial Intelligence
--This paper presents a novel Retrieval-Augmented Generation (RAG) framework tailored for complex question answering tasks, addressing challenges in multi-hop reasoning and contextual understanding across lengthy documents. Built upon LLaMA 3, the framework integrates a dense retrieval module with advanced context fusion and multi-hop reasoning mechanisms, enabling more accurate and coherent response generation. A joint optimization strategy combining retrieval likelihood and generation cross-entropy improves the model's robustness and adaptability. Experimental results show that the proposed system outperforms existing retrieval-augmented and generative baselines, confirming its effectiveness in delivering precise, contextually grounded answers. Understanding complex question answering (QA) tasks requires deep comprehension of documents containing numbers, legal texts, and intricate language.
arXiv.org Artificial Intelligence
Jun-23-2025
- Country:
- North America > United States > California > Los Angeles County > Los Angeles (0.14)
- Genre:
- Research Report > New Finding (0.34)
- Industry:
- Law (0.89)
- Technology: