TrustRAG: An Information Assistant with Retrieval Augmented Generation
Fan, Yixing, Yan, Qiang, Wang, Wenshan, Guo, Jiafeng, Zhang, Ruqing, Cheng, Xueqi
–arXiv.org Artificial Intelligence
\Ac{RAG} has emerged as a crucial technique for enhancing large models with real-time and domain-specific knowledge. While numerous improvements and open-source tools have been proposed to refine the \ac{RAG} framework for accuracy, relatively little attention has been given to improving the trustworthiness of generated results. To address this gap, we introduce TrustRAG, a novel framework that enhances \ac{RAG} from three perspectives: indexing, retrieval, and generation. Specifically, in the indexing stage, we propose a semantic-enhanced chunking strategy that incorporates hierarchical indexing to supplement each chunk with contextual information, ensuring semantic completeness. In the retrieval stage, we introduce a utility-based filtering mechanism to identify high-quality information, supporting answer generation while reducing input length. In the generation stage, we propose fine-grained citation enhancement, which detects opinion-bearing sentences in responses and infers citation relationships at the sentence-level, thereby improving citation accuracy. We open-source the TrustRAG framework and provide a demonstration studio designed for excerpt-based question answering tasks \footnote{https://huggingface.co/spaces/golaxy/TrustRAG}. Based on these, we aim to help researchers: 1) systematically enhancing the trustworthiness of \ac{RAG} systems and (2) developing their own \ac{RAG} systems with more reliable outputs.
arXiv.org Artificial Intelligence
Feb-19-2025
- Genre:
- Overview (0.69)
- Research Report (0.50)
- Technology:
- Information Technology > Artificial Intelligence
- Machine Learning > Neural Networks
- Deep Learning (0.44)
- Natural Language
- Chatbot (0.44)
- Information Retrieval (0.69)
- Large Language Model (0.73)
- Question Answering (0.55)
- Text Processing (0.49)
- Machine Learning > Neural Networks
- Information Technology > Artificial Intelligence