refind
REFIND: Retrieval-Augmented Factuality Hallucination Detection in Large Language Models
Hallucinations in large language model (LLM) outputs severely limit their reliability in knowledge-intensive tasks such as question answering. To address this challenge, we introduce REFIND (Retrieval-augmented Factuality hallucINation Detection), a novel framework that detects hallucinated spans within LLM outputs by directly leveraging retrieved documents. As part of the REFIND, we propose the Context Sensitivity Ratio (CSR), a novel metric that quantifies the sensitivity of LLM outputs to retrieved evidence. This innovative approach enables REFIND to efficiently and accurately detect hallucinations, setting it apart from existing methods. In the evaluation, REFIND demonstrated robustness across nine languages, including low-resource settings, and significantly outperformed baseline models, achieving superior IoU scores in identifying hallucinated spans. This work highlights the effectiveness of quantifying context sensitivity for hallucination detection, thereby paving the way for more reliable and trustworthy LLM applications across diverse languages.
11 links to dive into the ethics of artificial intelligence
So many links… The Swiss start-up Refind proposes to deal with them in new ways. Refind offers not only social bookmarking, but also curation. In their section "Deep dives", experts share a link selection of approximately 10 articles in their domain. When I was asked to provide ten such links about the ethics of artificial intelligence, I was delighted to do so. Because it is impossible to do justice [pun intended] to "AI ethics" via 10 websites.
Ethics of Artificial Intelligence Deep Dive by Dr. Anna Jobin – Refind
Artificial Intelligence is one of the key technologies of the 21st century, with deep implications for everything from business to politics and people's everyday lives. With great power comes great responsibility, and thus reflections on the ethics of Artificial Intelligence are just as important as the development of actual technology and implementations. This Deep Dive gives you an overview on the state of AI Ethics. Dr. Anna Jobin is a Senior Researcher at the Alexander von Humboldt Institute for Internet and Society in Berlin. She has a multidisciplinary background in sociology, economics, and information management.