mlsanityData to 14 Oct 2026

100% Elimination of Hallucinations on RAGTruth for GPT-4 and GPT-3.5 Turbo

arXiv 2412.05223 ↗First posted 6 Dec 2024cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

The issue of hallucinations in large language models (LLMs) remains a critical barrier to the adoption of AI in enterprise and other high-stakes applications. Despite advancements in retrieval-augmented generation (RAG) systems, current state-of-the-art methods fail to achieve more than 80% accuracy in generating faithful and factually correct outputs, even when provided with relevant and accurate context. In this work, we introduce Acurai, a novel systematic approach that achieves 100% hallucination-free responses in LLMs by reformatting queries and context data prior to input. Leveraging a deep understanding of LLM internal representations, the importance of noun-phrase dominance, and the role of discrete functional units (DFUs), Acurai ensures alignment between input context and generated output. We validate this method using the RAGTruth corpus, demonstrating its ability to eliminate 100% hallucinations for both GPT-4 and GPT-3.5 Turbo. Acurai sets a new standard for achieving consistent, accurate, and faithful AI responses, marking a significant step forward in the development of trustworthy AI systems.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 12 of its 18 references that are in the map. First posted on arXiv 6 Dec 2024.

Builds on

12 of 18 references.

References · 12

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  3. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  4. 2024Scaling and evaluating sparse autoencoderscited by 553
  5. 2024Measuring short-form factuality in large language modelscited by 373
  6. 2023A Survey of Hallucination in Large Foundation Modelscited by 368
  7. 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Modelscited by 283
  8. 2023Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answeringcited by 151
  9. 2023Factuality Challenges in the Era of Large Language Modelscited by 126
  10. 2024RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systemscited by 117
  11. 2024LongRAG: Enhancing Retrieval-Augmented Generation with Long-context LLMscited by 108
  12. 2024In Defense of RAG in the Era of Long-Context Language Modelscited by 53

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Benchmarking LLM Faithfulness in RAG with Evolving Leaderboards
  2. 2025LUMINA: Detecting Hallucinations in RAG System with Context-Knowledge Signals
  3. 2024Reducing hallucination in structured outputs via Retrieval-Augmented Generation
  4. 2026Mitigating Hallucination on Hallucination in RAG via Ensemble Voting
  5. 2024RAGged Edges: The Double-Edged Sword of Retrieval-Augmented Chatbots
  6. 2024HaluEval-Wild: Evaluating Hallucinations of Language Models in the Wild
  7. 2026RAGognizer: Hallucination-Aware Fine-Tuning via Detection Head Integration
  8. 2024THaMES: An End-to-End Tool for Hallucination Mitigation and Evaluation in Large Language Models