mlsanityData to 14 Oct 2026

K-FinHallu: A Hallucination Detection Benchmark for Multi-Turn RAG in Korean Finance

arXiv 2605.29523 ↗First posted 28 May 2026cs.LGcited by 1

On the map: Retrieval-augmented generation → Hallucination detection in RAG

Abstract (arXiv)

Large Language Models (LLMs) have advanced financial automation through Retrieval-Augmented Generation (RAG), yet hallucinations remain a critical barrier to deployment in high-stakes environments. Existing benchmarks focus on single-turn, English-centric tasks, leaving the multi-turn dynamics and linguistic-regulatory nuances of the Korean financial domain unaddressed. We introduce K-FinHallu, the first benchmark for hallucination detection in multi-turn Korean financial RAG. We construct multi-turn dialogues from authentic Korean financial documents and inject hallucinations under a proposed hierarchical taxonomy based on context answerability that explicitly accounts for justified abstention. Benchmarking frontier and open-source LLMs as hallucination detectors, we find that even the strongest models struggle with fine-grained financial diagnostics and refusal behavior. While fine-tuning an 8B model on our training split yields performance competitive with frontier LLMs, justified abstention remains the weakest axis across all evaluated models.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Hallucination detection in RAG, one of 15 directions in Retrieval-augmented generation. Builds on 19 of its 32 references that are in the map. First posted on arXiv 28 May 2026.

Builds on

19 of 32 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models31 Dec

Other references · 18

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  5. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  6. 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
  7. 2018CoQA: A Conversational Question Answering Challengecited by 683
  8. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  9. 2024Fine-grained Hallucination Detection and Editing for Language Modelscited by 149
  10. 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 109
  11. 2024KMMLU: Measuring Massive Multitask Language Understanding in Koreancited by 91
  12. 2025MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systemscited by 51
6 more
  1. 2023HAE-RAE Bench: Evaluation of Korean Knowledge in Language Modelscited by 47
  2. 2024AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Frameworkcited by 47
  3. 2025EXAONE 4.0: Unified Large Language Models Integrating Non-reasoning and Reasoning Modescited by 32
  4. 2024OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domaincited by 29
  5. 2024Open Ko-LLM Leaderboard: Evaluating Large Language Models in Korean with Ko-H5 Benchmarkcited by 23
  6. 2024Multi-Document Grounded Multi-Turn Synthetic Dialog Generationcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2023Deficiency of Large Language Models in Finance: An Empirical Examination of Hallucination
  2. 2025FRED: Financial Retrieval-Enhanced Detection and Editing of Hallucinations in Language Models
  3. 2026Empowering Small Language Models with Factual Hallucination-Aware Reasoning for Financial Classification
  4. 2025Dissecting the Ledger: Locating and Suppressing "Liar Circuits" in Financial Large Language Models
  5. 2026FinGround: Detecting and Grounding Financial Hallucinations via Atomic Claim Verification
  6. 2026Mitigating Hallucination in Financial Retrieval-Augmented Generation via Fine-Grained Knowledge Verification
  7. 2023Hallucination-minimized Data-to-answer Framework for Financial Decision-makers
  8. 2025Benchmarking LLM Faithfulness in RAG with Evolving Leaderboards