K-FinHallu: A Hallucination Detection Benchmark for Multi-Turn RAG in Korean Finance
On the map: Retrieval-augmented generation → Hallucination detection in RAG
Abstract (arXiv)
Large Language Models (LLMs) have advanced financial automation through Retrieval-Augmented Generation (RAG), yet hallucinations remain a critical barrier to deployment in high-stakes environments. Existing benchmarks focus on single-turn, English-centric tasks, leaving the multi-turn dynamics and linguistic-regulatory nuances of the Korean financial domain unaddressed. We introduce K-FinHallu, the first benchmark for hallucination detection in multi-turn Korean financial RAG. We construct multi-turn dialogues from authentic Korean financial documents and inject hallucinations under a proposed hierarchical taxonomy based on context answerability that explicitly accounts for justified abstention. Benchmarking frontier and open-source LLMs as hallucination detectors, we find that even the strongest models struggle with fine-grained financial diagnostics and refusal behavior. While fine-tuning an 8B model on our training split yields performance competitive with frontier LLMs, justified abstention remains the weakest axis across all evaluated models.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Hallucination detection in RAG, one of 15 directions in Retrieval-augmented generation. Builds on 19 of its 32 references that are in the map. First posted on arXiv 28 May 2026.
Builds on
19 of 32 references.
Closest ancestors · 1
Same direction, newest first
- 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models31 Dec
Other references · 18
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Measuring Massive Multitask Language Understandingcited by 7,963
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2021Retrieval Augmentation Reduces Hallucination in Conversationcited by 692
- 2018CoQA: A Conversational Question Answering Challengecited by 683
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2024Fine-grained Hallucination Detection and Editing for Language Modelscited by 149
- 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 109
- 2024KMMLU: Measuring Massive Multitask Language Understanding in Koreancited by 91
- 2025MTRAG: A Multi-Turn Conversational Benchmark for Evaluating Retrieval-Augmented Generation Systemscited by 51
6 more
- 2023HAE-RAE Bench: Evaluation of Korean Knowledge in Language Modelscited by 47
- 2024AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Frameworkcited by 47
- 2025EXAONE 4.0: Unified Large Language Models Integrating Non-reasoning and Reasoning Modescited by 32
- 2024OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domaincited by 29
- 2024Open Ko-LLM Leaderboard: Evaluating Large Language Models in Korean with Ko-H5 Benchmarkcited by 23
- 2024Multi-Document Grounded Multi-Turn Synthetic Dialog Generationcited by 7
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2023Deficiency of Large Language Models in Finance: An Empirical Examination of Hallucination
- 2025FRED: Financial Retrieval-Enhanced Detection and Editing of Hallucinations in Language Models
- 2026Empowering Small Language Models with Factual Hallucination-Aware Reasoning for Financial Classification
- 2025Dissecting the Ledger: Locating and Suppressing "Liar Circuits" in Financial Large Language Models
- 2026FinGround: Detecting and Grounding Financial Hallucinations via Atomic Claim Verification
- 2026Mitigating Hallucination in Financial Retrieval-Augmented Generation via Fine-Grained Knowledge Verification
- 2023Hallucination-minimized Data-to-answer Framework for Financial Decision-makers
- 2025Benchmarking LLM Faithfulness in RAG with Evolving Leaderboards