VISTA: Verification In Sequential Turn-based Assessment
Not on the map. Why?
Abstract (arXiv)
Hallucination--defined here as generating statements unsupported or contradicted by available evidence or conversational context--remains a major obstacle to deploying conversational AI systems in settings that demand factual reliability. Existing metrics either evaluate isolated responses or treat unverifiable content as errors, limiting their use for multi-turn dialogue. We introduce VISTA (Verification In Sequential Turn-based Assessment), a framework for evaluating conversational factuality through claim-level verification and sequential consistency tracking. VISTA decomposes each assistant turn into atomic factual claims, verifies them against trusted sources and dialogue history, and categorizes unverifiable statements (subjective, contradicted, lacking evidence, or abstaining). Across eight large language models and four dialogue factuality benchmarks (AIS, BEGIN, FAITHDIAL, and FADE), VISTA substantially improves hallucination detection over FACTSCORE and LLM-as-Judge baselines. Human evaluation confirms that VISTA's decomposition improves annotator agreement and reveals inconsistencies in existing benchmarks. By modeling factuality as a dynamic property of conversation, VISTA offers a more transparent, human-aligned measure of truthfulness in dialogue systems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 15 of its 46 references that are in the map. First posted on arXiv 30 Oct 2025.
Builds on
15 of 46 references.
References · 15
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,276
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
- 2023AlignScore: Evaluating Factual Consistency with a Unified Alignment Functioncited by 288
- 2021Measuring Attribution in Natural Language Generation Modelscited by 256
- 2021Q2: Evaluating Factual Consistency in Knowledge-Grounded Dialogues via Question Generation and Question Answeringcited by 132
- 2022FaithDial: A Faithful Benchmark for Information-Seeking Dialoguecited by 109
- 2024The Art of Saying No: Contextual Noncompliance in Language Modelscited by 105
- 2021Evaluating Attribution in Dialogue Systems: The BEGIN Benchmarkcited by 77
- 2021DialFact: A Benchmark for Fact-Checking in Dialoguecited by 62
- 2025Does Thinking More always Help? Mirage of Test-Time Scaling in Reasoning Modelscited by 53
- 2023Diving Deep into Modes of Fact Hallucinations in Dialogue Systemscited by 32
Built on by
Citing papers per year: 2026: 1.
1 paper.