GSAR: Typed Grounding for Hallucination Detection and Recovery in Multi-Agent LLMs
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
Autonomous multi-agent LLM systems are increasingly deployed to investigate operational incidents and produce structured diagnostic reports. Their trustworthiness hinges on whether each claim is grounded in observed evidence rather than model-internal inference. Existing groundedness evaluators (binary classifiers, LLM-as-judge scalars, self-correction loops) treat supporting evidence as interchangeable and emit a single signal that offers no principled control over downstream action. We present GSAR, a grounding-evaluation and replanning framework that (i) partitions claims into a four-way typology (grounded, ungrounded, contradicted, complementary), giving first-class standing to non-redundant alternative perspectives; (ii) assigns evidence-type-specific weights reflecting epistemic strength; (iii) computes an asymmetric contradiction-penalised weighted groundedness score; and (iv) couples that score to a three-tier decision function (proceed, regenerate, replan) driving a bounded-iteration outer loop under an explicit compute budget. We formalise the algorithm, prove six structural properties, and evaluate five design claims on FEVER with gold Wikipedia evidence under four independently-trained LLM judges (gpt-5.4, claude-sonnet-4-6, claude-opus-4-7, gemini-2.5-pro). Every ablation reproduces in the same direction on every judge: bootstrap 95% CIs on the rho=0 effect exclude 0 on all four; the no-complementary ablation under Opus 4.7 has CI [-96,-68] of 200; at n=1000 three independent judges converge to DeltaS(rho=0)=+0.058. A head-to-head against Vectara HHEM-2.1-Open is included. To our knowledge, GSAR is the first published groundedness framework coupling evidence-typed scoring with tiered recovery under an explicit compute budget.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 37 references that are in the map. First posted on arXiv 25 Apr 2026.
Builds on
20 of 37 references.
References · 20
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2023Ragas: Automated Evaluation of Retrieval Augmented Generationcited by 408
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2025Process Reward Models That Thinkcited by 118
8 more
- 2023Let's reward step by step: Step-Level reward model as the Navigators for Reasoningcited by 96
- 2023RCAgent: Cloud Root Cause Analysis by Autonomous Agents with Tool-Augmented Large Language Modelscited by 62
- 2024Exploring LLM-based Agents for Root Cause Analysiscited by 60
- 2024FIRE: Fact-checking with Iterative Retrieval and Verificationcited by 39
- 2025AIOpsLab: A Holistic Framework to Evaluate AI Agents for Enabling Autonomous Cloudscited by 36
- 2024Building AI Agents for Autonomous Clouds: Challenges and Design Principlescited by 19
- 2025Benchmarking LLM Faithfulness in RAG with Evolving Leaderboardscited by 19
- 2026MedRAGChecker: Claim-Level Verification for Biomedical Retrieval-Augmented Generationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026AgentHallu: Benchmarking Automated Hallucination Attribution of LLM-based Agents
- 2026MARCH: Multi-Agent Reinforced Self-Check for LLM Hallucination
- 2024Towards Detecting LLMs Hallucination via Markov Chain-based Multi-agent Debate Framework
- 2026Leveraging Low-Level Symbolic Competences for Unsupervised Grounding in Hallucination Detection
- 2025MMD-Flagger: Leveraging Maximum Mean Discrepancy to Detect Hallucinations
- 2026OptArgus: A Multi-Agent System to Detect Hallucinations in LLM-based Optimization Modeling
- 2026Beneath the Scores: Rethinking Hallucination Evaluation for Video Understanding Models
- 2026Actionable Hallucination Detection: Translating Latent Uncertainty into Agentic Critique