mlsanityData to 14 Oct 2026

Phantom Merge: When Your Large Language Model Agents Pick One but Tell You About Another

arXiv 2610.16141 ↗First posted 12 Oct 2026cs.AI cs.CLcited by 0

On the map: LLM agents and tool use → Agent threats, guardrails and governance also fits: Web, search, and research agents

Abstract (arXiv)

LLM agents increasingly operate over multiple entities, where reliable response generation requires not only retrieving relevant evidence but also preserving its association with the correct entity. We identify Phantom Merge (PM), an entity-evidence binding failure in which an agent attributes unsupported claims to its committed entity, potentially even when the task is completed correctly. We formalize PM at the claim level and characterize its prevalence and error subtypes across four agent domains and four backbone families. To address this problem, we propose a two-stage framework for claim-level risk estimation and correction. First, Anchor-Grounded Risk (AGR) combines a representational readout of the agent's pre-emission hidden state with Jacobian-based functional information, providing complementary slot-level and anchor-value risk scores. Second, Fixed-Anchor Correction (FAC) audits flagged claims and selectively revises them using observed anchor evidence or removes them when no supported replacement is available. On the held-out Shopping detection cohort, AGR-slot achieves an AUROC of 96.2% and an average precision of 97.3%, outperforming the evaluated detection baselines. In the end-to-end Shopping mitigation evaluation, FAC reduces trajectory-level PM from 51.4% to 6.2%, with an output-to-original claim ratio of 80.7%. These results demonstrate the prevalence of entity-specific grounding failures and the effectiveness of combining internal risk estimation with evidence-constrained claim correction. Our code is publicly available at https://github.com/LabRAI/PhantomMerge.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Agent threats, guardrails and governance, one of 16 directions in LLM agents and tool use. Builds on 40 of its 47 references that are in the map. First posted on arXiv 12 Oct 2026.

Builds on

40 of 47 references.

References · 40

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2022Locating and Editing Factual Associations in GPTcited by 2,691
  3. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
  4. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  5. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  6. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  7. 2024τ-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domainscited by 1,402
  8. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  9. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  10. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  11. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  12. 2022Mass-Editing Memory in a Transformercited by 1,001
28 more
  1. 2021Probing Classifiers: Promises, Shortcomings, and Advancescited by 876
  2. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  3. 2019Designing and Interpreting Probes with Control Taskscited by 640
  4. 2025τ2-Bench: Evaluating Conversational Agents in a Dual-Control Environmentcited by 627
  5. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  6. 2023API-Bank: A Comprehensive Benchmark for Tool-Augmented LLMscited by 591
  7. 2024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inferencecited by 554
  8. 2021SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarizationcited by 407
  9. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 401
  10. 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agentscited by 339
  11. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 324
  12. 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
  13. 2022RARR: Researching and Revising What Language Models Say, Using Language Modelscited by 287
  14. 2021Measuring Attribution in Natural Language Generation Modelscited by 256
  15. 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
  16. 2021QAFactEval: Improved QA-Based Factual Consistency Evaluation for Summarizationcited by 236
  17. 2024Long-form factuality in large language modelscited by 155
  18. 2023How do Language Models Bind Entities in Context?cited by 108
  19. 2023Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkerscited by 87
  20. 2024LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QAcited by 81
  21. 2026Verbalizable Representations Form a Global Workspace in Language Modelscited by 75
  22. 2024Representational Analysis of Binding in Language Modelscited by 28
  23. 2025ShoppingBench: A Real-World Intent-Grounded Shopping Benchmark for LLM-based Agentscited by 28
  24. 2025FHIR-AgentBench: Benchmarking LLM Agents for Realistic Interoperable EHR Question Answeringcited by 22
  25. 2024Learning Fine-Grained Grounded Citations for Attributed Large Language Modelscited by 13
  26. 2025On the Failure of Latent State Persistence in Large Language Modelscited by 9
  27. 2026Entity Binding Failures in Tool-Augmented Agentscited by 3
  28. 2026Binding Drift in Multi-Step Tool-Augmented Agentscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Proxy Confidence: Auditing Black-Box LLM Agents with a Surrogate's Log-Probabilities
  2. 2026LayerRAG-Bench: A Cross-Layer Reliability Benchmark for Agentic Retrieval-Augmented Generation
  3. 2026EAVer: Long-Form Factuality Verification as an End-to-End Agentic Policy
  4. 2026Beyond Aggregate Risk: Role-Stratified Conformal Risk Control for LLM Tool Calls
  5. 2026PrefixGuard: From LLM-Agent Traces to Online Failure-Warning Monitors
  6. 2026BLADE: Auditing Information Use for Failure Attribution in LLM Multi-Agent Systems
  7. 2026CoVeR: Coverage-Based Routing of Verifier Calls in Agentic Retrieval
  8. 2026CLAIR-Fin: An Adversarial Multi-Agent Framework for Claim-Level Verification and Adaptive Debate in Cross-Modal Financial QA