mlsanityData to 14 Oct 2026

VeriGraph: Towards Verifiable Data-Analytic Agents

arXiv 2606.16603 ↗First posted 15 Jun 2026cs.CL cs.AIcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

LLM-based agents have demonstrated strong capabilities in data-intensive analytical tasks, yet their outputs are rarely verifiable: a reliance on linear text trajectories makes their reasoning difficult to audit. In particular, deterministic computations over raw data and semantic deductions over natural-language claims are often entangled in an unstructured stream, leaving numerical conclusions hard to reproduce and qualitative judgments hard to inspect. To address this, we propose VeriGraph, a traceable neuro-symbolic reasoning framework that enables agents to construct an explicit heterogeneous evidence directed acyclic graph (DAG) during execution. VeriGraph introduces three evidence-expansion primitives, namely computational, grounding, and derivational expansion, to connect raw data, interpreter variables, computed results, and natural-language claims in a unified graph. Under this formulation, structural traceability is reduced to graph reachability from raw data sources to terminal claims, while semantic support is measured by claim-level evidence evaluation. To improve graph construction, we further design a graph-based policy optimization strategy with a composite reward that jointly supervises answer correctness, computational integrity, and derivational coherence. Experiments on four benchmarks show that VeriGraph-8B achieves the highest overall score among all baselines. More importantly, VeriGraph produces auditable evidence graphs with substantially stronger claim grounding, achieving a 87.61% Grounding Rate under our claim-level evidence support evaluation. These results suggest that explicit evidence-graph construction is a promising path toward verifiable data-analytic agents. Our code is available at https://github.com/ignorejjj/VeriGraph.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 57 of its 75 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

57 of 75 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Science19 Oct
  2. 2025Scaling Generalist Data-Analytic Agents29 Sep
  3. 2025DABstep: Data Agent Benchmark for Multi-step Reasoning30 Jun
  4. 2025Search-o1: Agentic Search-Enhanced Large Reasoning Models9 Jan
  5. 2024Data Interpreter: An LLM Agent For Data Science28 Feb
  6. 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoning27 Feb
  7. 2024InfiAgent-DABench: Evaluating Agents on Data Analysis Tasks10 Jan

Other references · 50

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  5. 2017Deep reinforcement learning from human preferencescited by 3,912
  6. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  7. 2023A Survey of Large Language Modelscited by 2,576
  8. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  9. 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 2,057
  10. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  11. 2023Self-RAG: Learning to Retrieve, Generate, and Critique through Self-Reflectioncited by 1,839
  12. 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,444
38 more
  1. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,076
  2. 2022Measuring and Narrowing the Compositionality Gap in Language Modelscited by 1,075
  3. 2025Group Sequence Policy Optimizationcited by 835
  4. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  5. 2024A Survey on Large Language Models for Code Generationcited by 658
  6. 2022PAL: Program-aided Language Modelscited by 652
  7. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  8. 2024Executable Code Actions Elicit Better LLM Agentscited by 564
  9. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
  10. 2025ToolRL: Reward is All Tool Learning Needscited by 362
  11. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  12. 2023StructGPT: A General Framework for Large Language Model to Reason over Structured Datacited by 343
  13. 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 336
  14. 2025WebThinker: Empowering Large Reasoning Models with Deep Research Capabilitycited by 335
  15. 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 324
  16. 2023Evaluating Verifiability in Generative Search Enginescited by 303
  17. 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
  18. 2025Large Language Model Agent: A Survey on Methodology, Applications and Challengescited by 205
  19. 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 128
  20. 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 121
  21. 2025StepSearch: Igniting LLMs Search Ability via Step-Wise Proximal Policy Optimizationcited by 88
  22. 2024Trustworthiness in Retrieval-Augmented Generation Systems: A Surveycited by 83
  23. 2023Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflowcited by 76
  24. 2024TableGPT2: A Large Multimodal Model with Tabular Data Integrationcited by 72
  25. 2024AutoKaggle: A Multi-Agent Framework for Autonomous Data Science Competitionscited by 70
  26. 2025SQL-R1: Training Natural Language to SQL Reasoning Model By Reinforcement Learningcited by 68
  27. 2024TrustAgent: Towards Safe and Trustworthy LLM-based Agentscited by 64
  28. 2025START: Self-taught Reasoner with Toolscited by 47
  29. 2024Financial Report Chunking for Effective Retrieval Augmented Generationcited by 46
  30. 2025Table-R1: Region-based Reinforcement Learning for Table Understandingcited by 37
  31. 2024Citation-Enhanced Generation for LLM-based Chatbotscited by 25
  32. 2025Beyond the Final Answer: Evaluating the Reasoning Trajectories of Tool-Augmented Agentscited by 24
  33. 2025FinSight: Towards Real-World Financial Deep Researchcited by 9
  34. 2025Graph of Verification: Structured Verification of LLM Reasoning with Directed Acyclic Graphscited by 8
  35. 2026FM-Agent: Scaling Formal Methods to Large Systems via LLM-Based Hoare-Style Reasoningcited by 6
  36. 2023Establishing Trustworthiness: Rethinking Tasks and Model Evaluationcited by 4
  37. 2025Neuro-Symbolic Query Compilercited by 4
  38. 2025MedCEG: Reinforcing Verifiable Medical Reasoning with Critical Evidence Graphcited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Verify-in-the-Graph: Entity Disambiguation Enhancement for Complex Claim Verification with Interactive Graph Representation
  2. 2025HyDRA: A Hybrid-Driven Reasoning Architecture for Verifiable Knowledge Graphs
  3. 2025R2-KG: General-Purpose Dual-Agent Framework for Reliable Reasoning on Knowledge Graphs
  4. 2026CIVeX: Causal Intervention Verification for Language Agents
  5. 2026Stochastic Semantic Evidence Graphs: Uncertainty Propagation and Governance for Agentic AI
  6. 2026PEARL: Auditable Repair for Scientific Reasoning Graph Extraction
  7. 2023GraphReason: Enhancing Reasoning Capabilities of Large Language Models through A Graph-Based Verification Approach
  8. 2023Think-on-Graph: Deep and Responsible Reasoning of Large Language Model on Knowledge Graph