Vision: Data-Centric Anchoring for Robust and Interpretable Agentic AI
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Agentic AI systems built on large language models fail in two persistent ways that scaling does not fix: they break under distribution shift, and they cannot explain the decisions they make. We argue these are co-symptoms of one structural deficiency in the data lifecycle that governs how agents are trained, evaluated, and deployed. Observational interaction logs record what an agent did, not what it would have done otherwise. They encode spurious correlations without controlled variation, so they lack the counterfactual structure needed to separate causal signal from coincidence or to validate an explanation. No model-centric method can recover invariances the data never contained. We present Data-Centric Anchoring: robustness and interpretability should be engineered into the data environment, not extracted from models after training. Our central contribution is the Data-Centric Agentic Loop, a four-stage framework of Curate, Augment, Constrain, and Attribute. The ordering is structural, not stylistic. Curation precedes augmentation because generative models amplify whatever bias they are trained on. Augmentation precedes constraint because invariance objectives are vacuous without variation across environments to be invariant to. Attribution closes the loop, converting observed failures into targeted data interventions for the next iteration. Each stage manufactures the preconditions of the next, which makes the loop self-correcting rather than merely sequential. We ground the framework in a failure-driven taxonomy that links four core failure modes to the data lifecycle: spurious feature reliance, distribution-shift fragility, uncertainty miscalibration, and explanation unfaithfulness. We close with the limits of this approach and the open problems that stand between it and practical deployment at scale.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 43 of its 51 references that are in the map. First posted on arXiv 8 Sep 2026.
Builds on
43 of 51 references.
Closest ancestors · 6
Same direction, newest first
- 2026AgentNoiseBench: Benchmarking Robustness of Tool-Using LLM Agents Under Noisy Condition11 Feb
- 2026What Do Agents Learn from Trajectory-SFT: Semantics or Interfaces?2 Feb
- 2025Survey on Evaluation of LLM-based Agents20 Mar
- 2024GTA: A Benchmark for General Tool Agents11 Jul
- 2024AgentQuest: A Modular Benchmark Framework to Measure Progress and Improve LLM Agents9 Apr
- 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents24 Jan
Other references · 37
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2019Invariant Risk Minimizationcited by 1,854
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2019Distributionally Robust Neural Networks for Group Shifts: On the Importance of Regularization for Worst-Case Generalizationcited by 1,247
- 2021Domain Generalization: A Surveycited by 764
- 2020Out-of-Distribution Generalization via Risk Extrapolation (REx)cited by 742
- 2023Measuring Faithfulness in Chain-of-Thought Reasoningcited by 703
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 672
- 2019Data Shapley: Equitable Valuation of Data for Machine Learningcited by 629
25 more
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2020Estimating Training Data Influence by Tracing Gradient Descentcited by 580
- 2019Confident Learning: Estimating Uncertainty in Dataset Labelscited by 413
- 2023Faithful Chain-of-Thought Reasoningcited by 288
- 2019Towards Efficient Data Valuation Based on the Shapley Valuecited by 281
- 2023Data-centric Artificial Intelligence: A Surveycited by 203
- 2018Representer Point Selection for Explaining Deep Neural Networkscited by 187
- 2022Training Data Influence Analysis and Estimation: A Surveycited by 135
- 2023SmartPlay: A Benchmark for LLMs as Intelligent Agentscited by 125
- 2024Making Reasoning Matter: Measuring and Improving Faithfulness of Chain-of-Thought Reasoningcited by 110
- 2024MixEval: Deriving Wisdom of the Crowd from LLM Benchmark Mixturescited by 74
- 2024Mobile-Bench: An Evaluation Benchmark for LLM-based Mobile Agentscited by 56
- 2023Data-centric AI: Perspectives and Challengescited by 43
- 2024Causal Inference with Large Language Model: A Surveycited by 32
- 2024Domain Generalization through Meta-Learning: A Surveycited by 28
- 2023From Identifiable Causal Representations to Controllable Counterfactual Generation: A Survey on Causal Generative Modelingcited by 22
- 2025A Survey on Data-Centric AI: Tabular Learning from Reinforcement Learning and Generative AI Perspectivecited by 14
- 2025A Snapshot of Influence: A Local Data Attribution Framework for Online Reinforcement Learningcited by 11
- 2023Distributionally Robust Optimization with Bias and Variance Reductioncited by 6
- 2025Rethinking Spatio-Temporal Anomaly Detection: A Vision for Causality-Driven Cybersecuritycited by 6
- 2026FinRule-Bench: A Benchmark for Joint Reasoning over Financial Tables and Principlescited by 5
- 2025Incremental Causal Graph Learning for Online Cyberattack Detection in Cyber-Physical Infrastructurescited by 4
- 2025DELTA: Variational Disentangled Learning for Privacy-Preserving Data Reprogrammingcited by 4
- 2026Causally-Guided Automated Feature Engineering with Multi-Agent Reinforcement Learningcited by 3
- 2025Daunce: Data Attribution through Uncertainty Estimationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026OpenThoughts-Agent: Data Recipes for Agentic Models
- 2026ToolAnchor: Anchoring Counterfactual Context to Boost Agentic Tool-use Capability
- 2026Agentic-imodels: Evolving agentic interpretability tools via autoresearch
- 2024Explanation, Debate, Align: A Weak-to-Strong Framework for Language Model Generalization
- 2026Interpreting Agentic Systems: Beyond Model Explanations to System-Level Accountability
- 2026Towards Faithful Agentic XAI: A Verification Method and an Open-World Benchmark for Better Model Faithfulness
- 2026ADE: Agentic Data Evolution Framework for Human-Centered Objectives
- 2026From Model Scaling to System Scaling: Scaling the Harness in Agentic AI