mlsanityData to 14 Oct 2026

What's the next frontier for Data-centric AI? Data Savvy Agents

arXiv 2511.01015 ↗First posted 2 Nov 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

The recent surge in AI agents that autonomously communicate, collaborate with humans and use diverse tools has unlocked promising opportunities in various real-world settings. However, a vital aspect remains underexplored: how agents handle data. Scalable autonomy demands agents that continuously acquire, process, and evolve their data. In this paper, we argue that data-savvy capabilities should be a top priority in the design of agentic systems to ensure reliable real-world deployment. Specifically, we propose four key capabilities to realize this vision: (1) Proactive data acquisition: enabling agents to autonomously gather task-critical knowledge or solicit human input to address data gaps; (2) Sophisticated data processing: requiring context-aware and flexible handling of diverse data challenges and inputs; (3) Interactive test data synthesis: shifting from static benchmarks to dynamically generated interactive test data for agent evaluation; and (4) Continual adaptation: empowering agents to iteratively refine their data and background knowledge to adapt to shifting environments. While current agent research predominantly emphasizes reasoning, we hope to inspire a reflection on the role of data-savvy agents as the next frontier in data-centric AI.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 45 of its 69 references that are in the map. First posted on arXiv 2 Nov 2025.

Builds on

45 of 69 references.

References · 45

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  2. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  3. 2023AgentBench: Evaluating LLMs as Agentscited by 1,267
  4. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
  5. 2023An Empirical Study of Catastrophic Forgetting in Large Language Models During Continual Fine-tuningcited by 639
  6. 2019Three scenarios for continual learningcited by 614
  7. 2024WebVoyager: Building an End-to-End Web Agent with Large Multimodal Modelscited by 438
  8. 2021Pervasive Label Errors in Test Sets Destabilize Machine Learning Benchmarkscited by 395
  9. 2024TheAgentCompany: Benchmarking LLM Agents on Consequential Real World Taskscited by 326
  10. 2024Magentic-One: A Generalist Multi-Agent System for Solving Complex Taskscited by 232
  11. 2024Data Interpreter: An LLM Agent For Data Sciencecited by 225
  12. 2023Data-centric Artificial Intelligence: A Surveycited by 203
33 more
  1. 2022Domino: Discovering Systematic Errors with Cross-Modal Embeddingscited by 156
  2. 2024DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoningcited by 125
  3. 2017Learning Active Learning from Datacited by 101
  4. 2024Revisiting Catastrophic Forgetting in Large Language Model Tuningcited by 99
  5. 2024Proactive Agent: Shifting LLM Agents from Reactive Responses to Active Assistancecited by 87
  6. 2022HyperImpute: Generalized Iterative Imputation with Automatic Model Selectioncited by 83
  7. 2025Lifelong Learning of Large Language Model based Agents: A Roadmapcited by 83
  8. 2024Scaling Retrieval-Based Language Models with a Trillion-Token Datastorecited by 56
  9. 2023OpenDataVal: a Unified Benchmark for Data Valuationcited by 55
  10. 2024Human-In-the-Loop Software Development Agentscited by 42
  11. 2023Diagnosing Model Performance Under Distribution Shiftcited by 39
  12. 2024Large Language Model-based Human-Agent Collaboration for Complex Task Solvingcited by 38
  13. 2021A Data Quality-Driven View of MLOpscited by 31
  14. 2024A Survey on Context-Aware Multi-Agent Systems: Techniques, Challenges and Future Directionscited by 27
  15. 2024Advancing Agentic Systems: Dynamic Task Decomposition, Tool Integration and Evaluation using Novel Metrics and Datasetcited by 24
  16. 2022AI Autonomy : Self-Initiated Open-World Continual Learning and Adaptationcited by 23
  17. 2022Data-IQ: Characterizing subgroups with heterogeneous outcomes in tabular datacited by 22
  18. 2024CleanAgent: Automating Data Standardization with LLM-based Agentscited by 22
  19. 2021Data Excellence for AI: Why Should You Carecited by 14
  20. 2022DC-Check: A Data-Centric AI checklist to guide the development of reliable machine learning systemscited by 14
  21. 2024Dissecting Sample Hardness: A Fine-Grained Analysis of Hardness Characterization Methods for Data-Centric AIcited by 11
  22. 2023Data Acquisition: A New Frontier in Data-centric AIcited by 9
  23. 2024Matchmaker: Self-Improving Large Language Model Programs for Schema Matchingcited by 9
  24. 2024Adapting to Non-Stationary Environments: Multi-Armed Bandit Enhanced Retrieval-Augmented Generation on Knowledge Graphscited by 9
  25. 2024Context-Aware Testing: A New Paradigm for Model Testing with Large Language Modelscited by 8
  26. 2023TRIAGE: Characterizing and auditing training data for improved regressioncited by 6
  27. 2024A hierarchical decomposition for explaining ML performance discrepanciescited by 5
  28. 2025YETI (YET to Intervene) Proactive Interventions by Multimodal AI Agents in Augmented Reality Taskscited by 4
  29. 2024You can't handle the (dirty) truth: Data-centric insights improve pseudo-labelingcited by 3
  30. 2024CliMB: An AI-enabled Partner for Clinical Predictive Modelingcited by 2
  31. 2025Towards Human-Guided, Data-Centric LLM Co-Pilotscited by 2
  32. 2022REPTILE: A Proactive Real-Time Deep Reinforcement Learning Self-adaptive Frameworkcited by 1
  33. 2023Anticipatory Thinking Challenges in Open Worlds: Risk Managementcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Data Agents: Agentic Data Systems
  2. 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?
  3. 2025Autonomous Data Agents: A New Opportunity for Smart Data
  4. 2026Atria Dawn: The Dawn of Agentic Superintelligence
  5. 2026Vision: Data-Centric Anchoring for Robust and Interpretable Agentic AI
  6. 2025Scaling Generalist Data-Analytic Agents
  7. 2026Agentic Data Environments
  8. 2025The Cost of Dynamic Reasoning: Demystifying AI Agents and Test-Time Scaling from an AI Infrastructure Perspective