mlsanityData to 14 Oct 2026

Agentic Data Cleaning Without a Clean Reference: An Experimental Study of Capabilities and Trade-offs

arXiv 2608.14765 ↗First posted 14 Aug 2026cs.AI cs.DBcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Data cleaning without a trusted clean reference is challenging because unusual values may represent either genuine errors or valid observations. This paper studies how different agent capabilities affect reference-free data cleaning and proposes an evidence-grounded framework that combines structured context, profiling, LLM reasoning, executable checks, controlled evidence retrieval, source ranking, citation alignment, conservative repair, reversible scripts, and provenance logging. Seven configurations are evaluated across financial, clinical, and environmental-monitoring datasets using controlled synthetic corruption and original-data descriptive analysis, resulting in 126 completed runs. The evaluation includes two comparison baselines and a progressive LLM-based sequence that adds executable tools, evidence retrieval, evidence controls, and conservative repair. In the synthetic evaluation, the deterministic profiling baseline achieved the highest detection F1-score of 0.561. Among the LLM-based configurations, the full conservative configuration achieved the highest F1-score of 0.421, but no configuration performed best across all evaluation criteria. The source-ranked configurations achieved the lowest unsupported-rule rates, while decision-level citation alignment remained weak. The full conservative configuration produced no unsafe or unnecessary modifications, although these rates were already zero before the conservative policy was added, and it performed no direct repairs. Overall, the results show that additional capabilities introduce trade-offs among detection, repair, evidence grounding, conservative behaviour, reproducibility, and operational cost rather than producing consistent improvements. The study provides a structured framework and empirical methodology for evaluating these trade-offs in reference-free agentic data cleaning.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 14 of its 39 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

14 of 39 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024CleanAgent: Automating Data Standardization with LLM-based Agents13 Mar

Other references · 13

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  4. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  5. 2021Measuring Attribution in Natural Language Generation Modelscited by 256
  6. 2022Can Foundation Models Wrangle Your Data?cited by 175
  7. 2017HoloClean: Holistic Data Repairs with Probabilistic Inferencecited by 79
  8. 2024AutoDCWorkflow: LLM-based Data Cleaning Workflow Auto-Generation and Benchmarkcited by 24
  9. 2024LLMClean: Context-Aware Tabular Data Cleaning via LLM-Generated OFDscited by 19
  10. 2020PClean: Bayesian Data Cleaning at Scale with Domain-Specific Probabilistic Programmingcited by 10
  11. 2024Data Cleaning Using Large Language Modelscited by 7
  12. 2024Cocoon: Semantic Table Profiling Using Large Language Modelscited by 6
1 more
  1. 2022Use of Context in Data Quality Management: a Systematic Literature Reviewcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Correct Answers, Unsupported Findings: Evidence Binding in Forensic Reconstruction of LLM Agent Logs
  2. 2026Beyond the Text: Verifying That Agent-Written Papers Are Backed by Their Artifacts
  3. 2026When Evidence Changes: Evaluating Memory Repair and Re-reading in Language-Model Agents
  4. 2026SCIRIGOR:Evaluating Open-Ended Scientific Analysis Beyond Final Scores
  5. 2026From Agent Traces to Trust: A Survey of Evidence Tracing and Execution Provenance in LLM Agents
  6. 2025The AI Committee: A Multi-Agent Framework for Automated Validation and Remediation of Web-Sourced Data
  7. 2026Fidelity Is Not Enough: Dispatch-Level Instrumentation for Agentic Datasheet Extraction
  8. 2026Can LLM Agents Generate Real-World Evidence? Evaluating Observational Studies in Medical Databases