mlsanityData to 14 Oct 2026

Can LLMs Clean Up Your Mess? A Survey of Application-Ready Data Preparation with LLMs

arXiv 2601.17058 ↗First posted 22 Jan 2026cs.DB cs.AI cs.CLcited by 9

Not on the map. Why?

Abstract (arXiv)

Data preparation aims to denoise raw datasets, uncover cross-dataset relationships, and extract valuable insights from them, which is essential for a wide range of data-centric applications. Driven by (i) rising demands for application-ready data (e.g., for analytics, visualization, decision-making), (ii) increasingly powerful LLM techniques, and (iii) the emergence of infrastructures that facilitate flexible agent construction (e.g., using Databricks Unity Catalog), LLM-enhanced methods are rapidly becoming a transformative and potentially dominant paradigm for data preparation. By investigating hundreds of recent literature works, this paper presents a systematic review of this evolving landscape, focusing on the use of LLM techniques to prepare data for diverse downstream tasks. First, we characterize the fundamental paradigm shift, from rule-based, model-specific pipelines to prompt-driven, context-aware, and agentic preparation workflows. Next, we introduce a task-centric taxonomy that organizes the field into three major tasks: data cleaning (e.g., standardization, error processing, imputation), data integration (e.g., entity matching, schema matching), and data enrichment (e.g., data annotation, profiling). For each task, we survey representative techniques, and highlight their respective strengths (e.g., improved generalization, semantic understanding) and limitations (e.g., the prohibitive cost of scaling LLMs, persistent hallucinations even in advanced agents, the mismatch between advanced methods and weak evaluation). Moreover, we analyze commonly used datasets and evaluation metrics (the empirical part). Finally, we discuss open research challenges and outline a forward-looking roadmap that emphasizes scalable LLM-data systems, principled designs for reliable agentic workflows, and robust evaluation protocols.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 84 of its 162 references that are in the map. First posted on arXiv 22 Jan 2026.

Builds on

84 of 162 references.

References · 84

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
  4. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  5. 2024A Survey on Large Language Models for Code Generationcited by 658
  6. 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 434
  7. 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 244
  8. 2024Large Language Models for Data Annotation and Synthesis: A Surveycited by 205
  9. 2021FeTaQA: Free-form Table Question Answeringcited by 175
  10. 2023FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learningcited by 149
  11. 2020Deep Entity Matching with Pre-Trained Language Modelscited by 144
  12. 2023TableLlama: Towards Open Large Generalist Models for Tablescited by 137
38 more
  1. 2023Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakescited by 111
  2. 2019Sherlock: A Deep Learning Approach to Semantic Data Type Detectioncited by 74
  3. 2024TableGPT2: A Large Multimodal Model with Tabular Data Integrationcited by 72
  4. 2025Synthetic Data Generation Using Large Language Models: Advances in Text and Codecited by 61
  5. 2017DeepER -- Deep Entity Resolutioncited by 54
  6. 2023Open-WikiTable: Dataset for Open Domain Question Answering with Complex Reasoning over Tablecited by 40
  7. 2023Large Language Models as Data Preprocessorscited by 34
  8. 2023Large Language Models as Annotators: Enhancing Generalization of NLP Models at Minimal Costcited by 33
  9. 2023Open-Source LLMs for Text Annotation: A Practical Guide for Model Setting and Fine-Tuningcited by 32
  10. 2024Match, Compare, or Select? An Investigation of Large Language Models for Entity Matchingcited by 32
  11. 2023Entity Matching using Large Language Modelscited by 31
  12. 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?cited by 30
  13. 2025A Comprehensive Survey of Synthetic Tabular Data Generationcited by 28
  14. 2023Agent-OM: Leveraging LLM Agents for Ontology Matchingcited by 27
  15. 2024LLM-Forest: Ensemble Learning of LLMs with Graph-Augmented Prompts for Data Imputationcited by 25
  16. 2023CHORUS: Foundation Models for Unified Data Discovery and Explorationcited by 24
  17. 2024AutoDCWorkflow: LLM-based Data Cleaning Workflow Auto-Generation and Benchmarkcited by 24
  18. 2025Pneuma: Leveraging LLMs for Tabular Data Representation and Retrieval in an End-to-End Systemcited by 23
  19. 2024CleanAgent: Automating Data Standardization with LLM-based Agentscited by 22
  20. 2025PALADIN: Self-Correcting Language Model Agents to Cure Tool-Failure Casescited by 22
  21. 2024Decoding Time Series with LLMs: A Multi-Agent Framework for Cross-Domain Annotationcited by 21
  22. 2023Jellyfish: A Large Language Model for Data Preprocessingcited by 20
  23. 2024Schema Matching with Large Language Models: an Experimental Studycited by 20
  24. 2025Exploring LLM Agents for Cleaning Tabular Machine Learning Datasetscited by 20
  25. 2024LLMClean: Context-Aware Tabular Data Cleaning via LLM-Generated OFDscited by 19
  26. 2024LLMAEL: Large Language Models are Good Context Augmenters for Entity Linkingcited by 19
  27. 2023WDC Products: A Multi-Dimensional Entity Matching Benchmarkcited by 17
  28. 2024Magneto: Combining Small and Large Language Models for Schema Matchingcited by 17
  29. 2024Multi-News+: Cost-efficient Dataset Cleansing via LLM-based Data Annotationcited by 16
  30. 2023ArcheType: A Novel Framework for Open-Source Column Type Annotation using Large Language Modelscited by 15
  31. 2023Cost-Effective In-Context Learning for Entity Resolution: A Design Space Explorationcited by 15
  32. 2024The Synergy between Data and Multi-Modal Large Language Models: A Survey from Co-Development Perspectivecited by 15
  33. 2024Data Imputation using Large Language Model to Accelerate Recommendation Systemcited by 15
  34. 2024The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias Detectioncited by 15
  35. 2025Knowledge Graph-based Retrieval-Augmented Generation for Schema Matchingcited by 13
  36. 2024Anomaly Detection of Tabular Data Using LLMscited by 12
  37. 2025On LLM-Enhanced Mixed-Type Data Imputation with High-Order Message Passingcited by 11
  38. 2015Truth Finding on the Deep Web: Is the Problem Solved?cited by 10

50 most cited of 84 All 84 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Walk Before You Run: The Importance of Data Exploration for Data Analysis Agents
  2. 2025A Survey of LLM × DATA
  3. 2025Why Do Open-Source LLMs Struggle with Data Analysis? A Systematic Empirical Study
  4. 2026Do LLM-Generated Skills Make Better AI Data Scientists? A Component Ablation Across Data-Science Workflows
  5. 2025LLM-Based Data Science Agents: A Survey of Capabilities, Challenges, and Future Directions
  6. 2026LongDA: Benchmarking LLM Agents for Long-Document Data Analysis
  7. 2025Skywork-SWE: Unveiling Data Scaling Laws for Software Engineering in LLMs
  8. 2025LLM/Agent-as-Data-Analyst: A Survey