Can LLMs Clean Up Your Mess? A Survey of Application-Ready Data Preparation with LLMs
Not on the map. Why?
Abstract (arXiv)
Data preparation aims to denoise raw datasets, uncover cross-dataset relationships, and extract valuable insights from them, which is essential for a wide range of data-centric applications. Driven by (i) rising demands for application-ready data (e.g., for analytics, visualization, decision-making), (ii) increasingly powerful LLM techniques, and (iii) the emergence of infrastructures that facilitate flexible agent construction (e.g., using Databricks Unity Catalog), LLM-enhanced methods are rapidly becoming a transformative and potentially dominant paradigm for data preparation. By investigating hundreds of recent literature works, this paper presents a systematic review of this evolving landscape, focusing on the use of LLM techniques to prepare data for diverse downstream tasks. First, we characterize the fundamental paradigm shift, from rule-based, model-specific pipelines to prompt-driven, context-aware, and agentic preparation workflows. Next, we introduce a task-centric taxonomy that organizes the field into three major tasks: data cleaning (e.g., standardization, error processing, imputation), data integration (e.g., entity matching, schema matching), and data enrichment (e.g., data annotation, profiling). For each task, we survey representative techniques, and highlight their respective strengths (e.g., improved generalization, semantic understanding) and limitations (e.g., the prohibitive cost of scaling LLMs, persistent hallucinations even in advanced agents, the mismatch between advanced methods and weak evaluation). Moreover, we analyze commonly used datasets and evaluation metrics (the empirical part). Finally, we discuss open research challenges and outline a forward-looking roadmap that emphasizes scalable LLM-data systems, principled designs for reliable agentic workflows, and robust evaluation protocols.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 84 of its 162 references that are in the map. First posted on arXiv 22 Jan 2026.
Builds on
84 of 162 references.
References · 84
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2015Character-level Convolutional Networks for Text Classificationcited by 2,330
- 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
- 2024A Survey on Large Language Models for Code Generationcited by 658
- 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 434
- 2024On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A Surveycited by 244
- 2024Large Language Models for Data Annotation and Synthesis: A Surveycited by 205
- 2021FeTaQA: Free-form Table Question Answeringcited by 175
- 2023FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learningcited by 149
- 2020Deep Entity Matching with Pre-Trained Language Modelscited by 144
- 2023TableLlama: Towards Open Large Generalist Models for Tablescited by 137
38 more
- 2023Language Models Enable Simple Systems for Generating Structured Views of Heterogeneous Data Lakescited by 111
- 2019Sherlock: A Deep Learning Approach to Semantic Data Type Detectioncited by 74
- 2024TableGPT2: A Large Multimodal Model with Tabular Data Integrationcited by 72
- 2025Synthetic Data Generation Using Large Language Models: Advances in Text and Codecited by 61
- 2017DeepER -- Deep Entity Resolutioncited by 54
- 2023Open-WikiTable: Dataset for Open Domain Question Answering with Complex Reasoning over Tablecited by 40
- 2023Large Language Models as Data Preprocessorscited by 34
- 2023Large Language Models as Annotators: Enhancing Generalization of NLP Models at Minimal Costcited by 33
- 2023Open-Source LLMs for Text Annotation: A Practical Guide for Model Setting and Fine-Tuningcited by 32
- 2024Match, Compare, or Select? An Investigation of Large Language Models for Entity Matchingcited by 32
- 2023Entity Matching using Large Language Modelscited by 31
- 2025A Survey of Data Agents: Emerging Paradigm or Overstated Hype?cited by 30
- 2025A Comprehensive Survey of Synthetic Tabular Data Generationcited by 28
- 2023Agent-OM: Leveraging LLM Agents for Ontology Matchingcited by 27
- 2024LLM-Forest: Ensemble Learning of LLMs with Graph-Augmented Prompts for Data Imputationcited by 25
- 2023CHORUS: Foundation Models for Unified Data Discovery and Explorationcited by 24
- 2024AutoDCWorkflow: LLM-based Data Cleaning Workflow Auto-Generation and Benchmarkcited by 24
- 2025Pneuma: Leveraging LLMs for Tabular Data Representation and Retrieval in an End-to-End Systemcited by 23
- 2024CleanAgent: Automating Data Standardization with LLM-based Agentscited by 22
- 2025PALADIN: Self-Correcting Language Model Agents to Cure Tool-Failure Casescited by 22
- 2024Decoding Time Series with LLMs: A Multi-Agent Framework for Cross-Domain Annotationcited by 21
- 2023Jellyfish: A Large Language Model for Data Preprocessingcited by 20
- 2024Schema Matching with Large Language Models: an Experimental Studycited by 20
- 2025Exploring LLM Agents for Cleaning Tabular Machine Learning Datasetscited by 20
- 2024LLMClean: Context-Aware Tabular Data Cleaning via LLM-Generated OFDscited by 19
- 2024LLMAEL: Large Language Models are Good Context Augmenters for Entity Linkingcited by 19
- 2023WDC Products: A Multi-Dimensional Entity Matching Benchmarkcited by 17
- 2024Magneto: Combining Small and Large Language Models for Schema Matchingcited by 17
- 2024Multi-News+: Cost-efficient Dataset Cleansing via LLM-based Data Annotationcited by 16
- 2023ArcheType: A Novel Framework for Open-Source Column Type Annotation using Large Language Modelscited by 15
- 2023Cost-Effective In-Context Learning for Entity Resolution: A Design Space Explorationcited by 15
- 2024The Synergy between Data and Multi-Modal Large Language Models: A Survey from Co-Development Perspectivecited by 15
- 2024Data Imputation using Large Language Model to Accelerate Recommendation Systemcited by 15
- 2024The Promises and Pitfalls of LLM Annotations in Dataset Labeling: a Case Study on Media Bias Detectioncited by 15
- 2025Knowledge Graph-based Retrieval-Augmented Generation for Schema Matchingcited by 13
- 2024Anomaly Detection of Tabular Data Using LLMscited by 12
- 2025On LLM-Enhanced Mixed-Type Data Imputation with High-Order Message Passingcited by 11
- 2015Truth Finding on the Deep Web: Is the Problem Solved?cited by 10
50 most cited of 84 All 84 (JSON)
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026AgenticDataBench: A Comprehensive Benchmark for Data Agentscited by 7
- 2026Self-Improvement of Large Language Models: A Technical Overview and Future Outlookcited by 5
- 2026LongDS-Bench: On the Failure of Long-Horizon Agentic Data Analysiscited by 4
- 2026PrepBench: How Far Are We from Natural-Language-Driven Data Preparation?cited by 3
- 2026Automating Database-Native Function Code Synthesis with LLMscited by 2
- 2026Dial: A Knowledge-Grounded Dialect-Specific NL2SQL Systemcited by 0
- 2026SemJoin: Semantic Join Optimizationcited by 0
- 2026Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Modelscited by 0
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnessescited by 0
- 2026Towards Reliable AI Data Scientists: Data Agents with Workflow Harnesses28 Sep 2026
- 2026Auto-Fill: Learning to Predict Missing Values Accurately with Specialist Language Models22 Jul 2026
- 2026AgenticDataBench: A Comprehensive Benchmark for Data Agents2 Jul 2026
- 2026SemJoin: Semantic Join Optimization28 Jun 2026
- 2026LongDS-Bench: On the Failure of Long-Horizon Agentic Data Analysis28 May 2026
- 2026PrepBench: How Far Are We from Natural-Language-Driven Data Preparation?9 May 2026
- 2026Automating Database-Native Function Code Synthesis with LLMs2 Apr 2026
- 2026Self-Improvement of Large Language Models: A Technical Overview and Future Outlook26 Mar 2026
- 2026Dial: A Knowledge-Grounded Dialect-Specific NL2SQL System8 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Walk Before You Run: The Importance of Data Exploration for Data Analysis Agents
- 2025A Survey of LLM × DATA
- 2025Why Do Open-Source LLMs Struggle with Data Analysis? A Systematic Empirical Study
- 2026Do LLM-Generated Skills Make Better AI Data Scientists? A Component Ablation Across Data-Science Workflows
- 2025LLM-Based Data Science Agents: A Survey of Capabilities, Challenges, and Future Directions
- 2026LongDA: Benchmarking LLM Agents for Long-Document Data Analysis
- 2025Skywork-SWE: Unveiling Data Scaling Laws for Software Engineering in LLMs
- 2025LLM/Agent-as-Data-Analyst: A Survey