HoloClean: Holistic Data Repairs with Probabilistic Inference
Not on the map. Why?
Abstract (arXiv)
We introduce HoloClean, a framework for holistic data repairing driven by probabilistic inference. HoloClean unifies existing qualitative data repairing approaches, which rely on integrity constraints or external data sources, with quantitative data repairing methods, which leverage statistical properties of the input data. Given an inconsistent dataset as input, HoloClean automatically generates a probabilistic program that performs data repairing. Inspired by recent theoretical advances in probabilistic inference, we introduce a series of optimizations which ensure that inference over HoloClean's probabilistic model scales to instances with millions of tuples. We show that HoloClean scales to instances with millions of tuples and find data repairs with an average precision of ~90% and an average recall of above ~76% across a diverse array of datasets exhibiting different types of errors. This yields an average F1 improvement of more than 2x against state-of-the-art methods.
Key facts. Cited by 79 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Feb 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 11; 2023: 19; 2024: 9; 2025: 16; 2026: 15.
79 papers.
Sort:
By area:
- 2022Can Foundation Models Wrangle Your Data?cited by 173
- 2023Machine Learning for Synthetic Data Generation: A Reviewcited by 118
- 2021Data Collection and Quality Challenges in Deep Learning: A Data-Centric AI Perspectivecited by 116
- 2023Large Language Models as Data Preprocessorscited by 34
- 2021VolcanoML: Speeding up End-to-End AutoML via Scalable Search Space Decompositioncited by 25
- 2024AutoDCWorkflow: LLM-based Data Cleaning Workflow Auto-Generation and Benchmarkcited by 23
- 2021How Much Automation Does a Data Scientist Want?cited by 20
- 2023Jellyfish: A Large Language Model for Data Preprocessingcited by 20
- 2025Exploring LLM Agents for Cleaning Tabular Machine Learning Datasetscited by 20
- 2022Saga: A Platform for Continuous Construction and Serving of Knowledge At Scalecited by 18
- 2022Hyper-Tune: Towards Efficient Hyper-parameter Tuning at Scalecited by 13
- 2023Construction of Knowledge Graphs: State and Challengescited by 12
38 more
- 2023REIN: A Comprehensive Benchmark Framework for Data Cleaning Methods in ML Pipelinescited by 10
- 2023Traffic-Domain Video Question Answering with Automatic Captioningcited by 10
- 2023SEED: Domain-Specific Data Curation With Large Language Modelscited by 10
- 2023Data Cleaning and Machine Learning: A Systematic Literature Reviewcited by 9
- 2021Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Searchcited by 8
- 2021Enabling SQL-based Training Data Debugging for Federated Learningcited by 8
- 2023Lingua Manga: A Generic Large Language Model Centric System for Data Curationcited by 8
- 2024TabularMark: Watermarking Tabular Datasets for Machine Learningcited by 8
- 2024UniDM: A Unified Framework for Data Manipulation with Large Language Modelscited by 7
- 2024Table-LLM-Specialist: Language Model Specialists for Tables using Iterative Generator-Validator Fine-tuningcited by 7
- 2022DiffML: End-to-end Differentiable ML Pipelinescited by 6
- 2023DataVinci: Learning Syntactic and Semantic String Repairscited by 6
- 2025LABELING COPILOT: A Deep Research Agent for Automated Data Curation in Computer Visioncited by 6
- 2022Differentiable and Scalable Generative Adversarial Models for Data Imputationcited by 5
- 2023Desbordante: from benchmarking suite to high-performance science-intensive data profiler (preprint)cited by 5
- 2022Querying Inconsistent Prioritized Data with ORBITS: Algorithms, Implementation, and Experimentscited by 4
- 2022PInKS: Preconditioned Commonsense Inference with Minimal Supervisioncited by 4
- 2022Certifiable Robustness for Nearest Neighbor Classifierscited by 3
- 2022SHiFT: An Efficient, Flexible Search Engine for Transfer Learningcited by 3
- 2024In-Database Data Imputationcited by 3
- 2025LM-mixup: Text Data Augmentation via Language Model based Mixupcited by 3
- 2026PrepBench: How Far Are We from Natural-Language-Driven Data Preparation?cited by 3
- 2021A probabilistic database approach to autoencoder-based data cleaningcited by 2
- 2023KGLiDS: A Platform for Semantic Abstraction, Linking, and Automation of Data Sciencecited by 2
- 2023Naive Bayes Classifiers over Missing Data: Decision and Poisoningcited by 2
- 2023BClean: A Bayesian Data Cleaning Systemcited by 2
- 2025LLM-Aided Customizable Profiling of Code Data Based On Programming Language Conceptscited by 2
- 2021Towards Artificial Intelligence Enabled Financial Crime Detectioncited by 1
- 2022Repairing Systematic Outliers by Learning Clean Subspaces in VAEscited by 1
- 2023DataAssist: A Machine Learning Approach to Data Cleaning and Preparationcited by 1
- 2023Towards Consistent Language Models Using Declarative Constraintscited by 1
- 2024Foundation Model Engineering: Engineering Foundation Models Just as Engineering Softwarecited by 1
- 2025Learning High-dimensional Gaussians from Censored Datacited by 1
- 2025Refining Labeling Functions with Limited Labeled Datacited by 1
- 2025Towards Practical Benchmarking of Data Cleaning Techniques: On Generating Authentic Errors via Large Language Modelscited by 1
- 2025Towards Cross-Modal Error Detection with Tables and Imagescited by 1
- 2025Aixel: A Unified, Adaptive and Extensible System for AI-powered Data Analysiscited by 1
- 2025Lost in the Pipeline: How Well Do Large Language Models Handle Data Preparation?cited by 1
50 most cited of 79 All 79 (JSON)
- 2026TCMaster: Confidence-Aware Querying and Workload-Guided Physical Design for Multi-Source Traditional Chinese Medicine Knowledge Graphs22 Sep 2026
- 2026Data Quality Rule Generation with LLMs5 Sep 2026
- 2026Agentic Data Cleaning Without a Clean Reference: An Experimental Study of Capabilities and Trade-offs14 Aug 2026
- 2026Data Quality Profiling at Scale with Progressive Sampling: A Benchmark for Data-Centric AI Pipelines28 Jul 2026
- 2026Invariant Discovery for Networked Systems24 Jul 2026
- 2026ReliableTableQA:How Much Supervision Does Reliability Annotation Need?10 Jul 2026
- 2026Structural Adversarial Attacks on Relational Deep Learning under Integrity Constraints8 Jul 2026
- 2026BatteryLake: Agentic, Physics-Grounded Curation of Heterogeneous Battery Aging Data and Benchmarking6 Jul 2026
- 2026ArtiFact: A Large-Scale Multi-Modal Cultural Heritage Dataset8 Jun 2026
- 2026When Helping Hurts and How to Fix It: Multi-Agent Debate for Data Cleaning1 Jun 2026
- 2026PrepBench: How Far Are We from Natural-Language-Driven Data Preparation?9 May 2026
- 2026Text Data Integration28 Mar 2026
38 more
- 2026Learning from Anonymized and Incomplete Tabular Data1 Feb 2026
- 2026VISTA: Knowledge-Driven Vessel Trajectory Imputation with Repair Provenance11 Jan 2026
- 2026Computational Compliance for AI Regulation: Blueprint for a New Research Domain8 Jan 2026
- 2025MechDetect: Detecting Data-Dependent Errors3 Dec 2025
- 2025Step-E: A Differentiable Data Cleaning Framework for Robust Learning with Noisy Labels21 Nov 2025
- 2025RAG-Driven Data Quality Governance for Enterprise ERP Systems18 Nov 2025
- 2025Lost in the Pipeline: How Well Do Large Language Models Handle Data Preparation?17 Nov 2025
- 2025LM-mixup: Text Data Augmentation via Language Model based Mixup23 Oct 2025
- 2025Aixel: A Unified, Adaptive and Extensible System for AI-powered Data Analysis14 Oct 2025
- 2025Towards Cross-Modal Error Detection with Tables and Images14 Oct 2025
- 2025LABELING COPILOT: A Deep Research Agent for Automated Data Curation in Computer Vision26 Sep 2025
- 2025Harnessing Temporal Databases for Systematic Evaluation of Factual Time-Sensitive Question-Answering in Large Language Models4 Aug 2025
- 2025Towards Practical Benchmarking of Data Cleaning Techniques: On Generating Authentic Errors via Large Language Models15 Jul 2025
- 2025DIM-SUM: Dynamic IMputation for Smart Utility Management24 Jun 2025
- 2025Refining Labeling Functions with Limited Labeled Data29 May 2025
- 2025CADRE: Customizable Assurance of Data Readiness in Privacy-Preserving Federated Learning28 May 2025
- 2025Learning High-dimensional Gaussians from Censored Data28 Apr 2025
- 2025LLM-Aided Customizable Profiling of Code Data Based On Programming Language Concepts19 Mar 2025
- 2025Exploring LLM Agents for Cleaning Tabular Machine Learning Datasets9 Mar 2025
- 2024AutoDCWorkflow: LLM-based Data Cleaning Workflow Auto-Generation and Benchmark9 Dec 2024
- 2024Data Quality Awareness: A Journey from Traditional Data Management to Data Science Systems5 Nov 2024
- 2024GIG: Graph Data Imputation With Graph Differential Dependencies21 Oct 2024
- 2024Table-LLM-Specialist: Language Model Specialists for Tables using Iterative Generator-Validator Fine-tuning16 Oct 2024
- 2024A Theoretical Framework for AI-driven data quality monitoring in high-volume data environments11 Oct 2024
- 2024Foundation Model Engineering: Engineering Foundation Models Just as Engineering Software11 Jul 2024
- 2024TabularMark: Watermarking Tabular Datasets for Machine Learning21 Jun 2024
- 2024UniDM: A Unified Framework for Data Manipulation with Large Language Models10 May 2024
- 2024In-Database Data Imputation7 Jan 2024
- 2023Towards Consistent Language Models Using Declarative Constraints24 Dec 2023
- 2023Jellyfish: A Large Language Model for Data Preprocessing4 Dec 2023
- 2023Enhancing Sentiment Analysis Results through Outlier Detection Optimization25 Nov 2023
- 2023BClean: A Bayesian Data Cleaning System11 Nov 2023
- 2023Data Cleaning and Machine Learning: A Systematic Literature Review3 Oct 2023
- 2023SEED: Domain-Specific Data Curation With Large Language Models1 Oct 2023
- 2023Large Language Models as Data Preprocessors30 Aug 2023
- 2023DataVinci: Learning Syntactic and Semantic String Repairs21 Aug 2023
- 2023Traffic-Domain Video Question Answering with Automatic Captioning18 Jul 2023
- 2023DataAssist: A Machine Learning Approach to Data Cleaning and Preparation14 Jul 2023
50 newest of 79 All 79 (JSON)
- 2025Exploring LLM Agents for Cleaning Tabular Machine Learning Datasetscited by 20
- 2025LABELING COPILOT: A Deep Research Agent for Automated Data Curation in Computer Visioncited by 6
- 2026When Helping Hurts and How to Fix It: Multi-Agent Debate for Data Cleaningcited by 0
- 2026BatteryLake: Agentic, Physics-Grounded Curation of Heterogeneous Battery Aging Data and Benchmarkingcited by 0
- 2026Agentic Data Cleaning Without a Clean Reference: An Experimental Study of Capabilities and Trade-offscited by 0
- 2026Agentic Data Cleaning Without a Clean Reference: An Experimental Study of Capabilities and Trade-offs14 Aug 2026
- 2026BatteryLake: Agentic, Physics-Grounded Curation of Heterogeneous Battery Aging Data and Benchmarking6 Jul 2026
- 2026When Helping Hurts and How to Fix It: Multi-Agent Debate for Data Cleaning1 Jun 2026
- 2025LABELING COPILOT: A Deep Research Agent for Automated Data Curation in Computer Vision26 Sep 2025
- 2025Exploring LLM Agents for Cleaning Tabular Machine Learning Datasets9 Mar 2025
- 2022Can Foundation Models Wrangle Your Data?cited by 173
- 2023Machine Learning for Synthetic Data Generation: A Reviewcited by 118
- 2021Data Collection and Quality Challenges in Deep Learning: A Data-Centric AI Perspectivecited by 116
- 2023Large Language Models as Data Preprocessorscited by 34
- 2021VolcanoML: Speeding up End-to-End AutoML via Scalable Search Space Decompositioncited by 25
- 2024AutoDCWorkflow: LLM-based Data Cleaning Workflow Auto-Generation and Benchmarkcited by 23
- 2021How Much Automation Does a Data Scientist Want?cited by 20
- 2023Jellyfish: A Large Language Model for Data Preprocessingcited by 20
- 2022Saga: A Platform for Continuous Construction and Serving of Knowledge At Scalecited by 18
- 2022Hyper-Tune: Towards Efficient Hyper-parameter Tuning at Scalecited by 13
- 2023Construction of Knowledge Graphs: State and Challengescited by 12
- 2023REIN: A Comprehensive Benchmark Framework for Data Cleaning Methods in ML Pipelinescited by 10
12 most cited of 72 All 72 (JSON)
- 2026TCMaster: Confidence-Aware Querying and Workload-Guided Physical Design for Multi-Source Traditional Chinese Medicine Knowledge Graphs22 Sep 2026
- 2026Data Quality Rule Generation with LLMs5 Sep 2026
- 2026Data Quality Profiling at Scale with Progressive Sampling: A Benchmark for Data-Centric AI Pipelines28 Jul 2026
- 2026Invariant Discovery for Networked Systems24 Jul 2026
- 2026ReliableTableQA:How Much Supervision Does Reliability Annotation Need?10 Jul 2026
- 2026Structural Adversarial Attacks on Relational Deep Learning under Integrity Constraints8 Jul 2026
- 2026ArtiFact: A Large-Scale Multi-Modal Cultural Heritage Dataset8 Jun 2026
- 2026PrepBench: How Far Are We from Natural-Language-Driven Data Preparation?9 May 2026
- 2026Text Data Integration28 Mar 2026
- 2026Learning from Anonymized and Incomplete Tabular Data1 Feb 2026
- 2026VISTA: Knowledge-Driven Vessel Trajectory Imputation with Repair Provenance11 Jan 2026
- 2026Computational Compliance for AI Regulation: Blueprint for a New Research Domain8 Jan 2026
12 newest of 72 All 72 (JSON)