# End-to-End Entity Resolution for Big Data: A Survey

arXiv: https://arxiv.org/abs/1905.06397 · HTML: https://mlsanity.com/paper/1905.06397/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 May 2019.

## Built on by (most cited first, 8 of 8)

- [Auto-Pipeline: Synthesizing Complex Data Pipelines By-Target Using Reinforcement Learning and Search](https://mlsanity.com/paper/2106.13861/) (2021)
- [Position: Foundation Models for Tabular Data within Systemic Contexts Need Grounding](https://mlsanity.com/paper/2505.19825/) (2025)
- [On Leveraging Large Language Models for Enhancing Entity Resolution: A Cost-efficient Approach](https://mlsanity.com/paper/2401.03426/) (2024)
- [A Primer on the Data Cleaning Pipeline](https://mlsanity.com/paper/2307.13219/) (2023)
- [Heterogeneous Entity Matching with Complex Attribute Associations using BERT and Neural Networks](https://mlsanity.com/paper/2309.11046/) (2023)
- [Q4EDA: A Novel Strategy for Textual Information Retrieval Based on User Interactions with Visual Representations of Time Series](https://mlsanity.com/paper/2101.08655/) (2021)
- [Transformer-Gather, Fuzzy-Reconsider: A Scalable Hybrid Framework for Entity Resolution](https://mlsanity.com/paper/2509.17470/) (2025)
- [OpenSanctions Pairs: Large-Scale Entity Matching with LLMs](https://mlsanity.com/paper/2603.11051/) (2026)

## Abstract (arXiv)

One of the most important tasks for improving data quality and the reliability of data analytics results is Entity Resolution (ER). ER aims to identify different descriptions that refer to the same real-world entity, and remains a challenging problem. While previous works have studied specific aspects of ER (and mostly in traditional settings), in this survey, we provide for the first time an end-to-end view of modern ER workflows, and of the novel aspects of entity indexing and matching methods in order to cope with more than one of the Big Data characteristics simultaneously. We present the basic concepts, processing steps and execution strategies that have been proposed by different communities, i.e., database, semantic Web and machine learning, in order to cope with the loose structuredness, extreme diversity, high speed and large scale of entity descriptions used by real-world applications. Finally, we provide a synthetic discussion of the existing approaches, and conclude with a detailed presentation of open research directions.