# Using ChatGPT for Entity Matching

arXiv: https://arxiv.org/abs/2305.03423 · HTML: https://mlsanity.com/paper/2305.03423/

## Key facts

- Cited by 22 papers in the map (data through 14 Oct 2026).
- Builds on 15 of its 22 references that are in the map.
- First posted on arXiv 5 May 2023.

## Builds on (most cited first, 15 of 15)

- [Language Models are Few-Shot Learners](https://mlsanity.com/paper/2005.14165/) (2020)
- [Training language models to follow instructions with human feedback](https://mlsanity.com/paper/2203.02155/) (2022)
- [RoBERTa: A Robustly Optimized BERT Pretraining Approach](https://mlsanity.com/paper/1907.11692/) (2019)
- [PaLM: Scaling Language Modeling with Pathways](https://mlsanity.com/paper/2204.02311/) (2022)
- [A Survey of Large Language Models](https://mlsanity.com/paper/2303.18223/) (2023)
- [Emergent Abilities of Large Language Models](https://mlsanity.com/paper/2206.07682/) (2022)
- [Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processing](https://mlsanity.com/paper/2107.13586/) (2021)
- [Calibrate Before Use: Improving Few-Shot Performance of Language Models](https://mlsanity.com/paper/2102.09690/) (2021)
- [What Makes Good In-Context Examples for GPT-3?](https://mlsanity.com/paper/2101.06804/) (2021)
- [Can Foundation Models Wrangle Your Data?](https://mlsanity.com/paper/2205.09911/) (2022)
- [Deep Entity Matching with Pre-Trained Language Models](https://mlsanity.com/paper/2004.00584/) (2020)
- [BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting](https://mlsanity.com/paper/2212.09535/) (2022)
- [Neural Networks for Entity Matching: A Survey](https://mlsanity.com/paper/2010.11075/) (2020)
- [Supervised Contrastive Learning for Product Matching](https://mlsanity.com/paper/2202.02098/) (2022)
- [WDC Products: A Multi-Dimensional Entity Matching Benchmark](https://mlsanity.com/paper/2301.09521/) (2023)

## Built on by (most cited first, 22 of 22)

- [A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets](https://mlsanity.com/paper/2305.18486/) (2023)
- [Table-GPT: Table-tuned GPT for Diverse Table Tasks](https://mlsanity.com/paper/2310.09263/) (2023)
- [Entity Matching using Large Language Models](https://mlsanity.com/paper/2310.11244/) (2023)
- [Column Type Annotation using ChatGPT](https://mlsanity.com/paper/2306.00745/) (2023)
- [Fine-tuning Large Language Models for Entity Matching](https://mlsanity.com/paper/2409.08185/) (2024)
- [Generalizable and Scalable Multistage Biomedical Concept Normalization Leveraging Large Language Models](https://mlsanity.com/paper/2405.15122/) (2024)
- [Ontology Matching with Large Language Models and Prioritized Depth-First Search](https://mlsanity.com/paper/2501.11441/) (2025)
- [LinkTransformer: A Unified Package for Record Linkage with Transformer Language Models](https://mlsanity.com/paper/2309.00789/) (2023)
- [Evaluating LLMs on Entity Disambiguation in Tables](https://mlsanity.com/paper/2408.06423/) (2024)
- [KROMA: Ontology Matching with Knowledge Retrieval and Large Language Models](https://mlsanity.com/paper/2507.14032/) (2025)
- [Generative Benchmark Creation for Table Union Search](https://mlsanity.com/paper/2308.03883/) (2023)
- [Graph-based Active Learning for Entity Cluster Repair](https://mlsanity.com/paper/2401.14992/) (2024)
- [EnsembleLink: Accurate Record Linkage Without Training Data](https://mlsanity.com/paper/2601.21138/) (2026)
- [Entity Resolution via Batched Oracle Queries](https://mlsanity.com/paper/2606.24407/) (2026)
- [Text-Based Product Matching -- Semi-Supervised Clustering Approach](https://mlsanity.com/paper/2402.10091/) (2024)
- [APrompt4EM: Augmented Prompt Tuning for Generalized Entity Matching](https://mlsanity.com/paper/2405.04820/) (2024)
- [T-KAER: Transparency-enhanced Knowledge-Augmented Entity Resolution Framework](https://mlsanity.com/paper/2410.00218/) (2024)
- [OpenSanctions Pairs: Large-Scale Entity Matching with LLMs](https://mlsanity.com/paper/2603.11051/) (2026)
- [When Helping Hurts and How to Fix It: Multi-Agent Debate for Data Cleaning](https://mlsanity.com/paper/2606.02866/) (2026)
- [Corporate-Family Resolution Is Not a String-Matching Problem: A Public Benchmark Stratified by Name Visibility](https://mlsanity.com/paper/2609.04269/) (2026)
- [Follow the Entities: A Corpus Map for Agentic Search](https://mlsanity.com/paper/2609.37226/) (2026)
- [Billiger.de Products: A Bilingual Entity Matching Benchmark](https://mlsanity.com/paper/2609.37713/) (2026)

## Abstract (arXiv)

Entity Matching is the task of deciding if two entity descriptions refer to the same real-world entity. State-of-the-art entity matching methods often rely on fine-tuning Transformer models such as BERT or RoBERTa. Two major drawbacks of using these models for entity matching are that (i) the models require significant amounts of fine-tuning data for reaching a good performance and (ii) the fine-tuned models are not robust concerning out-of-distribution entities. In this paper, we investigate using ChatGPT for entity matching as a more robust, training data-efficient alternative to traditional Transformer models. We perform experiments along three dimensions: (i) general prompt design, (ii) in-context learning, and (iii) provision of higher-level matching knowledge. We show that ChatGPT is competitive with a fine-tuned RoBERTa model, reaching a zero-shot performance of 82.35% F1 on a challenging matching task on which RoBERTa requires 2000 training examples for reaching a similar performance. Adding in-context demonstrations to the prompts further improves the F1 by up to 7.85% when using similarity-based example selection. Always using the same set of 10 handpicked demonstrations leads to an improvement of 4.92% over the zero-shot performance. Finally, we show that ChatGPT can also be guided by adding higher-level matching knowledge in the form of rules to the prompts. Providing matching rules leads to similar performance gains as providing in-context demonstrations.
