# Fine-tuning Large Language Models for Entity Matching

arXiv: https://arxiv.org/abs/2409.08185 · HTML: https://mlsanity.com/paper/2409.08185/

## Key facts

- Cited by 16 papers in the map (data through 14 Oct 2026).
- Builds on 19 of its 35 references that are in the map.
- First posted on arXiv 12 Sep 2024.

## Builds on (most cited first, 19 of 19)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [The Llama 3 Herd of Models](https://mlsanity.com/paper/2407.21783/) (2024)
- [A Survey of Large Language Models](https://mlsanity.com/paper/2303.18223/) (2023)
- [Calibrate Before Use: Improving Few-Shot Performance of Language Models](https://mlsanity.com/paper/2102.09690/) (2021)
- [Fantastically Ordered Prompts and Where to Find Them: Overcoming Few-Shot Prompt Order Sensitivity](https://mlsanity.com/paper/2104.08786/) (2021)
- [Can Foundation Models Wrangle Your Data?](https://mlsanity.com/paper/2205.09911/) (2022)
- [Deep Entity Matching with Pre-Trained Language Models](https://mlsanity.com/paper/2004.00584/) (2020)
- [Active Learning Principles for In-Context Learning with Large Language Models](https://mlsanity.com/paper/2305.14264/) (2023)
- [Neural Networks for Entity Matching: A Survey](https://mlsanity.com/paper/2010.11075/) (2020)
- [Entity Matching using Large Language Models](https://mlsanity.com/paper/2310.11244/) (2023)
- [Using ChatGPT for Entity Matching](https://mlsanity.com/paper/2305.03423/) (2023)
- [Jellyfish: A Large Language Model for Data Preprocessing](https://mlsanity.com/paper/2312.01678/) (2023)
- [WDC Products: A Multi-Dimensional Entity Matching Benchmark](https://mlsanity.com/paper/2301.09521/) (2023)
- [Machamp: A Generalized Entity Matching Benchmark](https://mlsanity.com/paper/2106.08455/) (2021)
- [Cost-Effective In-Context Learning for Entity Resolution: A Design Space Exploration](https://mlsanity.com/paper/2312.03987/) (2023)
- [Pre-trained Embeddings for Entity Resolution: An Experimental Analysis [Experiment, Analysis & Benchmark]](https://mlsanity.com/paper/2304.12329/) (2023)
- [Learning from Natural Language Explanations for Generalizable Entity Matching](https://mlsanity.com/paper/2406.09330/) (2024)
- [AnyMatch -- Efficient Zero-Shot Entity Matching with a Small Language Model](https://mlsanity.com/paper/2409.04073/) (2024)
- [Cost-Efficient Prompt Engineering for Unsupervised Entity Resolution](https://mlsanity.com/paper/2310.06174/) (2023)

## Built on by (most cited first, 16 of 16)

- [A Survey of Data Agents: Emerging Paradigm or Overstated Hype?](https://mlsanity.com/paper/2510.23587/) (2025)
- [Knowledge Graph-based Retrieval-Augmented Generation for Schema Matching](https://mlsanity.com/paper/2501.08686/) (2025)
- [Empowering Tabular Data Preparation with Language Models: Why and How?](https://mlsanity.com/paper/2508.01556/) (2025)
- [Cost-Efficient RAG for Entity Matching with LLMs: A Blocking-based Exploration](https://mlsanity.com/paper/2602.05708/) (2026)
- [Understanding Domain-Aware Distribution Alignment in Budgeted Entity Matching](https://mlsanity.com/paper/2606.27342/) (2026)
- [Labeling Training Data for Entity Matching Using Large Language Models](https://mlsanity.com/paper/2606.28823/) (2026)
- [Evaluating Large Language Models in Code Generation: INFINITE Methodology for Defining the Inference Index](https://mlsanity.com/paper/2503.05852/) (2025)
- [Leveraging Language Models for Automated Patient Record Linkage](https://mlsanity.com/paper/2504.15261/) (2025)
- [Beyond Traditional Algorithms: Leveraging LLMs for Accurate Cross-Border Entity Identification](https://mlsanity.com/paper/2507.11086/) (2025)
- [OpenSanctions Pairs: Large-Scale Entity Matching with LLMs](https://mlsanity.com/paper/2603.11051/) (2026)
- [Structure-Guided Entity Resolution: Fine-Tuning LLMs for Robust Name Matching in Complex Linguistic Contexts](https://mlsanity.com/paper/2605.23597/) (2026)
- [Towards Trustworthy and Cost-Efficient Data Integration: From Na"ive RAG to Agentic RAG](https://mlsanity.com/paper/2607.22319/) (2026)
- [Beyond Scale and Generation: Understanding Language Model-based Entity Matching](https://mlsanity.com/paper/2607.24688/) (2026)
- [Entity Resolution in Practice: Lessons from a Self-Serve Pipeline](https://mlsanity.com/paper/2607.26298/) (2026)
- [Curating Merchant-Matching Training Data with Two Confidence-Gated Local LLM Judges](https://mlsanity.com/paper/2609.33878/) (2026)
- [Billiger.de Products: A Bilingual Entity Matching Benchmark](https://mlsanity.com/paper/2609.37713/) (2026)

## Abstract (arXiv)

Generative large language models (LLMs) are a promising alternative to pre-trained language models for entity matching due to their high zero-shot performance and ability to generalize to unseen entities. Existing research on using LLMs for entity matching has focused on prompt engineering and in-context learning. This paper explores the potential of fine-tuning LLMs for entity matching. We analyze fine-tuning along two dimensions: 1) the representation of training examples, where we experiment with adding different types of LLM-generated explanations to the training set, and 2) the selection and generation of training examples using LLMs. In addition to the matching performance on the source dataset, we investigate how fine-tuning affects the models ability to generalize to other in-domain datasets as well as across topical domains. Our experiments show that fine-tuning significantly improves the performance of the smaller models while the results for the larger models are mixed. Fine-tuning also improves the generalization to in-domain datasets while hurting cross-domain transfer. We show that adding structured explanations to the training set has a positive impact on the performance of three out of four LLMs, while the proposed example selection and generation methods, only improve the performance of Llama 3.1 8B while decreasing the performance of GPT-4o-mini.
