APrompt4EM: Augmented Prompt Tuning for Generalized Entity Matching
Not on the map. Why?
Abstract (arXiv)
Generalized Entity Matching (GEM), which aims at judging whether two records represented in different formats refer to the same real-world entity, is an essential task in data management. The prompt tuning paradigm for pre-trained language models (PLMs), including the recent PromptEM model, effectively addresses the challenges of low-resource GEM in practical applications, offering a robust solution when labeled data is scarce. However, existing prompt tuning models for GEM face the challenges of prompt design and information gap. This paper introduces an augmented prompt tuning framework for the challenges, which consists of two main improvements. The first is an augmented contextualized soft token-based prompt tuning method that extracts a guiding soft token benefit for the PLMs' prompt tuning, and the second is a cost-effective information augmentation strategy leveraging large language models (LLMs). Our approach performs well on the low-resource GEM challenges. Extensive experiments show promising advancements of our basic model without information augmentation over existing methods based on moderate-size PLMs (average 5.24%+), and our model with information augmentation achieves comparable performance compared with fine-tuned LLMs, using less than 14% of the API fee.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 68 references that are in the map. First posted on arXiv 8 May 2024.
Builds on
30 of 68 references.
References · 30
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2019Language Models as Knowledge Bases?cited by 1,922
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2019How Can We Know What Language Models Know?cited by 953
- 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
- 2021A Survey of Data Augmentation Approaches for NLPcited by 408
18 more
- 2021Factual Probing Is [MASK]: Learning vs. Learning to Recallcited by 291
- 2022Can Foundation Models Wrangle Your Data?cited by 173
- 2022A Review on Language Models as Knowledge Basescited by 156
- 2021OpenPrompt: An Open-source Framework for Prompt-learningcited by 148
- 2020Deep Entity Matching with Pre-Trained Language Modelscited by 143
- 2017DeepER -- Deep Entity Resolutioncited by 54
- 2021Efficient (Soft) Q-Learning for Text Generation with Limited Good Datacited by 35
- 2020Neural Networks for Entity Matching: A Surveycited by 33
- 2019ZeroER: Entity Resolution using Zero Labeled Examplescited by 28
- 2022Supervised Contrastive Learning for Product Matchingcited by 24
- 2023Using ChatGPT for Entity Matchingcited by 22
- 2022Sudowoodo: Contrastive Self-supervised Learning for Multi-purpose Data Integration and Preparationcited by 19
- 2023WDC Products: A Multi-Dimensional Entity Matching Benchmarkcited by 17
- 2021Machamp: A Generalized Entity Matching Benchmarkcited by 16
- 2021Unsupervised Matching of Data and Textcited by 7
- 2022Machop: an End-to-End Generalized Entity Matching Frameworkcited by 6
- 2022FlexER: Flexible Entity Resolution for Multiple Intentscited by 6
- 2023KAER: A Knowledge Augmented Pre-Trained Language Model for Entity Resolutioncited by 5
Built on by
Not cited yet.