mlsanityData to 7 Oct 2026

APrompt4EM: Augmented Prompt Tuning for Generalized Entity Matching

arXiv 2405.04820 ↗First posted 8 May 2024cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Generalized Entity Matching (GEM), which aims at judging whether two records represented in different formats refer to the same real-world entity, is an essential task in data management. The prompt tuning paradigm for pre-trained language models (PLMs), including the recent PromptEM model, effectively addresses the challenges of low-resource GEM in practical applications, offering a robust solution when labeled data is scarce. However, existing prompt tuning models for GEM face the challenges of prompt design and information gap. This paper introduces an augmented prompt tuning framework for the challenges, which consists of two main improvements. The first is an augmented contextualized soft token-based prompt tuning method that extracts a guiding soft token benefit for the PLMs' prompt tuning, and the second is a cost-effective information augmentation strategy leveraging large language models (LLMs). Our approach performs well on the low-resource GEM challenges. Extensive experiments show promising advancements of our basic model without information augmentation over existing methods based on moderate-size PLMs (average 5.24%+), and our model with information augmentation achieves comparable performance compared with fine-tuned LLMs, using less than 14% of the API fee.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 68 references that are in the map. First posted on arXiv 8 May 2024.

Builds on

30 of 68 references.

References · 30

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  6. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  8. 2019Language Models as Knowledge Bases?cited by 1,922
  9. 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
  10. 2019How Can We Know What Language Models Know?cited by 953
  11. 2023REPLUG: Retrieval-Augmented Black-Box Language Modelscited by 786
  12. 2021A Survey of Data Augmentation Approaches for NLPcited by 408
18 more
  1. 2021Factual Probing Is [MASK]: Learning vs. Learning to Recallcited by 291
  2. 2022Can Foundation Models Wrangle Your Data?cited by 173
  3. 2022A Review on Language Models as Knowledge Basescited by 156
  4. 2021OpenPrompt: An Open-source Framework for Prompt-learningcited by 148
  5. 2020Deep Entity Matching with Pre-Trained Language Modelscited by 143
  6. 2017DeepER -- Deep Entity Resolutioncited by 54
  7. 2021Efficient (Soft) Q-Learning for Text Generation with Limited Good Datacited by 35
  8. 2020Neural Networks for Entity Matching: A Surveycited by 33
  9. 2019ZeroER: Entity Resolution using Zero Labeled Examplescited by 28
  10. 2022Supervised Contrastive Learning for Product Matchingcited by 24
  11. 2023Using ChatGPT for Entity Matchingcited by 22
  12. 2022Sudowoodo: Contrastive Self-supervised Learning for Multi-purpose Data Integration and Preparationcited by 19
  13. 2023WDC Products: A Multi-Dimensional Entity Matching Benchmarkcited by 17
  14. 2021Machamp: A Generalized Entity Matching Benchmarkcited by 16
  15. 2021Unsupervised Matching of Data and Textcited by 7
  16. 2022Machop: an End-to-End Generalized Entity Matching Frameworkcited by 6
  17. 2022FlexER: Flexible Entity Resolution for Multiple Intentscited by 6
  18. 2023KAER: A Knowledge Augmented Pre-Trained Language Model for Entity Resolutioncited by 5

Built on by

Not cited yet.