Unsupervised Matching of Data and Text
Not on the map. Why?
Abstract (arXiv)
Entity resolution is a widely studied problem with several proposals to match records across relations. Matching textual content is a widespread task in many applications, such as question answering and search. While recent methods achieve promising results for these two tasks, there is no clear solution for the more general problem of matching textual content and structured data. We introduce a framework that supports this new task in an unsupervised setting for any pair of corpora, being relational tables or text documents. Our method builds a fine-grained graph over the content of the corpora and derives word embeddings to represent the objects to match in a low dimensional space. The learned representation enables effective and efficient matching at different granularity, from relational tuples to text sentences and paragraphs. Our flexible framework can exploit pre-trained resources, but it does not depends on their existence and achieves better quality performance in matching content when the vocabulary is domain specific. We also introduce optimizations in the graph creation process with an "expand and compress" approach that first identifies new valid relationships across elements, to improve matching, and then prunes nodes and edges, to reduce the graph size. Experiments on real use cases and public datasets show that our framework produces embeddings that outperform word embeddings and fine-tuned language models both in results' quality and in execution times.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 30 of its 52 references that are in the map. First posted on arXiv 16 Dec 2021.
Builds on
30 of 52 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
- 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2014DeepWalk: Online Learning of Social Representationscited by 1,543
- 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
- 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
- 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
- 2017Representation Learning on Graphs: Methods and Applicationscited by 456
- 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
- 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
18 more
- 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 395
- 2015Skip-Thought Vectorscited by 321
- 2017Graph Embedding Techniques, Applications, and Performance: A Surveycited by 188
- 2019Text Classification Algorithms: A Surveycited by 163
- 2020Deep Entity Matching with Pre-Trained Language Modelscited by 143
- 2020That is a Known Lie: Detecting Previously Fact-Checked Claimscited by 82
- 2019DocBERT: BERT for Document Classificationcited by 68
- 2017DeepER -- Deep Entity Resolutioncited by 54
- 2016Joint Learning of the Embedding of Words and Entities for Named Entity Disambiguationcited by 48
- 2020Valentine: Evaluating Matching Techniques for Dataset Discoverycited by 34
- 2019MatchZoo: A Learning, Practicing, and Developing System for Neural Text Matchingcited by 17
- 2020TURL: Table Understanding through Representation Learningcited by 14
- 2016Representation learning for very short texts using weighted word embedding aggregationcited by 12
- 2020Graph-Embedding Empowered Entity Retrievalcited by 10
- 2020SSumM: Sparse Summarization of Massive Graphscited by 9
- 2020Scrutinizer: A Mixed-Initiative Approach to Large-Scale, Data-Driven Claim Verificationcited by 6
- 2019Termite: A System for Tunneling Through Heterogeneous Datacited by 5
- 2019Contextualized End-to-End Neural Entity Linkingcited by 1
Built on by
Citing papers per year: 2022: 2; 2023: 2; 2024: 3.
7 papers.
- 2022Crowdsourced Fact-Checking at Twitter: How Does the Crowd Compare With Experts?cited by 16
- 2024GTC: GNN-Transformer Co-contrastive Learning for Self-supervised Heterogeneous Graph Representationcited by 9
- 2023Cross Modal Data Discovery over Structured and Unstructured Data Lakescited by 5
- 2022Neural Data-to-Text Generation Based on Small Datasets: Comparing the Added Value of Two Semi-Supervised Learning Approaches on Top of a Large Language Modelcited by 1
- 2023AdapterEM: Pre-trained Language Model Adaptation for Generalized Entity Matching using Adapter-tuningcited by 0
- 2024APrompt4EM: Augmented Prompt Tuning for Generalized Entity Matchingcited by 0
- 2024Tailed Low-Rank Matrix Factorization for Similarity Matrix Completioncited by 0
- 2024Tailed Low-Rank Matrix Factorization for Similarity Matrix Completion29 Sep 2024
- 2024APrompt4EM: Augmented Prompt Tuning for Generalized Entity Matching8 May 2024
- 2024GTC: GNN-Transformer Co-contrastive Learning for Self-supervised Heterogeneous Graph Representation22 Mar 2024
- 2023Cross Modal Data Discovery over Structured and Unstructured Data Lakes1 Jun 2023
- 2023AdapterEM: Pre-trained Language Model Adaptation for Generalized Entity Matching using Adapter-tuning30 May 2023
- 2022Crowdsourced Fact-Checking at Twitter: How Does the Crowd Compare With Experts?19 Aug 2022
- 2022Neural Data-to-Text Generation Based on Small Datasets: Comparing the Added Value of Two Semi-Supervised Learning Approaches on Top of a Large Language Model14 Jul 2022