mlsanityData to 7 Oct 2026

Unsupervised Matching of Data and Text

arXiv 2112.08776 ↗First posted 16 Dec 2021cs.DB cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Entity resolution is a widely studied problem with several proposals to match records across relations. Matching textual content is a widespread task in many applications, such as question answering and search. While recent methods achieve promising results for these two tasks, there is no clear solution for the more general problem of matching textual content and structured data. We introduce a framework that supports this new task in an unsupervised setting for any pair of corpora, being relational tables or text documents. Our method builds a fine-grained graph over the content of the corpora and derives word embeddings to represent the objects to match in a low dimensional space. The learned representation enables effective and efficient matching at different granularity, from relational tuples to text sentences and paragraphs. Our flexible framework can exploit pre-trained resources, but it does not depends on their existence and achieves better quality performance in matching content when the vocabulary is domain specific. We also introduce optimizations in the graph creation process with an "expand and compress" approach that first identifies new valid relationships across elements, to improve matching, and then prunes nodes and edges, to reduce the graph size. Experiments on real use cases and public datasets show that our framework produces embeddings that outperform word embeddings and fine-tuned language models both in results' quality and in execution times.

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 30 of its 52 references that are in the map. First posted on arXiv 16 Dec 2021.

Builds on

30 of 52 references.

References · 30

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,346
  4. 2016node2vec: Scalable Feature Learning for Networkscited by 1,913
  5. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  6. 2014DeepWalk: Online Learning of Social Representationscited by 1,543
  7. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  8. 2016ConceptNet 5.5: An Open Multilingual Graph of General Knowledgecited by 1,065
  9. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
  10. 2017Representation Learning on Graphs: Methods and Applicationscited by 456
  11. 2020TAPAS: Weakly Supervised Table Parsing via Pre-trainingcited by 432
  12. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
18 more
  1. 2020TaBERT: Pretraining for Joint Understanding of Textual and Tabular Datacited by 395
  2. 2015Skip-Thought Vectorscited by 321
  3. 2017Graph Embedding Techniques, Applications, and Performance: A Surveycited by 188
  4. 2019Text Classification Algorithms: A Surveycited by 163
  5. 2020Deep Entity Matching with Pre-Trained Language Modelscited by 143
  6. 2020That is a Known Lie: Detecting Previously Fact-Checked Claimscited by 82
  7. 2019DocBERT: BERT for Document Classificationcited by 68
  8. 2017DeepER -- Deep Entity Resolutioncited by 54
  9. 2016Joint Learning of the Embedding of Words and Entities for Named Entity Disambiguationcited by 48
  10. 2020Valentine: Evaluating Matching Techniques for Dataset Discoverycited by 34
  11. 2019MatchZoo: A Learning, Practicing, and Developing System for Neural Text Matchingcited by 17
  12. 2020TURL: Table Understanding through Representation Learningcited by 14
  13. 2016Representation learning for very short texts using weighted word embedding aggregationcited by 12
  14. 2020Graph-Embedding Empowered Entity Retrievalcited by 10
  15. 2020SSumM: Sparse Summarization of Massive Graphscited by 9
  16. 2020Scrutinizer: A Mixed-Initiative Approach to Large-Scale, Data-Driven Claim Verificationcited by 6
  17. 2019Termite: A System for Tunneling Through Heterogeneous Datacited by 5
  18. 2019Contextualized End-to-End Neural Entity Linkingcited by 1

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 2; 2024: 3.

7 papers.