Matching the Blanks: Distributional Similarity for Relation Learning
Not on the map. Why?
Abstract (arXiv)
General purpose relation extractors, which can model arbitrary relations, are a core aspiration in information extraction. Efforts have been made to build general purpose extractors that represent relations with their surface forms, or which jointly embed surface forms with relations from an existing knowledge graph. However, both of these approaches are limited in their ability to generalize. In this paper, we build on extensions of Harris' distributional hypothesis to relations, as well as recent advances in learning text representations (specifically, BERT), to build task agnostic relation representations solely from entity-linked text. We show that these representations significantly outperform previous work on exemplar based relation extraction (FewRel) even without using any of that task's training data. We also show that models initialized with our task agnostic representations, and then tuned on supervised relation extraction datasets, significantly outperform the previous methods on SemEval 2010 Task 8, KBP37, and TACRED.
Key facts. Cited by 272 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Jun 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 68; 2022: 90; 2023: 63; 2024: 33; 2025: 12; 2026: 6.
272 papers.
Sort:
By area:
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
- 2021Pre-Trained Models: Past, Present and Futurecited by 319
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2021Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learnerscited by 115
- 2021KLUE: Korean Language Understanding Evaluationcited by 114
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 83
- 2021An Improved Baseline for Sentence-level Relation Extractioncited by 81
- 2023LLMaAA: Making Large Language Models as Active Annotatorscited by 79
38 more
- 2021When Can Models Learn From Explanations? A Formal Framework for Understanding the Roles of Explanation Datacited by 75
- 2021Re-TACRED: Addressing Shortcomings of the TACRED Datasetcited by 74
- 2022ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linkingcited by 74
- 2021Prompt-Learning for Fine-Grained Entity Typingcited by 62
- 2023GPT-RE: In-context Learning for Relation Extraction using Large Language Modelscited by 62
- 2023Empirical Study of Zero-Shot NER with ChatGPTcited by 60
- 2021Neural Data Augmentation via Example Extrapolationcited by 54
- 2021Packed Levitated Marker for Entity and Relation Extractioncited by 49
- 2022DeepStruct: Pretraining of Language Models for Structure Predictioncited by 45
- 2022Hybrid Transformer with Multi-level Fusion for Multimodal Knowledge Graph Completioncited by 44
- 2021Mention Memory: incorporating textual knowledge into Transformers through entity mention attentioncited by 43
- 2022Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillationcited by 39
- 2021CLEVE: Contrastive Pre-training for Event Extractioncited by 36
- 2021Learning Rich Representation of Keyphrases from Textcited by 36
- 2021Gradient Imitation Reinforcement Learning for Low Resource Relation Extractioncited by 33
- 2022UCTopic: Unsupervised Contrastive Learning for Phrase Representations and Topic Miningcited by 33
- 2022HiURE: Hierarchical Exemplar Contrastive Learning for Unsupervised Relation Extractioncited by 32
- 2021Relational World Knowledge Representation in Contextual Language Models: A Reviewcited by 31
- 2021Relation Classification with Entity Type Restrictioncited by 31
- 2022Knowledge Base Question Answering by Case-based Reasoning over Subgraphscited by 31
- 2022Inducing Positive Perspectives with Text Reframingcited by 31
- 2022Summarization as Indirect Supervision for Relation Extractioncited by 31
- 2023How to Unleash the Power of Large Language Models for Few-shot Relation Extraction?cited by 30
- 2022Consistent Representation Learning for Continual Relation Extractioncited by 28
- 2021Revisiting Few-shot Relation Classification: Evaluation Data and Classification Schemescited by 27
- 2021Discriminative Reasoning for Document-level Relation Extractioncited by 25
- 2022Textual Entailment for Event Argument Extraction: Zero- and Few-Shot with Multi-Source Learningcited by 25
- 2021Exploring Task Difficulty for Few-Shot Relation Extractioncited by 24
- 2021NSP-BERT: A Prompt-based Few-Shot Learner Through an Original Pre-training Task--Next Sentence Predictioncited by 23
- 2023The Life Cycle of Knowledge in Big Language Models: A Surveycited by 23
- 2021Zero-Shot Information Extraction as a Unified Text-to-Triple Translationcited by 22
- 2023A Comprehensive Survey on Relation Extraction: Recent Advances and New Frontierscited by 22
- 2022CrossRE: A Cross-Domain Dataset for Relation Extractioncited by 21
- 2023Unified Low-Resource Sequence Labeling by Sample-Aware Dynamic Sparse Finetuningcited by 21
- 2022ERGO: Event Relational Graph Transformer for Document-level Event Causality Identificationcited by 19
- 2021Reasoning Over Virtual Knowledge Bases With Open Predicate Relationscited by 18
- 2022Unified Semantic Typing with Meaningful Label Inferencecited by 18
- 2023Improved Logical Reasoning of Language Models via Differentiable Symbolic Programmingcited by 18
50 most cited of 272 All 272 (JSON)
- 2026U4RASD at KnowledgeGraphEval-2026: Ontology-Constrained Encoder and LLM Systems for Arabic Relation Extraction8 Oct 2026
- 2026DistilledGemma: Balanced Efficiency-Accuracy for Person-Place Relation Extraction from Multilingual Historical Articles28 Jun 2026
- 2026SCOPE and SCION: A Benchmark and an Auditable Reference Pipeline for Schema Induction and Fusion from Text20 May 2026
- 2026Text Data Integration28 Mar 2026
- 2026A Study on Building Efficient Zero-Shot Relation Extraction Models1 Mar 2026
- 2026Multilingual Extraction and Recognition of Implicit Discourse Relations in Speech and Text4 Feb 2026
- 2025Hybrid-Code v2: Zero-Hallucination Clinical ICD-10 Coding via Neuro-Symbolic Verification and Automated Knowledge Base Expansion26 Dec 2025
- 2025The Answer Lies Within: Self-Derived Rewards Enable Explainable Relation Extraction7 Oct 2025
- 2025Retrieval over Classification: Integrating Relation Semantics for Multimodal Relation Extraction25 Sep 2025
- 2025Financial Risk Relation Identification through Dual-view Adaptation23 Sep 2025
- 2025Transformer Enhanced Relation Classification: A Comparative Analysis of Contextuality, Data Efficiency and Sequence Complexity14 Sep 2025
- 2025SCoRE: Streamlined Corpus-based Relation Extraction using Multi-Label Contrastive Learning and Bayesian kNN9 Jul 2025
38 more
- 2025DISCIE -- Discriminative Closed Information Extraction19 Jun 2025
- 2025A Pluggable Multi-Task Learning Framework for Sentiment-Aware Financial Relation Extraction14 Jun 2025
- 2025Towards a More Generalized Approach in Open Relation Extraction28 May 2025
- 2025Relation Extraction or Pattern Matching? Unravelling the Generalisation Limits of Language Models for Biographical RE18 May 2025
- 2025Bridging Generative and Discriminative Learning: Few-Shot Relation Extraction via Two-Stage Knowledge-Guided Pre-training18 May 2025
- 2025CPTuning: Contrastive Prompt Tuning for Generative Relation Extraction4 Jan 2025
- 2024Diversity Over Quantity: A Lesson From Few Shot Relation Classification6 Dec 2024
- 2024Few-shot Open Relation Extraction with Gaussian Prototype and Adaptive Margin27 Oct 2024
- 2024Preserving Generalization of Language models in Few-shot Continual Relation Extraction1 Oct 2024
- 2024DiMB-RE: Mining the Scientific Literature for Diet-Microbiome Associations29 Sep 2024
- 2024Shapley Value-based Contrastive Alignment for Multimodal Information Extraction25 Jul 2024
- 2024Enhancing Biomedical Knowledge Discovery for Diseases: An Open-Source Framework Applied on Rett Syndrome and Alzheimer's Disease18 Jul 2024
- 2024Large Language Model Enhanced Knowledge Representation Learning: A Survey1 Jul 2024
- 2024Entangled Relations: Leveraging NLI and Meta-analysis to Enhance Biomedical Relation Extraction31 May 2024
- 2024PyTorch-IE: Fast and Reproducible Prototyping for Information Extraction16 May 2024
- 2024Recall, Retrieve and Reason: Towards Better In-Context Relation Extraction27 Apr 2024
- 2024How to Encode Domain Information in Relation Classification21 Apr 2024
- 2024Variational Multi-Modal Hypergraph Attention Network for Multi-Modal Relation Extraction18 Apr 2024
- 2024A LayoutLMv3-Based Model for Enhanced Relation Extraction in Visually-Rich Documents16 Apr 2024
- 2024Towards Realistic Few-Shot Relation Extraction: A New Meta Dataset and Evaluation5 Apr 2024
- 2024READ: Improving Relation Extraction from an ADversarial Perspective2 Apr 2024
- 2024A Dataset for Pharmacovigilance in German, French, and Japanese: Annotating Adverse Drug Reactions across Languages27 Mar 2024
- 2024Guided Distant Supervision for Multilingual Relation Extraction Data: Adapting to a New Language25 Mar 2024
- 2024Efficient Information Extraction in Few-Shot Relation Classification through Contrastive Representation Learning25 Mar 2024
- 2024Towards Human-Like Machine Comprehension: Few-Shot Relational Learning in Visually-Rich Documents23 Mar 2024
- 2024Distilling Named Entity Recognition Models for Endangered Species from Large Language Models13 Mar 2024
- 2024Extracting Protein-Protein Interactions (PPIs) from Biomedical Literature using Attention-based Relational Context Information8 Mar 2024
- 2024X-Shot: A Unified System to Handle Frequent, Few-shot and Zero-shot Learning Simultaneously in Classification6 Mar 2024
- 2024Formulation Comparison for Timeline Construction using LLMs1 Mar 2024
- 2024Few-Shot Relation Extraction with Hybrid Visual Evidence1 Mar 2024
- 2024Survey in Characterizing Semantic Change29 Feb 2024
- 2024Pointing out the Shortcomings of Relation Extraction Models with Semantically Motivated Adversarials29 Feb 2024
- 2024A Simple but Effective Approach to Improve Structured Language Model Output for Information Extraction20 Feb 2024
- 2024Transfer Learning for the Prediction of Entity Modifiers in Clinical Text: Application to Opioid Use Disorder Case Detection26 Jan 2024
- 2024BayesPrompt: Prompting Large-Scale Pre-Trained Language Models on Few-shot Inference via Debiased Domain Abstraction25 Jan 2024
- 2024Learning from Semi-Factuals: A Debiased and Semantic-Aware Framework for Generalized Relation Discovery12 Jan 2024
- 2024ConcEPT: Concept-Enhanced Pre-Training for Language Models11 Jan 2024
- 2024IDoFew: Intermediate Training Using Dual-Clustering in Language Models for Few Labels Text Classification8 Jan 2024
50 newest of 272 All 272 (JSON)
- 2023Improved Logical Reasoning of Language Models via Differentiable Symbolic Programmingcited by 18
- 2022Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledgecited by 14
- 2024Recall, Retrieve and Reason: Towards Better In-Context Relation Extractioncited by 6
- 2025The Answer Lies Within: Self-Derived Rewards Enable Explainable Relation Extractioncited by 0
- 2025The Answer Lies Within: Self-Derived Rewards Enable Explainable Relation Extraction7 Oct 2025
- 2024Recall, Retrieve and Reason: Towards Better In-Context Relation Extraction27 Apr 2024
- 2023Improved Logical Reasoning of Language Models via Differentiable Symbolic Programming5 May 2023
- 2022Open-domain Question Answering via Chain of Reasoning over Heterogeneous Knowledge22 Oct 2022
- 2022Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillationcited by 39
- 2022Consistent Representation Learning for Continual Relation Extractioncited by 28
- 2026DistilledGemma: Balanced Efficiency-Accuracy for Person-Place Relation Extraction from Multilingual Historical Articlescited by 0
- 2026DistilledGemma: Balanced Efficiency-Accuracy for Person-Place Relation Extraction from Multilingual Historical Articles28 Jun 2026
- 2022Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillation21 Mar 2022
- 2022Consistent Representation Learning for Continual Relation Extraction5 Mar 2022
- 2023Unifying Large Language Models and Knowledge Graphs: A Roadmapcited by 668
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 463
- 2021Pre-Trained Models: Past, Present and Futurecited by 319
- 2021PTR: Prompt Tuning with Rules for Text Classificationcited by 238
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2021KnowPrompt: Knowledge-aware Prompt-tuning with Synergistic Optimization for Relation Extractioncited by 180
- 2021Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learnerscited by 115
- 2021KLUE: Korean Language Understanding Evaluationcited by 114
- 2021Case-based Reasoning for Natural Language Queries over Knowledge Basescited by 107
- 2021MatSciBERT: A Materials Domain Language Model for Text Mining and Information Extractioncited by 83
- 2021An Improved Baseline for Sentence-level Relation Extractioncited by 81
- 2023LLMaAA: Making Large Language Models as Active Annotatorscited by 79
12 most cited of 262 All 262 (JSON)
- 2026U4RASD at KnowledgeGraphEval-2026: Ontology-Constrained Encoder and LLM Systems for Arabic Relation Extraction8 Oct 2026
- 2026SCOPE and SCION: A Benchmark and an Auditable Reference Pipeline for Schema Induction and Fusion from Text20 May 2026
- 2026Text Data Integration28 Mar 2026
- 2026A Study on Building Efficient Zero-Shot Relation Extraction Models1 Mar 2026
- 2026Multilingual Extraction and Recognition of Implicit Discourse Relations in Speech and Text4 Feb 2026
- 2025Hybrid-Code v2: Zero-Hallucination Clinical ICD-10 Coding via Neuro-Symbolic Verification and Automated Knowledge Base Expansion26 Dec 2025
- 2025Retrieval over Classification: Integrating Relation Semantics for Multimodal Relation Extraction25 Sep 2025
- 2025Financial Risk Relation Identification through Dual-view Adaptation23 Sep 2025
- 2025Transformer Enhanced Relation Classification: A Comparative Analysis of Contextuality, Data Efficiency and Sequence Complexity14 Sep 2025
- 2025SCoRE: Streamlined Corpus-based Relation Extraction using Multi-Label Contrastive Learning and Bayesian kNN9 Jul 2025
- 2025DISCIE -- Discriminative Closed Information Extraction19 Jun 2025
- 2025A Pluggable Multi-Task Learning Framework for Sentiment-Aware Financial Relation Extraction14 Jun 2025
12 newest of 262 All 262 (JSON)