Enriching Relation Extraction with OpenIE
Not on the map. Why?
Abstract (arXiv)
Relation extraction (RE) is a sub-discipline of information extraction (IE) which focuses on the prediction of a relational predicate from a natural-language input unit (such as a sentence, a clause, or even a short paragraph consisting of multiple sentences and/or clauses). Together with named-entity recognition (NER) and disambiguation (NED), RE forms the basis for many advanced IE tasks such as knowledge-base (KB) population and verification. In this work, we explore how recent approaches for open information extraction (OpenIE) may help to improve the task of RE by encoding structured information about the sentences' principal units, such as subjects, objects, verbal phrases, and adverbials, into various forms of vectorized (and hence unstructured) representations of the sentences. Our main conjecture is that the decomposition of long and possibly convoluted sentences into multiple smaller clauses via OpenIE even helps to fine-tune context-sensitive language models such as BERT (and its plethora of variants) for RE. Our experiments over two annotated corpora, KnowledgeNet and FewRel, demonstrate the improved accuracy of our enriched models compared to existing RE approaches. Our best results reach 92% and 71% of F1 score for KnowledgeNet and FewRel, respectively, proving the effectiveness of our approach on competitive benchmarks.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 53 references that are in the map. First posted on arXiv 19 Dec 2022.
Builds on
23 of 53 references.
References · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,854
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2013Distributed Representations of Words and Phrases and their Compositionalitycited by 3,462
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2018Deep contextualized word representationscited by 2,285
- 2016Enriching Word Vectors with Subword Informationcited by 1,578
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
- 2019ERNIE: Enhanced Language Representation with Informative Entitiescited by 525
11 more
- 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 271
- 2018FewRel: A Large-Scale Supervised Few-Shot Relation Classification Dataset with State-of-the-Art Evaluationcited by 254
- 2022Efficient Few-Shot Learning Without Promptscited by 135
- 2019FewRel 2.0: Towards More Challenging Few-Shot Relation Classificationcited by 94
- 2021An Improved Baseline for Sentence-level Relation Extractioncited by 80
- 2020Efficient One-Pass End-to-End Entity Linking for Questionscited by 76
- 2020Do Syntax Trees Help Pre-trained Transformers Extract Information?cited by 47
- 2020FLERT: Document-Level Features for Named Entity Recognitioncited by 45
- 2021Zero-Shot Information Extraction as a Unified Text-to-Triple Translationcited by 22
- 2019OpenKI: Integrating Open Information Extraction and Knowledge Bases with Relation Inferencecited by 9
- 2022CompactIE: Compact Facts in Open Information Extractioncited by 5
Built on by
Citing papers per year: 2024: 1.
1 paper.