mlsanityData to 7 Oct 2026

A Two-Phase Paradigm for Joint Entity-Relation Extraction

arXiv 2208.08659 ↗First posted 18 Aug 2022cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

An exhaustive study has been conducted to investigate span-based models for the joint entity and relation extraction task. However, these models sample a large number of negative entities and negative relations during the model training, which are essential but result in grossly imbalanced data distributions and in turn cause suboptimal model performance. In order to address the above issues, we propose a two-phase paradigm for the span-based joint entity and relation extraction, which involves classifying the entities and relations in the first phase, and predicting the types of these entities and relations in the second phase. The two-phase paradigm enables our model to significantly reduce the data distribution gap, including the gap between negative entities and other entities, as well as the gap between negative relations and other relations. In addition, we make the first attempt at combining entity type and entity distance as global features, which has proven effective, especially for the relation extraction. Experimental results on several datasets demonstrate that the spanbased joint extraction model augmented with the two-phase paradigm and the global features consistently outperforms previous state-of-the-art span-based models for the joint extraction task, establishing a new standard benchmark. Qualitative and quantitative analyses further validate the effectiveness the proposed paradigm and the global features.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 38 references that are in the map. First posted on arXiv 18 Aug 2022.

Builds on

17 of 38 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  4. 2018Deep contextualized word representationscited by 2,285
  5. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
  6. 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
  7. 2017End-to-end Neural Coreference Resolutioncited by 240
  8. 2016End-to-End Relation Extraction using LSTMs on Sequences and Tree Structurescited by 161
  9. 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 132
  10. 2019Entity-Relation Extraction as Multi-Turn Question Answeringcited by 96
  11. 2019A General Framework for Information Extraction using Dynamic Span Graphscited by 93
  12. 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
5 more
  1. 2018Joint entity recognition and relation extraction as a multi-head selection problemcited by 59
  2. 2020TransOMCS: From Linguistic Graphs to Commonsense Knowledgecited by 52
  3. 2021UniRE: A Unified Label Space for Entity Relation Extractioncited by 38
  4. 2018Jointly Predicting Predicates and Arguments in Neural Semantic Role Labelingcited by 34
  5. 2019Exploiting Entity BIO Tag Embeddings and Multi-task Learning for Relation Extraction with Imbalanced Datacited by 11

Built on by

Not cited yet.