Boosting Span-based Joint Entity and Relation Extraction via Squence Tagging Mechanism
Not on the map. Why?
Abstract (arXiv)
Span-based joint extraction simultaneously conducts named entity recognition (NER) and relation extraction (RE) in text span form. Recent studies have shown that token labels can convey crucial task-specific information and enrich token semantics. However, as far as we know, due to completely abstain from sequence tagging mechanism, all prior span-based work fails to use token label in-formation. To solve this problem, we pro-pose Sequence Tagging enhanced Span-based Network (STSN), a span-based joint extrac-tion network that is enhanced by token BIO label information derived from sequence tag-ging based NER. By stacking multiple atten-tion layers in depth, we design a deep neu-ral architecture to build STSN, and each atten-tion layer consists of three basic attention units. The deep neural architecture first learns seman-tic representations for token labels and span-based joint extraction, and then constructs in-formation interactions between them, which also realizes bidirectional information interac-tions between span-based NER and RE. Fur-thermore, we extend the BIO tagging scheme to make STSN can extract overlapping en-tity. Experiments on three benchmark datasets show that our model consistently outperforms previous optimal models by a large margin, creating new state-of-the-art results.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 34 references that are in the map. First posted on arXiv 21 May 2021.
Builds on
19 of 34 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2018Deep contextualized word representationscited by 2,285
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
- 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
- 2017End-to-end Neural Coreference Resolutioncited by 240
- 2016End-to-End Relation Extraction using LSTMs on Sequences and Tree Structurescited by 161
- 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 132
- 2019Entity-Relation Extraction as Multi-Turn Question Answeringcited by 96
- 2019A General Framework for Information Extraction using Dynamic Span Graphscited by 93
7 more
- 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
- 2018Joint Embedding of Words and Labels for Text Classificationcited by 69
- 2018Joint entity recognition and relation extraction as a multi-head selection problemcited by 59
- 2020TransOMCS: From Linguistic Graphs to Commonsense Knowledgecited by 52
- 2019Hierarchically-Refined Label Attention Network for Sequence Labelingcited by 25
- 2018End-to-end neural relation extraction using deep biaffine attentioncited by 19
- 2019Exploiting Entity BIO Tag Embeddings and Multi-task Learning for Relation Extraction with Imbalanced Datacited by 11
Built on by
Citing papers per year: 2022: 1.
1 paper.