HySPA: Hybrid Span Generation for Scalable Text-to-Graph Extraction
Not on the map. Why?
Abstract (arXiv)
Text-to-Graph extraction aims to automatically extract information graphs consisting of mentions and types from natural language texts. Existing approaches, such as table filling and pairwise scoring, have shown impressive performance on various information extraction tasks, but they are difficult to scale to datasets with longer input texts because of their second-order space/time complexities with respect to the input length. In this work, we propose a Hybrid Span Generator (HySPA) that invertibly maps the information graph to an alternating sequence of nodes and edge types, and directly generates such sequences via a hybrid span decoder which can decode both the spans and the types recurrently in linear time and space complexities. Extensive experiments on the ACE05 dataset show that our approach also significantly outperforms state-of-the-art on the joint entity and relation extraction task.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 21 of its 44 references that are in the map. First posted on arXiv 30 Jun 2021.
Builds on
21 of 44 references.
References · 21
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016Layer Normalizationcited by 5,579
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
- 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
- 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
- 2016End-to-End Relation Extraction using LSTMs on Sequences and Tree Structurescited by 161
- 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 132
9 more
- 2016Sequence-to-Sequence Learning as Beam-Search Optimizationcited by 126
- 2015A Survey of Heterogeneous Information Network Analysiscited by 109
- 2019A General Framework for Information Extraction using Dynamic Span Graphscited by 93
- 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
- 2019CopyMTL: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learningcited by 47
- 2020IMoJIE: Iterative Memory-Based Joint Open Information Extractioncited by 34
- 2019Broad-Coverage Semantic Parsing as Transductioncited by 32
- 2020Minimize Exposure Bias of Seq2Seq Models in Joint Entity and Relation Extractioncited by 27
- 2018Seq2RDF: An end-to-end application for deriving Triples from Natural Language Textcited by 7
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 0; 2024: 2.
6 papers.
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
- 2022Unified Structure Generation for Universal Information Extractioncited by 220
- 2022Generative Knowledge Graph Construction: A Reviewcited by 49
- 2024An Autoregressive Text-to-Graph Framework for Joint Entity and Relation Extractioncited by 5
- 2022Span-based joint entity and relation extraction augmented with sequence tagging mechanismcited by 2
- 2024PyTorch-IE: Fast and Reproducible Prototyping for Information Extractioncited by 0
- 2024PyTorch-IE: Fast and Reproducible Prototyping for Information Extraction16 May 2024
- 2024An Autoregressive Text-to-Graph Framework for Joint Entity and Relation Extraction2 Jan 2024
- 2022Span-based joint entity and relation extraction augmented with sequence tagging mechanism23 Oct 2022
- 2022Generative Knowledge Graph Construction: A Review23 Oct 2022
- 2022Unified Structure Generation for Universal Information Extraction23 Mar 2022
- 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Survey1 Nov 2021