mlsanityData to 7 Oct 2026

HySPA: Hybrid Span Generation for Scalable Text-to-Graph Extraction

arXiv 2106.15838 ↗First posted 30 Jun 2021cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

Text-to-Graph extraction aims to automatically extract information graphs consisting of mentions and types from natural language texts. Existing approaches, such as table filling and pairwise scoring, have shown impressive performance on various information extraction tasks, but they are difficult to scale to datasets with longer input texts because of their second-order space/time complexities with respect to the input length. In this work, we propose a Hybrid Span Generator (HySPA) that invertibly maps the information graph to an alternating sequence of nodes and edge types, and directly generates such sequences via a hybrid span decoder which can decode both the spans and the types recurrently in linear time and space complexities. Extensive experiments on the ACE05 dataset show that our approach also significantly outperforms state-of-the-art on the joint entity and relation extraction task.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 21 of its 44 references that are in the map. First posted on arXiv 30 Jun 2021.

Builds on

21 of 44 references.

References · 21

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2016Layer Normalizationcited by 5,579
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
  6. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
  7. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  8. 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
  9. 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
  10. 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 261
  11. 2016End-to-End Relation Extraction using LSTMs on Sequences and Tree Structurescited by 161
  12. 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 132
9 more
  1. 2016Sequence-to-Sequence Learning as Beam-Search Optimizationcited by 126
  2. 2015A Survey of Heterogeneous Information Network Analysiscited by 109
  3. 2019A General Framework for Information Extraction using Dynamic Span Graphscited by 93
  4. 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
  5. 2019CopyMTL: Copy Mechanism for Joint Extraction of Entities and Relations with Multi-Task Learningcited by 47
  6. 2020IMoJIE: Iterative Memory-Based Joint Open Information Extractioncited by 34
  7. 2019Broad-Coverage Semantic Parsing as Transductioncited by 32
  8. 2020Minimize Exposure Bias of Seq2Seq Models in Joint Entity and Relation Extractioncited by 27
  9. 2018Seq2RDF: An end-to-end application for deriving Triples from Natural Language Textcited by 7

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 3; 2023: 0; 2024: 2.

6 papers.