An Autoregressive Text-to-Graph Framework for Joint Entity and Relation Extraction
Not on the map. Why?
Abstract (arXiv)
In this paper, we propose a novel method for joint entity and relation extraction from unstructured text by framing it as a conditional sequence generation problem. In contrast to conventional generative information extraction models that are left-to-right token-level generators, our approach is textitspan-based. It generates a linearized graph where nodes represent text spans and edges represent relation triplets. Our method employs a transformer encoder-decoder architecture with pointing mechanism on a dynamic vocabulary of spans and relation types. Our model can capture the structural characteristics and boundaries of entities and relations through span representations while simultaneously grounding the generated output in the original text thanks to the pointing mechanism. Evaluation on benchmark datasets validates the effectiveness of our approach, demonstrating competitive results. Code is available at https://github.com/urchade/ATG.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 34 of its 54 references that are in the map. First posted on arXiv 2 Jan 2024.
Builds on
34 of 54 references.
References · 34
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019The Curious Case of Neural Text Degenerationcited by 2,916
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
- 2015Pointer Networkscited by 895
- 2017Reading Wikipedia to Answer Open-Domain Questionscited by 777
- 2016Neural Architectures for Named Entity Recognitioncited by 550
- 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 349
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 322
22 more
- 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 262
- 2022Unified Structure Generation for Universal Information Extractioncited by 221
- 2015Named Entity Recognition with Bidirectional LSTM-CNNscited by 201
- 2023Grammar-Constrained Decoding for Structured NLP Tasks without Finetuningcited by 197
- 2023Large Language Models for Generative Information Extraction: A Surveycited by 185
- 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
- 2021Document-Level Event Argument Extraction by Conditional Generationcited by 155
- 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 133
- 2018Correcting Length Bias in Neural Machine Translationcited by 120
- 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
- 2019Effective Modeling of Encoder-Decoder Architecture for Joint Entity and Relation Extractioncited by 73
- 2022Gradient-Based Constrained Sampling from Language Modelscited by 64
- 2020Joint Entity and Relation Extraction with Set Prediction Networkscited by 54
- 2022Generative Knowledge Graph Construction: A Reviewcited by 49
- 2022Autoregressive Structured Prediction with Language Modelscited by 43
- 2023LasUIE: Unifying Information Extraction with Latent Adaptive Structure-aware Generative Language Modelcited by 43
- 2021A Partition Filter Network for Joint Entity and Relation Extractioncited by 42
- 2021UniRE: A Unified Label Space for Entity Relation Extractioncited by 38
- 2022OneRel:Joint Entity and Relation Extraction with One Module in One Stepcited by 27
- 2022A sequence-to-sequence approach for document-level relation extractioncited by 25
- 2021Characterizing and addressing the issue of oversmoothing in neural autoregressive sequence modelingcited by 10
- 2021HySPA: Hybrid Span Generation for Scalable Text-to-Graph Extractioncited by 6
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 2.
5 papers.
- 2026GLiNER-Relex: A Unified Framework for Joint Named Entity Recognition and Relation Extractioncited by 1
- 2024Exploration of Marker-Based Approaches in Argument Mining through Augmented Natural Languagecited by 0
- 2025Dependency Parsing is More Parameter-Efficient with Normalizationcited by 0
- 2025EMERGE: A Benchmark for Updating Knowledge Graphs with Emerging Textual Knowledgecited by 0
- 2026LLMs Underperform Graph-Based Parsers on Supervised Relation Extraction for Complex Graphscited by 0
- 2026GLiNER-Relex: A Unified Framework for Joint Named Entity Recognition and Relation Extraction11 May 2026
- 2026LLMs Underperform Graph-Based Parsers on Supervised Relation Extraction for Complex Graphs9 Apr 2026
- 2025EMERGE: A Benchmark for Updating Knowledge Graphs with Emerging Textual Knowledge4 Jul 2025
- 2025Dependency Parsing is More Parameter-Efficient with Normalization26 May 2025
- 2024Exploration of Marker-Based Approaches in Argument Mining through Augmented Natural Language12 Jun 2024