mlsanityData to 14 Oct 2026

Joint Entity and Relation Extraction with Span Pruning and Hypergraph Neural Networks

arXiv 2310.17238 ↗First posted 26 Oct 2023cs.CL cs.AI cs.LGcited by 11

Not on the map. Why?

Abstract (arXiv)

Entity and Relation Extraction (ERE) is an important task in information extraction. Recent marker-based pipeline models achieve state-of-the-art performance, but still suffer from the error propagation issue. Also, most of current ERE models do not take into account higher-order interactions between multiple entities and relations, while higher-order modeling could be beneficial.In this work, we propose HyperGraph neural network for ERE (hgnn), which is built upon the PL-marker (a state-of-the-art marker-based pipleline model). To alleviate error propagation,we use a high-recall pruner mechanism to transfer the burden of entity identification and labeling from the NER module to the joint module of our model. For higher-order modeling, we build a hypergraph, where nodes are entities (provided by the span pruner) and relations thereof, and hyperedges encode interactions between two different relations or between a relation and its associated subject and object entities. We then run a hypergraph neural network for higher-order inference by applying message passing over the built hypergraph. Experiments on three widely used benchmarks (acef, ace and scierc) for ERE task show significant improvements over the previous state-of-the-art PL-marker.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 34 of its 54 references that are in the map. First posted on arXiv 26 Oct 2023.

Builds on

34 of 54 references.

References · 34

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,790
  3. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  4. 2018Hypergraph Neural Networkscited by 488
  5. 2016Deep Biaffine Attention for Neural Dependency Parsingcited by 334
  6. 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 322
  7. 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 272
  8. 2019Entity, Relation, and Event Extraction with Contextualized Span Representationscited by 262
  9. 2020A Note on Over-Smoothing for Graph Neural Networkscited by 249
  10. 2019Hypergraph Convolution and Hypergraph Attentioncited by 228
  11. 2022Unified Structure Generation for Universal Information Extractioncited by 221
  12. 2015Conditional Random Fields as Recurrent Neural Networkscited by 214
22 more
  1. 2021Structured Prediction as Translation between Augmented Natural Languagescited by 183
  2. 2016End-to-End Relation Extraction using LSTMs on Sequences and Tree Structurescited by 161
  3. 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 133
  4. 2021UniGNN: a Unified Framework for Graph and Hypergraph Neural Networkscited by 130
  5. 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
  6. 2020Neural Enhanced Belief Propagation on Factor Graphscited by 57
  7. 2020HyperSAGE: Generalizing Inductive Representation Learning on Hypergraphscited by 54
  8. 2020Efficient Second-Order TreeCRF for Neural Dependency Parsingcited by 48
  9. 2021A Partition Filter Network for Joint Entity and Relation Extractioncited by 42
  10. 2018Inference in Probabilistic Graphical Models by Graph Neural Networkscited by 38
  11. 2021UniRE: A Unified Label Space for Entity Relation Extractioncited by 38
  12. 2020Belief Propagation Neural Networkscited by 33
  13. 2021A Trigger-Sense Memory Flow Framework for Joint Entity and Relation Extractioncited by 26
  14. 2021Cross-Task Instance Representation Interactions and Label Dependencies for Joint Information Extraction with Graph Convolutional Networkscited by 22
  15. 2019Second-Order Semantic Dependency Parsing with End-to-End Neural Networkscited by 21
  16. 2020Denoising Relation Extraction from Document-level Distant Supervisioncited by 19
  17. 2020Second-Order Neural Dependency Parsing with Message Passing and End-to-End Trainingcited by 17
  18. 2023Factor Graph Neural Networkscited by 15
  19. 2022Neural Structured Prediction for Inductive Node Classificationcited by 13
  20. 2020High-order Semantic Role Labelingcited by 11
  21. 2022Graph Neural Networks Intersect Probabilistic Graphical Models: A Surveycited by 6
  22. 2021Combining (second-order) graph-based and headed-span-based projective dependency parsingcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 3; 2026: 6.

11 papers.