mlsanityData to 7 Oct 2026

Rethinking Relation Classification with Graph Meaning Representations

arXiv 2310.09772 ↗First posted 15 Oct 2023cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

In the field of natural language understanding, the intersection of neural models and graph meaning representations (GMRs) remains a compelling area of research. Despite the growing interest, a critical gap persists in understanding the exact influence of GMRs, particularly concerning relation extraction tasks. Addressing this, we introduce DAGNN-plus, a simple and parameter-efficient neural architecture designed to decouple contextual representation learning from structural information propagation. Coupled with various sequence encoders and GMRs, this architecture provides a foundation for systematic experimentation on two English and two Chinese datasets. Our empirical analysis utilizes four different graph formalisms and nine parsers. The results yield a nuanced understanding of GMRs, showing improvements in three out of the four datasets, particularly favoring English over Chinese due to highly accurate parsers. Interestingly, GMRs appear less effective in literary-domain datasets compared to general-domain datasets. These findings lay the groundwork for better-informed design of GMRs and parsers to improve relation classification, which is expected to tangibly impact the future trajectory of natural language understanding research.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 43 of its 96 references that are in the map. First posted on arXiv 15 Oct 2023.

Builds on

43 of 96 references.

References · 43

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  5. 2017Graph Attention Networkscited by 8,854
  6. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
  7. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  8. 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
  9. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  10. 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
  11. 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
  12. 2020A Generalization of Transformer Networks to Graphscited by 653
31 more
  1. 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 544
  2. 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
  3. 2020Universal Dependencies v2: An Evergrowing Multilingual Treebank Collectioncited by 269
  4. 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 262
  5. 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
  6. 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 132
  7. 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
  8. 2020Automated Concatenation of Embeddings for Structured Predictioncited by 86
  9. 2021Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoningcited by 85
  10. 2021An Improved Baseline for Sentence-level Relation Extractioncited by 80
  11. 2021Re-TACRED: Addressing Shortcomings of the TACRED Datasetcited by 73
  12. 2018Linguistically-Informed Self-Attention for Semantic Role Labelingcited by 71
  13. 2022Graph Pre-training for AMR Parsing and Generationcited by 55
  14. 2019SG-Net: Syntax-Guided Machine Reading Comprehensioncited by 52
  15. 2020Do Syntax Trees Help Pre-trained Transformers Extract Information?cited by 47
  16. 2021The Stem Cell Hypothesis: Dilemma behind Multi-Task Learning with Transformer Encoderscited by 31
  17. 2020Do Neural Language Models Show Preferences for Syntactic Formalisms?cited by 30
  18. 2020N-LTP: An Open-source Neural Language Technology Platform for Chinesecited by 29
  19. 2020Syntax-Enhanced Pre-trained Modelcited by 29
  20. 2020Improving BERT with Syntax-aware Local Attentioncited by 26
  21. 2019Enhancing Machine Translation with Dependency-Aware Self-Attentioncited by 24
  22. 2020Infusing Finetuning with Semantic Dependenciescited by 18
  23. 2019Compositional Semantic Parsing Across Graphbankscited by 15
  24. 2017A Transition-Based Directed Acyclic Graph Parser for UCCAcited by 13
  25. 2017A Discourse-Level Named Entity Recognition and Relation Extraction Dataset for Chinese Literature Textcited by 13
  26. 2021On the Interaction of Belief Bias and Explanationscited by 13
  27. 2021Does injecting linguistic structure into language models lead to better alignment with brain recordings?cited by 11
  28. 2020A Practical Chinese Dependency Parser Based on A Large-scale Datasetcited by 6
  29. 2019Content Differences in Syntactic and Semantic Representationscited by 4
  30. 2021Slot Filling for Biomedical Information Extractioncited by 3
  31. 2023Silver Syntax Pre-training for Cross-Domain Relation Extractioncited by 2

Built on by

Not cited yet.