Rethinking Relation Classification with Graph Meaning Representations
Not on the map. Why?
Abstract (arXiv)
In the field of natural language understanding, the intersection of neural models and graph meaning representations (GMRs) remains a compelling area of research. Despite the growing interest, a critical gap persists in understanding the exact influence of GMRs, particularly concerning relation extraction tasks. Addressing this, we introduce DAGNN-plus, a simple and parameter-efficient neural architecture designed to decouple contextual representation learning from structural information propagation. Coupled with various sequence encoders and GMRs, this architecture provides a foundation for systematic experimentation on two English and two Chinese datasets. Our empirical analysis utilizes four different graph formalisms and nine parsers. The results yield a nuanced understanding of GMRs, showing improvements in three out of the four datasets, particularly favoring English over Chinese due to highly accurate parsers. Interestingly, GMRs appear less effective in literary-domain datasets compared to general-domain datasets. These findings lay the groundwork for better-informed design of GMRs and parsers to improve relation classification, which is expected to tangibly impact the future trajectory of natural language understanding research.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 43 of its 96 references that are in the map. First posted on arXiv 15 Oct 2023.
Builds on
43 of 96 references.
References · 43
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,898
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2017Modeling Relational Data with Graph Convolutional Networkscited by 1,684
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
- 2019SpanBERT: Improving Pre-training by Representing and Predicting Spanscited by 832
- 2020Stanza: A Python Natural Language Processing Toolkit for Many Human Languagescited by 719
- 2020A Generalization of Transformer Networks to Graphscited by 653
31 more
- 2019Measuring and Relieving the Over-smoothing Problem for Graph Neural Networks from the Topological Viewcited by 544
- 2020LUKE: Deep Contextualized Entity Representations with Entity-aware Self-attentioncited by 326
- 2020Universal Dependencies v2: An Evergrowing Multilingual Treebank Collectioncited by 269
- 2020Revisiting Pre-Trained Models for Chinese Natural Language Processingcited by 262
- 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
- 2019Span-based Joint Entity and Relation Extraction with Transformer Pre-trainingcited by 132
- 2020Two are Better than One: Joint Entity and Relation Extraction with Table-Sequence Encoderscited by 87
- 2020Automated Concatenation of Embeddings for Structured Predictioncited by 86
- 2021Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoningcited by 85
- 2021An Improved Baseline for Sentence-level Relation Extractioncited by 80
- 2021Re-TACRED: Addressing Shortcomings of the TACRED Datasetcited by 73
- 2018Linguistically-Informed Self-Attention for Semantic Role Labelingcited by 71
- 2022Graph Pre-training for AMR Parsing and Generationcited by 55
- 2019SG-Net: Syntax-Guided Machine Reading Comprehensioncited by 52
- 2020Do Syntax Trees Help Pre-trained Transformers Extract Information?cited by 47
- 2021The Stem Cell Hypothesis: Dilemma behind Multi-Task Learning with Transformer Encoderscited by 31
- 2020Do Neural Language Models Show Preferences for Syntactic Formalisms?cited by 30
- 2020N-LTP: An Open-source Neural Language Technology Platform for Chinesecited by 29
- 2020Syntax-Enhanced Pre-trained Modelcited by 29
- 2020Improving BERT with Syntax-aware Local Attentioncited by 26
- 2019Enhancing Machine Translation with Dependency-Aware Self-Attentioncited by 24
- 2020Infusing Finetuning with Semantic Dependenciescited by 18
- 2019Compositional Semantic Parsing Across Graphbankscited by 15
- 2017A Transition-Based Directed Acyclic Graph Parser for UCCAcited by 13
- 2017A Discourse-Level Named Entity Recognition and Relation Extraction Dataset for Chinese Literature Textcited by 13
- 2021On the Interaction of Belief Bias and Explanationscited by 13
- 2021Does injecting linguistic structure into language models lead to better alignment with brain recordings?cited by 11
- 2020A Practical Chinese Dependency Parser Based on A Large-scale Datasetcited by 6
- 2019Content Differences in Syntactic and Semantic Representationscited by 4
- 2021Slot Filling for Biomedical Information Extractioncited by 3
- 2023Silver Syntax Pre-training for Cross-Domain Relation Extractioncited by 2
Built on by
Not cited yet.