Multi-Scale Feature and Metric Learning for Relation Extraction
Not on the map. Why?
Abstract (arXiv)
Existing methods in relation extraction have leveraged the lexical features in the word sequence and the syntactic features in the parse tree. Though effective, the lexical features extracted from the successive word sequence may introduce some noise that has little or no meaningful content. Meanwhile, the syntactic features are usually encoded via graph convolutional networks which have restricted receptive field. To address the above limitations, we propose a multi-scale feature and metric learning framework for relation extraction. Specifically, we first develop a multi-scale convolutional neural network to aggregate the non-successive mainstays in the lexical sequence. We also design a multi-scale graph convolutional network which can increase the receptive field towards specific syntactic roles. Moreover, we present a multi-scale metric learning paradigm to exploit both the feature-level relation between lexical and syntactic features and the sample-level relation between instances with the same or different classes. We conduct extensive experiments on three real world datasets for various types of relation extraction tasks. The results demonstrate that our model significantly outperforms the state-of-the-art approaches.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 30 of its 67 references that are in the map. First posted on arXiv 28 Jul 2021.
Builds on
30 of 67 references.
References · 30
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2015Multi-Scale Context Aggregation by Dilated Convolutionscited by 1,128
- 2014Convolutional Neural Networks for Sentence Classificationcited by 1,124
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,099
- 2016Language Modeling with Gated Convolutional Networkscited by 688
- 2019COMET: Commonsense Transformers for Automatic Knowledge Graph Constructioncited by 450
- 2018Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Constructioncited by 321
- 2015Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networkscited by 305
18 more
- 2016Hierarchical Question-Image Co-Attention for Visual Question Answeringcited by 278
- 2019Matching the Blanks: Distributional Similarity for Relation Learningcited by 271
- 2016End-to-End Relation Extraction using LSTMs on Sequences and Tree Structurescited by 161
- 2018Graph Convolution over Pruned Dependency Trees Improves Relation Extractioncited by 146
- 2018Dynamic Fusion with Intra- and Inter- Modality Attention Flow for Visual Question Answeringcited by 113
- 2017Cross-Sentence N-ary Relation Extraction with Graph LSTMscited by 101
- 2019Enriching Pre-trained Language Model with Entity Information for Relation Classificationcited by 82
- 2019Attention Guided Graph Convolutional Networks for Relation Extractioncited by 82
- 2020Learning from Context or Names? An Empirical Study on Neural Relation Extractioncited by 75
- 2016Distant Supervision for Relation Extraction beyond the Sentence Boundarycited by 62
- 2017HARP: Hierarchical Representation Learning for Networkscited by 58
- 2015Relation Classification via Recurrent Neural Networkcited by 46
- 2017Improved Neural Relation Detection for Knowledge Base Question Answeringcited by 44
- 2015Classifying Relations via Long Short Term Memory Networks along Shortest Dependency Pathcited by 35
- 2018N-ary Relation Extraction using Graph State LSTMcited by 26
- 2020Modeling Topical Relevance for Multi-Turn Dialogue Generationcited by 15
- 2015Incremental Knowledge Base Construction Using DeepDivecited by 14
- 2017Auto-Encoding User Ratings via Knowledge Graphs in Recommendation Scenarioscited by 4
Built on by
Not cited yet.