Improving Long Tailed Document-Level Relation Extraction via Easy Relation Augmentation and Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Towards real-world information extraction scenario, research of relation extraction is advancing to document-level relation extraction(DocRE). Existing approaches for DocRE aim to extract relation by encoding various information sources in the long context by novel model architectures. However, the inherent long-tailed distribution problem of DocRE is overlooked by prior work. We argue that mitigating the long-tailed distribution problem is crucial for DocRE in the real-world scenario. Motivated by the long-tailed distribution problem, we propose an Easy Relation Augmentation(ERA) method for improving DocRE by enhancing the performance of tailed relations. In addition, we further propose a novel contrastive learning framework based on our ERA, i.e., ERACL, which can further improve the model performance on tailed relations and achieve competitive overall DocRE performance compared to the state-of-arts.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 25 of its 35 references that are in the map. First posted on arXiv 21 May 2022.
Builds on
25 of 35 references.
References · 25
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2019Unsupervised Cross-lingual Representation Learning at Scalecited by 3,935
- 2019EDA: Easy Data Augmentation Techniques for Boosting Performance on Text Classification Taskscited by 807
- 2020Supervised Contrastive Learning for Pre-trained Language Model Fine-tuningcited by 276
- 2019DocRED: A Large-Scale Document-Level Relation Extraction Datasetcited by 239
- 2020CERT: Contrastive Self-supervised Learning for Language Understandingcited by 169
- 2020Document-Level Relation Extraction with Adaptive Thresholding and Localized Context Poolingcited by 115
- 2020Reasoning with Latent Structure Refinement for Document-Level Relation Extractioncited by 97
13 more
- 2020Double Graph Based Reasoning for Document-level Relation Extractioncited by 87
- 2020Coreferential Reasoning Learning for Language Representationcited by 80
- 2021Document-level Relation Extraction as Semantic Segmentationcited by 80
- 2020Learning from Context or Names? An Empirical Study on Neural Relation Extractioncited by 75
- 2020ERICA: Improving Entity and Relation Understanding for Pre-trained Language Models via Contrastive Learningcited by 72
- 2019Connecting the Dots: Document-level Neural Relation Extraction with Edge-oriented Graphscited by 71
- 2021Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extractioncited by 68
- 2019Document-Level N-ary Relation Extraction with Multiscale Representation Learningcited by 52
- 2019Inter-sentence Relation Extraction with Document-level Graph Convolutional Neural Networkcited by 51
- 2020Global-to-Local Neural Networks for Document-Level Relation Extractioncited by 43
- 2019Fine-tune Bert for DocRED with Two-step Processcited by 42
- 2022Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillationcited by 39
- 2021Discriminative Reasoning for Document-level Relation Extractioncited by 25
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 0; 2025: 0; 2026: 1.
3 papers.