Coreferential Reasoning Learning for Language Representation
Not on the map. Why?
Abstract (arXiv)
Language representation models such as BERT could effectively capture contextual semantic information from plain text, and have been proved to achieve promising results in lots of downstream NLP tasks with appropriate fine-tuning. However, most existing language representation models cannot explicitly handle coreference, which is essential to the coherent understanding of the whole discourse. To address this issue, we present CorefBERT, a novel language representation model that can capture the coreferential relations in context. The experimental results show that, compared with existing baseline models, CorefBERT can achieve significant improvements consistently on various downstream NLP tasks that require coreferential reasoning, while maintaining comparable performance to previous models on other common NLP tasks. The source code and experiment details of this paper can be obtained from https://github.com/thunlp/CorefBERT.
Key facts. Cited by 80 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 26; 2023: 16; 2024: 12; 2025: 4.
80 papers.
Sort:
By area:
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,185
- 2021Document-level Relation Extraction as Semantic Segmentationcited by 80
- 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
- 2021Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extractioncited by 68
- 2021Few-Shot Question Answering by Pretraining Span Selectioncited by 62
- 2021DialFact: A Benchmark for Fact-Checking in Dialoguecited by 62
- 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 52
- 2024CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Modelscited by 50
- 2021Learning to Retrieve Passages without Supervisioncited by 46
- 2022Synthetic Disinformation Attacks on Automated Fact Verification Systemscited by 44
- 2022Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillationcited by 39
- 2021An End-to-end Model for Entity-level Relation Extraction using Multi-instance Learningcited by 31
38 more
- 2021SIRE: Separate Intra- and Inter-sentential Reasoning for Document-level Relation Extractioncited by 30
- 2021Eider: Empowering Document-level Relation Extraction with Efficient Evidence Extraction and Inference-stage Fusioncited by 28
- 2021Graph Based Network with Contextualized Representations of Turns in Dialoguecited by 26
- 2021SAIS: Supervising and Augmenting Intermediate Steps for Document-Level Relation Extractioncited by 23
- 2023LIQUID: A Framework for List Question Answering Dataset Generationcited by 19
- 2022DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Populationcited by 17
- 2022Prompt Tuning for Discriminative Pre-trained Language Modelscited by 17
- 2021QA-Align: Representing Cross-Text Content Overlap by Aligning Question-Answer Propositionscited by 16
- 2022Document-Level Relation Extraction with Sentences Importance Estimation and Focusingcited by 16
- 2021Learning Logic Rules for Document-level Relation Extractioncited by 15
- 2021A Multi-Level Attention Model for Evidence-Based Fact Checkingcited by 13
- 2022Can Pre-trained Language Models Interpret Similes as Smart as Human?cited by 13
- 2022Fact-Saboteurs: A Taxonomy of Evidence Manipulation Attacks against Fact-Verification Systemscited by 11
- 2023BEVERS: A General, Simple, and Performant Framework for Automatic Fact Verificationcited by 11
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extractioncited by 11
- 2023Document-level Relation Extraction with Cross-sentence Reasoning Graphcited by 9
- 2022Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarkscited by 8
- 2022None Class Ranking Loss for Document-Level Relation Extractioncited by 8
- 2022Commonsense and Named Entity Aware Knowledge Grounded Dialogue Generationcited by 8
- 2024[Lions: 1] and [Tigers: 2] and [Bears: 3], Oh My! Literary Coreference Annotation with LLMscited by 8
- 2024LLM with Relation Classifier for Document-Level Relation Extractioncited by 8
- 2022Towards Better Document-level Relation Extraction via Iterative Inferencecited by 7
- 2021REPT: Bridging Language Models and Machine Reading Comprehension via Retrieval-Based Pre-trainingcited by 6
- 2022Relation-Specific Attentions over Entity Mentions for Enhanced Document-Level Relation Extractioncited by 6
- 2021CSS-LM: A Contrastive Framework for Semi-supervised Fine-tuning of Pre-trained Language Modelscited by 5
- 2021Coreference Resolution for the Biomedical Domain: A Surveycited by 5
- 2022CorefDRE: Document-level Relation Extraction with coreference resolutioncited by 5
- 2023Unsupervised Pretraining for Fact Verification by Language Model Distillationcited by 5
- 2024FCDS: Fusing Constituency and Dependency Syntax into Document-Level Relation Extractioncited by 5
- 2024Building A Coding Assistant via the Retrieval-Augmented Language Modelcited by 5
- 2025Adversarial Attacks Against Automated Fact-Checking: A Surveycited by 5
- 2021Modular Self-Supervision for Document-Level Relation Extractioncited by 4
- 2022Document-level Relation Extraction with Context Guided Mention Integration and Inter-pair Reasoningcited by 4
- 2022CorefDiffs: Co-referential and Differential Knowledge Flow in Document Grounded Conversationscited by 4
- 2022Not Just Plain Text! Fuel Document-Level Relation Extraction with Explicit Syntax Refinement and Subsentence Modelingcited by 4
- 2023Towards Integration of Discriminability and Robustness for Document-Level Relation Extractioncited by 4
- 2023A Comprehensive Survey of Document-level Relation Extraction (2016-2023)cited by 4
- 2023PromptRE: Weakly-Supervised Document-Level Relation Extraction via Prompting-Based Data Programmingcited by 4
50 most cited of 80 All 80 (JSON)
- 2025A systematic review of relation extraction task since the emergence of Transformers5 Nov 2025
- 2025Adversarial Attacks Against Automated Fact-Checking: A Survey10 Sep 2025
- 2025COMM:Concentrated Margin Maximization for Robust Document-Level Relation Extraction18 Mar 2025
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extraction6 Jan 2025
- 2024KnowRA: Knowledge Retrieval Augmented Method for Document-level Relation Extraction with Comprehensive Reasoning Abilities31 Dec 2024
- 2024Building A Coding Assistant via the Retrieval-Augmented Language Model21 Oct 2024
- 2024LLM with Relation Classifier for Document-Level Relation Extraction25 Aug 2024
- 2024GEGA: Graph Convolutional Networks and Evidence Retrieval Guided Attention for Enhanced Document-level Relation Extraction31 Jul 2024
- 2024Augmenting Document-level Relation Extraction with Efficient Multi-Supervision1 Jul 2024
- 2024TTM-RE: Memory-Augmented Document-Level Relation Extraction9 Jun 2024
- 2024Multi-Evidence based Fact Verification via A Confidential Graph Neural Network17 May 2024
- 2024Enhancing Pre-Trained Generative Language Models with Question Attended Span Extraction on Machine Reading Comprehension27 Apr 2024
38 more
- 2024FCDS: Fusing Constituency and Dependency Syntax into Document-Level Relation Extraction4 Mar 2024
- 2024QASE Enhanced PLMs: Improved Control in Text Generation for MRC26 Feb 2024
- 2024[Lions: 1] and [Tigers: 2] and [Bears: 3], Oh My! Literary Coreference Annotation with LLMs31 Jan 2024
- 2024CRUD-RAG: A Comprehensive Chinese Benchmark for Retrieval-Augmented Generation of Large Language Models30 Jan 2024
- 2023Enhancing Low-Resource Relation Representations through Multi-View Decoupling26 Dec 2023
- 2023Retrieval-Augmented Generation for Large Language Models: A Survey18 Dec 2023
- 2023A Survey on Semantic Processing Techniques22 Oct 2023
- 2023A Predictive Factor Analysis of Social Biases and Task-Performance in Pretrained Masked Language Models19 Oct 2023
- 2023PromptRE: Weakly-Supervised Document-Level Relation Extraction via Prompting-Based Data Programming13 Oct 2023
- 2023Document-Level Relation Extraction with Relation Correlation Enhancement6 Oct 2023
- 2023Unsupervised Pretraining for Fact Verification by Language Model Distillation28 Sep 2023
- 2023A Comprehensive Survey of Document-level Relation Extraction (2016-2023)28 Sep 2023
- 2023PRiSM: Enhancing Low-Resource Document-Level Relation Extraction with Relation-Aware Score Calibration25 Sep 2023
- 2023GADePo: Graph-Assisted Declarative Pooling Transformers for Document-Level Relation Extraction28 Aug 2023
- 2023KEPLET: Knowledge-Enhanced Pretrained Language Model with Topic Entity Awareness2 May 2023
- 2023UNTER: A Unified Knowledge Interface for Enhancing Pre-trained Language Models2 May 2023
- 2023Towards Integration of Discriminability and Robustness for Document-Level Relation Extraction3 Apr 2023
- 2023BEVERS: A General, Simple, and Performant Framework for Automatic Fact Verification29 Mar 2023
- 2023Document-level Relation Extraction with Cross-sentence Reasoning Graph7 Mar 2023
- 2023LIQUID: A Framework for List Question Answering Dataset Generation3 Feb 2023
- 2022Document-level Relation Extraction with Relation Correlations20 Dec 2022
- 2022Towards Better Document-level Relation Extraction via Iterative Inference26 Nov 2022
- 2022Not Just Plain Text! Fuel Document-Level Relation Extraction with Explicit Syntax Refinement and Subsentence Modeling10 Nov 2022
- 2022DORE: Document Ordered Relation Extraction based on Generative Framework28 Oct 2022
- 2022ConstGCN: Constrained Transmission-based Graph Convolutional Networks for Document-level Relation Extraction8 Oct 2022
- 2022CorefDiffs: Co-referential and Differential Knowledge Flow in Document Grounded Conversations5 Oct 2022
- 2022Fact-Saboteurs: A Taxonomy of Evidence Manipulation Attacks against Fact-Verification Systems7 Sep 2022
- 2022IMCI: Integrate Multi-view Contextual Information for Fact Extraction and Verification30 Aug 2022
- 2022SPOT: Knowledge-Enhanced Language Representations for Information Extraction20 Aug 2022
- 2022Discourse-Aware Graph Networks for Textual Logical Reasoning4 Jul 2022
- 2022Relation-Specific Attentions over Entity Mentions for Enhanced Document-Level Relation Extraction28 May 2022
- 2022Commonsense and Named Entity Aware Knowledge Grounded Dialogue Generation27 May 2022
- 2022Prompt Tuning for Discriminative Pre-trained Language Models23 May 2022
- 2022Improving Long Tailed Document-Level Relation Extraction via Easy Relation Augmentation and Contrastive Learning21 May 2022
- 2022None Class Ranking Loss for Document-Level Relation Extraction1 May 2022
- 2022Document-Level Relation Extraction with Sentences Importance Estimation and Focusing27 Apr 2022
- 2022Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks22 Apr 2022
- 2022A Masked Image Reconstruction Network for Document-level Relation Extraction21 Apr 2022
50 newest of 80 All 80 (JSON)
- 2021Document-level Relation Extraction as Semantic Segmentationcited by 80
- 2021A Survey on Stance Detection for Mis- and Disinformation Identificationcited by 75
- 2021Entity Structure Within and Throughout: Modeling Mention Dependencies for Document-Level Relation Extractioncited by 68
- 2021Few-Shot Question Answering by Pretraining Span Selectioncited by 62
- 2021DialFact: A Benchmark for Fact-Checking in Dialoguecited by 62
- 2021ProoFVer: Natural Logic Theorem Proving for Fact Verificationcited by 52
- 2021Learning to Retrieve Passages without Supervisioncited by 46
- 2022Synthetic Disinformation Attacks on Automated Fact Verification Systemscited by 44
- 2022Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillationcited by 39
- 2021An End-to-end Model for Entity-level Relation Extraction using Multi-instance Learningcited by 31
- 2021SIRE: Separate Intra- and Inter-sentential Reasoning for Document-level Relation Extractioncited by 30
- 2021Eider: Empowering Document-level Relation Extraction with Efficient Evidence Extraction and Inference-stage Fusioncited by 28
12 most cited of 75 All 75 (JSON)
- 2025A systematic review of relation extraction task since the emergence of Transformers5 Nov 2025
- 2025Adversarial Attacks Against Automated Fact-Checking: A Survey10 Sep 2025
- 2025COMM:Concentrated Margin Maximization for Robust Document-Level Relation Extraction18 Mar 2025
- 2025GLiREL -- Generalist Model for Zero-Shot Relation Extraction6 Jan 2025
- 2024LLM with Relation Classifier for Document-Level Relation Extraction25 Aug 2024
- 2024GEGA: Graph Convolutional Networks and Evidence Retrieval Guided Attention for Enhanced Document-level Relation Extraction31 Jul 2024
- 2024Augmenting Document-level Relation Extraction with Efficient Multi-Supervision1 Jul 2024
- 2024TTM-RE: Memory-Augmented Document-Level Relation Extraction9 Jun 2024
- 2024Multi-Evidence based Fact Verification via A Confidential Graph Neural Network17 May 2024
- 2024Enhancing Pre-Trained Generative Language Models with Question Attended Span Extraction on Machine Reading Comprehension27 Apr 2024
- 2024FCDS: Fusing Constituency and Dependency Syntax into Document-Level Relation Extraction4 Mar 2024
- 2024QASE Enhanced PLMs: Improved Control in Text Generation for MRC26 Feb 2024
12 newest of 75 All 75 (JSON)