A Multi-Task and Multi-Label Classification Model for Implicit Discourse Relation Recognition
Not on the map. Why?
Abstract (arXiv)
We propose a novel multi-label classification approach to implicit discourse relation recognition (IDRR). Our approach features a multi-task model that jointly learns multi-label representations of implicit discourse relations across all three sense levels in the PDTB 3.0 framework. The model can also be adapted to the traditional single-label IDRR setting by selecting the sense with the highest probability in the multi-label representation. We conduct extensive experiments to identify optimal model configurations and loss functions in both settings. Our approach establishes the first benchmark for multi-label IDRR and achieves SOTA results on single-label IDRR using DiscoGeM. Finally, we evaluate our model on the PDTB 3.0 corpus in the single-label setting, presenting the first analysis of transfer learning between the DiscoGeM and PDTB 3.0 corpora for IDRR.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 25 of its 70 references that are in the map. First posted on arXiv 16 Aug 2024.
Builds on
25 of 70 references.
References · 25
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2019Human uncertainty makes classification more robustcited by 231
- 2020What Can We Learn from Collective Human Opinions on Natural Language Inference Data?cited by 148
- 2017Deep learning from crowdscited by 105
- 2020On the Importance of Word and Sentence Representation Learning in Implicit Discourse Relation Classificationcited by 40
13 more
- 2020QADiscourse -- Discourse Relations as QA Pairs: Representation, Crowdsourcing and Baselinescited by 34
- 2023DiscoPrompt: Path Prediction Prompt Tuning for Implicit Discourse Relation Recognitioncited by 23
- 2023Facilitating Contrastive Learning of Discourse Relational Senses by Exploiting the Hierarchy of Sense Relationscited by 22
- 2021A Label Dependence-aware Sequence Generation Model for Multi-level Implicit Discourse Relation Recognitioncited by 18
- 2024Annotator-Centric Active Learning for Subjective NLP Taskscited by 18
- 2018Learning to Explicitate Connectives with Seq2Seq Network for Implicit Discourse Relation Classificationcited by 16
- 2019A Crowdsourced Frame Disambiguation Corpus with Ambiguitycited by 16
- 2022Prompt-based Connective Prediction Method for Fine-grained Implicit Discourse Relation Recognitioncited by 14
- 2023Design Choices for Crowdsourcing Implicit Discourse Relations: Revealing the Biases Introduced by Task Designcited by 14
- 2023Annotation-Inspired Implicit Discourse Relation Classification with Auxiliary Discourse Connective Generationcited by 12
- 2024Infusing Hierarchical Guidance into Prompt Tuning: A Parameter-Efficient Framework for Multi-level Implicit Discourse Relation Recognitioncited by 11
- 2020Extending Implicit Discourse Relation Recognition to the PDTB-3cited by 10
- 2024Multi-Label Classification for Implicit Discourse Relation Recognitioncited by 9
Built on by
Citing papers per year: 2024: 1; 2025: 3.
4 papers.
- 2024On Crowdsourcing Task Design for Discourse Relation Annotationcited by 2
- 2025Multi-Lingual Implicit Discourse Relation Recognition with Multi-Label Hierarchical Learningcited by 1
- 2025CLaC at DISRPT 2025: Hierarchical Adapters for Cross-Framework Multi-lingual Discourse Relation Classificationcited by 0
- 2025On the Influence of Discourse Relations in Persuasive Textscited by 0
- 2025On the Influence of Discourse Relations in Persuasive Texts30 Oct 2025
- 2025CLaC at DISRPT 2025: Hierarchical Adapters for Cross-Framework Multi-lingual Discourse Relation Classification21 Sep 2025
- 2025Multi-Lingual Implicit Discourse Relation Recognition with Multi-Label Hierarchical Learning28 Aug 2025
- 2024On Crowdsourcing Task Design for Discourse Relation Annotation16 Dec 2024