# Leveraging Hierarchical Prototypes as the Verbalizer for Implicit Discourse Relation Recognition

arXiv: https://arxiv.org/abs/2411.14880 · HTML: https://mlsanity.com/paper/2411.14880/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 10 of its 46 references that are in the map.
- First posted on arXiv 22 Nov 2024.

## Builds on (most cited first, 10 of 10)

- [RoBERTa: A Robustly Optimized BERT Pretraining Approach](https://mlsanity.com/paper/1907.11692/) (2019)
- [Unsupervised Cross-lingual Representation Learning at Scale](https://mlsanity.com/paper/1911.02116/) (2019)
- [Prototypical Networks for Few-shot Learning](https://mlsanity.com/paper/1703.05175/) (2017)
- [Supervised Contrastive Learning](https://mlsanity.com/paper/2004.11362/) (2020)
- [On the Importance of Word and Sentence Representation Learning in Implicit Discourse Relation Classification](https://mlsanity.com/paper/2004.12617/) (2020)
- [Prototypical Representation Learning for Relation Extraction](https://mlsanity.com/paper/2103.11647/) (2021)
- [Supervised Prototypical Contrastive Learning for Emotion Recognition in Conversation](https://mlsanity.com/paper/2210.08713/) (2022)
- [DiscoPrompt: Path Prediction Prompt Tuning for Implicit Discourse Relation Recognition](https://mlsanity.com/paper/2305.03973/) (2023)
- [A Label Dependence-aware Sequence Generation Model for Multi-level Implicit Discourse Relation Recognition](https://mlsanity.com/paper/2112.11740/) (2021)
- [Improving Self-training for Cross-lingual Named Entity Recognition with Contrastive and Prototype Learning](https://mlsanity.com/paper/2305.13628/) (2023)

## Built on by (most cited first, 5 of 5)

- [Fine-Grained Evaluation for Implicit Discourse Relation Recognition](https://mlsanity.com/paper/2503.05326/) (2025)
- [Evaluating Discourse Cohesion in Pre-trained Language Models](https://mlsanity.com/paper/2503.06137/) (2025)
- [Multi-Lingual Implicit Discourse Relation Recognition with Multi-Label Hierarchical Learning](https://mlsanity.com/paper/2508.20712/) (2025)
- [Similarity-Based Domain Adaptation with LLMs](https://mlsanity.com/paper/2503.05281/) (2025)
- [MetaXCR: Reinforcement-Based Meta-Transfer Learning for Cross-Lingual Commonsense Reasoning](https://mlsanity.com/paper/2503.06531/) (2025)

## Abstract (arXiv)

Implicit discourse relation recognition involves determining relationships that hold between spans of text that are not linked by an explicit discourse connective. In recent years, the pre-train, prompt, and predict paradigm has emerged as a promising approach for tackling this task. However, previous work solely relied on manual verbalizers for implicit discourse relation recognition, which suffer from issues of ambiguity and even incorrectness. To overcome these limitations, we leverage the prototypes that capture certain class-level semantic features and the hierarchical label structure for different classes as the verbalizer. We show that our method improves on competitive baselines. Besides, our proposed approach can be extended to enable zero-shot cross-lingual learning, facilitating the recognition of discourse relations in languages with scarce resources. These advancement validate the practicality and versatility of our approach in addressing the issues of implicit discourse relation recognition across different languages.
