Coupling Local Context and Global Semantic Prototypes via a Hierarchical Architecture for Rhetorical Roles Labeling
Not on the map. Why?
Abstract (arXiv)
Rhetorical Role Labeling (RRL) identifies the functional role of each sentence in a document, a key task for discourse understanding in domains such as law and medicine. While hierarchical models capture local dependencies effectively, they are limited in modeling global, corpus-level features. To address this limitation, we propose two prototype-based methods that integrate local context with global representations. Prototype-Based Regularization (PBR) learns soft prototypes through a distance-based auxiliary loss to structure the latent space, while Prototype-Conditioned Modulation (PCM) constructs corpus-level prototypes and injects them during training and inference. Given the scarcity of RRL resources, we introduce SCOTUS-Law, the first dataset of U.S. Supreme Court opinions annotated with rhetorical roles at three levels of granularity: category, rhetorical function, and step. Experiments on legal, medical, and scientific benchmarks show consistent improvements over strong baselines, with 4 Macro-F1 gains on low-frequency roles. We further analyze the implications in the era of Large Language Models and complement our findings with expert evaluation.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 62 references that are in the map. First posted on arXiv 4 Mar 2026.
Builds on
29 of 62 references.
References · 29
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
- 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
- 2017PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical Abstractscited by 124
- 2018Robust Classification with Convolutional Prototype Learningcited by 123
- 2019Interpretable and Steerable Sequence Learning via Prototypescited by 72
17 more
- 2019Pretrained Language Models for Sequential Sentence Classificationcited by 53
- 2022Corpus for Automatic Structuring of Legal Documentscited by 25
- 2018Hierarchical Neural Networks for Sequential Sentence Classification in Medical Scientific Abstractscited by 22
- 2022ProtoTEx: Explaining Model Decisions with Prototype Tensorscited by 21
- 2021Enhancing Content Preservation in Text Style Transfer Using Reverse Attention and Conditional Layer Normalizationcited by 20
- 2022Robust and Explainable Identification of Logical Fallacies in Natural Language Argumentscited by 12
- 2024Few-shot clinical entity recognition in English, French and Spanish: masked language models outperform generative model promptingcited by 12
- 2021Cross-Domain Multi-Task Learning for Sequential Sentence Classification in Research Paperscited by 11
- 2016Neural Networks for Joint Sentence Classification in Medical Paper Abstractscited by 10
- 2023Prototype-Based Interpretability for Legal Citation Predictioncited by 9
- 2023Harnessing GPT-3.5-turbo for Rhetorical Role Prediction in Legal Casescited by 8
- 2025LegalSeg: Unlocking the Structure of Indian Legal Judgments Through Rhetorical Role Classificationcited by 8
- 2024HiCuLR: Hierarchical Curriculum Learning for Rhetorical Role Labeling of Legal Documentscited by 6
- 2024Mind Your Neighbours: Leveraging Analogous Instances for Rhetorical Role Labeling for Legal Documentscited by 5
- 2023MProto: Multi-Prototype Network with Denoised Optimal Transport for Distantly Supervised Named Entity Recognitioncited by 4
- 2023Visually Grounded Continual Language Learning with Selective Specializationcited by 4
- 2023A Deeper (Autoregressive) Approach to Non-Convergent Discourse Parsingcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Mining Legal Arguments in U.S. Corporate Case Lawcited by 0
- 2026Mining Legal Arguments in U.S. Corporate Case Law21 Sep 2026