mlsanityData to 14 Oct 2026

Coupling Local Context and Global Semantic Prototypes via a Hierarchical Architecture for Rhetorical Roles Labeling

arXiv 2603.03856 ↗First posted 4 Mar 2026cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

Rhetorical Role Labeling (RRL) identifies the functional role of each sentence in a document, a key task for discourse understanding in domains such as law and medicine. While hierarchical models capture local dependencies effectively, they are limited in modeling global, corpus-level features. To address this limitation, we propose two prototype-based methods that integrate local context with global representations. Prototype-Based Regularization (PBR) learns soft prototypes through a distance-based auxiliary loss to structure the latent space, while Prototype-Conditioned Modulation (PCM) constructs corpus-level prototypes and injects them during training and inference. Given the scarcity of RRL resources, we introduce SCOTUS-Law, the first dataset of U.S. Supreme Court opinions annotated with rhetorical roles at three levels of granularity: category, rhetorical function, and step. Experiments on legal, medical, and scientific benchmarks show consistent improvements over strong baselines, with 4 Macro-F1 gains on low-frequency roles. We further analyze the implications in the era of Large Language Models and complement our findings with expert evaluation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 29 of its 62 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

29 of 62 references.

References · 29

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  6. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  7. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  8. 2019SciBERT: A Pretrained Language Model for Scientific Textcited by 1,414
  9. 2018This Looks Like That: Deep Learning for Interpretable Image Recognitioncited by 737
  10. 2017PubMed 200k RCT: a Dataset for Sequential Sentence Classification in Medical Abstractscited by 124
  11. 2018Robust Classification with Convolutional Prototype Learningcited by 123
  12. 2019Interpretable and Steerable Sequence Learning via Prototypescited by 72
17 more
  1. 2019Pretrained Language Models for Sequential Sentence Classificationcited by 53
  2. 2022Corpus for Automatic Structuring of Legal Documentscited by 25
  3. 2018Hierarchical Neural Networks for Sequential Sentence Classification in Medical Scientific Abstractscited by 22
  4. 2022ProtoTEx: Explaining Model Decisions with Prototype Tensorscited by 21
  5. 2021Enhancing Content Preservation in Text Style Transfer Using Reverse Attention and Conditional Layer Normalizationcited by 20
  6. 2022Robust and Explainable Identification of Logical Fallacies in Natural Language Argumentscited by 12
  7. 2024Few-shot clinical entity recognition in English, French and Spanish: masked language models outperform generative model promptingcited by 12
  8. 2021Cross-Domain Multi-Task Learning for Sequential Sentence Classification in Research Paperscited by 11
  9. 2016Neural Networks for Joint Sentence Classification in Medical Paper Abstractscited by 10
  10. 2023Prototype-Based Interpretability for Legal Citation Predictioncited by 9
  11. 2023Harnessing GPT-3.5-turbo for Rhetorical Role Prediction in Legal Casescited by 8
  12. 2025LegalSeg: Unlocking the Structure of Indian Legal Judgments Through Rhetorical Role Classificationcited by 8
  13. 2024HiCuLR: Hierarchical Curriculum Learning for Rhetorical Role Labeling of Legal Documentscited by 6
  14. 2024Mind Your Neighbours: Leveraging Analogous Instances for Rhetorical Role Labeling for Legal Documentscited by 5
  15. 2023MProto: Multi-Prototype Network with Denoised Optimal Transport for Distantly Supervised Named Entity Recognitioncited by 4
  16. 2023Visually Grounded Continual Language Learning with Selective Specializationcited by 4
  17. 2023A Deeper (Autoregressive) Approach to Non-Convergent Discourse Parsingcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.