mlsanityData to 7 Oct 2026

Topic-driven Distant Supervision Framework for Macro-level Discourse Parsing

arXiv 2305.13755 ↗First posted 23 May 2023cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Discourse parsing, the task of analyzing the internal rhetorical structure of texts, is a challenging problem in natural language processing. Despite the recent advances in neural models, the lack of large-scale, high-quality corpora for training remains a major obstacle. Recent studies have attempted to overcome this limitation by using distant supervision, which utilizes results from other NLP tasks (e.g., sentiment polarity, attention matrix, and segmentation probability) to parse discourse trees. However, these methods do not take into account the differences between in-domain and out-of-domain tasks, resulting in lower performance and inability to leverage the high-quality in-domain data for further improvement. To address these issues, we propose a distant supervision framework that leverages the relations between topic structure and rhetorical structure. Specifically, we propose two distantly supervised methods, based on transfer learning and the teacher-student model, that narrow the gap between in-domain and out-of-domain tasks through label mapping and oracle annotation. Experimental results on the MCDTB and RST-DT datasets show that our methods achieve the best performance in both distant-supervised and supervised scenarios.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 33 references that are in the map. First posted on arXiv 23 May 2023.

Builds on

14 of 33 references.

References · 14

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  3. 2018Text Segmentation as a Supervised Learning Taskcited by 76
  4. 2020Text Segmentation by Cross Segment Attentioncited by 54
  5. 2020Two-Level Transformer and Auxiliary Coherence Modeling for Improved Text Segmentationcited by 41
  6. 2018Attention-based Neural Text Segmentationcited by 26
  7. 2020Improving Context Modeling in Neural Topic Segmentationcited by 21
  8. 2017Scientific document summarization via citation contextualization and scientific discoursecited by 12
  9. 2019Discourse-Aware Semantic Self-Attention for Narrative Reading Comprehensioncited by 12
  10. 2021Predicting Discourse Trees from Transformer-based Neural Summarizerscited by 10
  11. 2019Predicting Discourse Structure using Distant Supervision from Sentimentcited by 8
  12. 2020MEGA RST Discourse Treebanks with Structure and Nuclearity from Scalable Distant Sentiment Supervisioncited by 8
2 more
  1. 2021Predicting Above-Sentence Discourse Structure using Distant Supervision from Topic Segmentationcited by 5
  2. 2022A Simple and Strong Baseline for End-to-End Neural RST-style Discourse Parsingcited by 4

Built on by

Not cited yet.