Advancing Topic Segmentation and Outline Generation in Chinese Texts: The Paragraph-level Topic Representation, Corpus, and Benchmark
Not on the map. Why?
Abstract (arXiv)
Topic segmentation and outline generation strive to divide a document into coherent topic sections and generate corresponding subheadings, unveiling the discourse topic structure of a document. Compared with sentence-level topic structure, the paragraph-level topic structure can quickly grasp and understand the overall context of the document from a higher level, benefitting many downstream tasks such as summarization, discourse parsing, and information retrieval. However, the lack of large-scale, high-quality Chinese paragraph-level topic structure corpora restrained relative research and applications. To fill this gap, we build the Chinese paragraph-level topic representation, corpus, and benchmark in this paper. Firstly, we propose a hierarchical paragraph-level topic structure representation with three layers to guide the corpus construction. Then, we employ a two-stage man-machine collaborative annotation method to construct the largest Chinese Paragraph-level Topic Structure corpus (CPTS), achieving high quality. We also build several strong baselines, including ChatGPT, to validate the computability of CPTS on two fundamental tasks (topic segmentation and outline generation) and preliminarily verified its usefulness for the downstream task (discourse parsing).
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 20 of its 60 references that are in the map. First posted on arXiv 24 May 2023.
Builds on
20 of 60 references.
References · 20
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,893
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,811
- 2019Text Summarization with Pretrained Encoderscited by 556
- 2018Text Segmentation as a Supervised Learning Taskcited by 76
- 2019Extractive Summarization of Long Documents by Combining Global and Local Contextcited by 59
- 2020Text Segmentation by Cross Segment Attentioncited by 54
- 2019SECTOR: A Neural Model for Coherent Topic Segmentation and Classificationcited by 48
- 2020Topic-Aware Multi-turn Dialogue Modelingcited by 46
- 2020Two-Level Transformer and Auxiliary Coherence Modeling for Improved Text Segmentationcited by 41
8 more
- 2018Attention-based Neural Text Segmentationcited by 26
- 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Studycited by 24
- 2021Transformer over Pre-trained Transformer for Neural Text Segmentation with Enhanced Topic Coherencecited by 22
- 2020Improving Context Modeling in Neural Topic Segmentationcited by 21
- 2021End-to-End Segmentation-based News Summarizationcited by 16
- 2019Outline Generation: Understanding the Inherent Content Structure of Documentscited by 12
- 2021Predicting Above-Sentence Discourse Structure using Distant Supervision from Topic Segmentationcited by 5
- 2022Improving Topic Segmentation by Injecting Discourse Dependenciescited by 5
Built on by
Citing papers per year: 2025: 3.
3 papers.