Text Segmentation as a Supervised Learning Task
Not on the map. Why?
Abstract (arXiv)
Text segmentation, the task of dividing a document into contiguous segments based on its semantic structure, is a longstanding challenge in language understanding. Previous work on text segmentation focused on unsupervised methods such as clustering or graph search, due to the paucity in labeled data. In this work, we formulate text segmentation as a supervised learning problem, and present a large new dataset for text segmentation that is automatically extracted and labeled from Wikipedia. Moreover, we develop a segmentation model based on this dataset and show that it generalizes well to unseen natural text.
Key facts. Cited by 76 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Mar 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 9; 2022: 7; 2023: 15; 2024: 8; 2025: 17; 2026: 20.
76 papers.
Sort:
By area:
- 2021Improving Unsupervised Dialogue Topic Segmentation with Utterance-Pair Coherence Scoringcited by 29
- 2022Toward Unifying Text Segmentation and Long Document Summarizationcited by 28
- 2021TIAGE: A Benchmark for Topic-Shift Aware Dialog Modelingcited by 22
- 2021Transformer over Pre-trained Transformer for Neural Text Segmentation with Enhanced Topic Coherencecited by 22
- 2024Detecting AI-Generated Sentences in Human-AI Collaborative Hybrid Texts: Challenges, Strategies, and Insightscited by 21
- 2023Stance Detection: A Practical Guide to Classifying Political Beliefs in Textcited by 20
- 2023Improving Long Document Topic Segmentation Models With Enhanced Coherence Modelingcited by 15
- 2021Sequence Model with Self-Adaptive Sliding Window for Efficient Spoken Document Segmentationcited by 14
- 2025Reconstructing Context: Evaluating Advanced Chunking Strategies for Retrieval-Augmented Generationcited by 12
- 2021Iterative Hierarchical Attention for Answering Complex Questions over Long Documentscited by 10
- 2023SuperDialseg: A Large-scale Dataset for Supervised Dialogue Segmentationcited by 10
- 2021Learning Constraints and Descriptive Segmentation for Subevent Detectioncited by 9
38 more
- 2025HiChunk: Evaluating and Enhancing Retrieval-Augmented Generation with Hierarchical Chunkingcited by 9
- 2025Enhancing Retrieval Augmented Generation with Hierarchical Text Segmentation Chunkingcited by 7
- 2021VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarizationcited by 6
- 2021Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentationcited by 6
- 2022MHMS: Multimodal Hierarchical Multimedia Summarizationcited by 6
- 2022Structured Summarization: Unified Text Segmentation and Segment Labeling as a Generation Taskcited by 6
- 2022Semantics-Consistent Cross-domain Summarization via Optimal Transport Alignmentcited by 6
- 2024Recent Trends in Linear Text Segmentation: a Surveycited by 6
- 2026Membox: Weaving Topic Continuity into Long-Range Memory for LLM Agentscited by 6
- 2021Predicting Above-Sentence Discourse Structure using Distant Supervision from Topic Segmentationcited by 5
- 2022Improving Topic Segmentation by Injecting Discourse Dependenciescited by 5
- 2022Topic Segmentation in the Wild: Towards Segmentation of Semi-structured & Unstructured Chatscited by 5
- 2024Large Language Models for Page Stream Segmentationcited by 5
- 2025Chunk Twice, Embed Once: A Systematic Study of Segmentation and Representation Trade-offs in Chemistry-Aware Retrieval-Augmented Generationcited by 5
- 2025DAMASHA: Detecting AI in Mixed Adversarial Texts via Segmentation with Human-interpretable Attributioncited by 5
- 2022Topical Segmentation of Spoken Narratives: A Test Case on Holocaust Survivor Testimoniescited by 4
- 2023Topic Shift Detection in Chinese Dialogues: Corpus and Benchmarkcited by 4
- 2023Multi-turn Dialogue Comprehension from a Topic-aware Perspectivecited by 4
- 2026Towards Multi-Level Transcript Segmentation: LoRA Fine-Tuning for Table-of-Contents Generationcited by 4
- 2023Topic Segmentation Model Focusing on Local Contextcited by 3
- 2023Advancing Topic Segmentation and Outline Generation in Chinese Texts: The Paragraph-level Topic Representation, Corpus, and Benchmarkcited by 3
- 2023Unsupervised Dialogue Topic Segmentation in Hyperdimensional Spacecited by 3
- 2024TocBERT: Medical Document Structure Extraction Using Bidirectional Transformerscited by 3
- 2026Beyond Transcripts: A Renewed Perspective on Audio Chapteringcited by 3
- 2025CrossFormer: Cross-Segment Semantic Fusion for Document Segmentationcited by 2
- 2025Paragraph Segmentation Revisited: Towards a Standard Task for Structuring Speechcited by 2
- 2026QEvict: Recoverable Quantized KV Eviction for Attention-Drift-Robust Long-Context Decodingcited by 2
- 2023Topic Segmentation of Semi-Structured and Unstructured Conversational Datasets using Language Modelscited by 1
- 2024Branching Narratives: Character Decision Points Detectioncited by 1
- 2024Multimodal Fusion and Coherence Modeling for Video Topic Segmentationcited by 1
- 2024Advancing Topic Segmentation of Broadcasted Speech with Multilingual Semantic Embeddingscited by 1
- 2025Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotatorscited by 1
- 2025Team "better_call_claude": Style Change Detection using a Sequential Sentence Pair Classifiercited by 1
- 2025BoundRL: Efficient Structured Text Segmentation through Reinforced Boundary Generationcited by 1
- 2025When F1 Fails: Granularity-Aware Evaluation for Dialogue Topic Segmentationcited by 1
- 2025Topic Segmentation Using Generative Language Modelscited by 1
- 2026Reading Between the Waves: Robust Topic Segmentation Using Inter-Sentence Audio Featurescited by 1
- 2026Structure-Aware Chunking for Tabular Data in Retrieval-Augmented Generationcited by 1
50 most cited of 76 All 76 (JSON)
- 2026Reusing Latent Speech Representations for Query-Conditioned Topic Localization in Transcripts18 Sep 2026
- 2026Automated Detection and Structuring of Social Tipping Point Evidence in Climate related Documents: A Modular AI Framework10 Sep 2026
- 2026Comparing Chunking and Embedding Strategies for Turkish RAG Systems24 Aug 2026
- 2026QEvict: Recoverable Quantized KV Eviction for Attention-Drift-Robust Long-Context Decoding5 Aug 2026
- 2026Right Reset: Chunking by Prefix Removal5 Aug 2026
- 2026CobSeg: Coherence Boundary Modeling for Dialogue Topic Segmentation29 May 2026
- 2026Evaluation of Chunking Strategies for Effective Text Embedding in Low-Resource Language on Agricultural Documents21 May 2026
- 2026SemChunk-C: Semantic Segmentation for C Code12 May 2026
- 2026Structure-Aware Chunking for Tabular Data in Retrieval-Augmented Generation1 May 2026
- 2026Pooling and Semantic Shift: The Fundamental Challenges in Long Text Embedding and Retrieval22 Mar 2026
- 2026CzechTopic: A Benchmark for Zero-Shot Topic Localization in Historical Czech Documents4 Mar 2026
- 2026Intent-Driven Dynamic Chunking: Segmenting Documents to Reflect Predicted Information Needs16 Feb 2026
38 more
- 2026Beyond Transcripts: A Renewed Perspective on Audio Chaptering9 Feb 2026
- 2026NLP for Local Governance Meeting Records: A Focus Article on Tasks, Datasets, Metrics and Benchmark8 Feb 2026
- 2026Reading Between the Waves: Robust Topic Segmentation Using Inter-Sentence Audio Features6 Feb 2026
- 2026Unsupervised Text Segmentation via Kernel Change-Point Detection on Sentence Embeddings26 Jan 2026
- 2026Codebook-Injected Dialogue Segmentation for Multi-Utterance Constructs Annotation: LLM-Assisted and Gold-Label-Free Evaluation17 Jan 2026
- 2026Membox: Weaving Topic Continuity into Long-Range Memory for LLM Agents7 Jan 2026
- 2026SegNSP: Revisiting Next Sentence Prediction for Linear Text Segmentation7 Jan 2026
- 2026Towards Multi-Level Transcript Segmentation: LoRA Fine-Tuning for Table-of-Contents Generation5 Jan 2026
- 2025Paragraph Segmentation Revisited: Towards a Standard Task for Structuring Speech30 Dec 2025
- 2025Topic Segmentation Using Generative Language Models27 Dec 2025
- 2025Toward General Semantic Chunking: A Discriminative Framework for Ultra-Long Documents23 Dec 2025
- 2025When F1 Fails: Granularity-Aware Evaluation for Dialogue Topic Segmentation18 Dec 2025
- 2025DAMASHA: Detecting AI in Mixed Adversarial Texts via Segmentation with Human-interpretable Attribution4 Dec 2025
- 2025BoundRL: Efficient Structured Text Segmentation through Reinforced Boundary Generation23 Oct 2025
- 2025Consistent Kernel Change-Point Detection under m-Dependence for Text Segmentation3 Oct 2025
- 2025HiChunk: Evaluating and Enhancing Retrieval-Augmented Generation with Hierarchical Chunking15 Sep 2025
- 2025Team "better_call_claude": Style Change Detection using a Sequential Sentence Pair Classifier1 Aug 2025
- 2025Enhancing Retrieval Augmented Generation with Hierarchical Text Segmentation Chunking14 Jul 2025
- 2025Semantic Source Code Segmentation using Small and Large Language Models11 Jul 2025
- 2025A Vietnamese Dataset for Text Segmentation and Multiple Choices Reading Comprehension19 Jun 2025
- 2025Chunk Twice, Embed Once: A Systematic Study of Segmentation and Representation Trade-offs in Chemistry-Aware Retrieval-Augmented Generation13 Jun 2025
- 2025BP-Seg: A graphical model approach to unsupervised and non-contiguous text segmentation using belief propagation22 May 2025
- 2025Reconstructing Context: Evaluating Advanced Chunking Strategies for Retrieval-Augmented Generation28 Apr 2025
- 2025CrossFormer: Cross-Segment Semantic Fusion for Document Segmentation31 Mar 2025
- 2025Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators9 Mar 2025
- 2024Recent Trends in Linear Text Segmentation: a Survey25 Nov 2024
- 2024fLSA: Learning Semantic Structures in Document Collections Using Foundation Models7 Oct 2024
- 2024Advancing Topic Segmentation of Broadcasted Speech with Multilingual Semantic Embeddings10 Sep 2024
- 2024Large Language Models for Page Stream Segmentation21 Aug 2024
- 2024Multimodal Fusion and Coherence Modeling for Video Topic Segmentation1 Aug 2024
- 2024TocBERT: Medical Document Structure Extraction Using Bidirectional Transformers27 Jun 2024
- 2024Branching Narratives: Character Decision Points Detection12 May 2024
- 2024Detecting AI-Generated Sentences in Human-AI Collaborative Hybrid Texts: Challenges, Strategies, and Insights6 Mar 2024
- 2023Segmenting Messy Text: Detecting Boundaries in Text Derived from Historical Newspaper Images20 Dec 2023
- 2023Multi-Modal Video Topic Segmentation with Dual-Contrastive Domain Adaptation30 Nov 2023
- 2023Topic Segmentation of Semi-Structured and Unstructured Conversational Datasets using Language Models26 Oct 2023
- 2023Improving Long Document Topic Segmentation Models With Enhanced Coherence Modeling18 Oct 2023
- 2023Grounded Complex Task Segmentation for Conversational Assistants20 Sep 2023
50 newest of 76 All 76 (JSON)
- 2025Reconstructing Context: Evaluating Advanced Chunking Strategies for Retrieval-Augmented Generationcited by 12
- 2025HiChunk: Evaluating and Enhancing Retrieval-Augmented Generation with Hierarchical Chunkingcited by 9
- 2025Enhancing Retrieval Augmented Generation with Hierarchical Text Segmentation Chunkingcited by 7
- 2025Chunk Twice, Embed Once: A Systematic Study of Segmentation and Representation Trade-offs in Chemistry-Aware Retrieval-Augmented Generationcited by 5
- 2026Structure-Aware Chunking for Tabular Data in Retrieval-Augmented Generationcited by 1
- 2026Evaluation of Chunking Strategies for Effective Text Embedding in Low-Resource Language on Agricultural Documentscited by 0
- 2026Comparing Chunking and Embedding Strategies for Turkish RAG Systemscited by 0
- 2026Comparing Chunking and Embedding Strategies for Turkish RAG Systems24 Aug 2026
- 2026Evaluation of Chunking Strategies for Effective Text Embedding in Low-Resource Language on Agricultural Documents21 May 2026
- 2026Structure-Aware Chunking for Tabular Data in Retrieval-Augmented Generation1 May 2026
- 2025HiChunk: Evaluating and Enhancing Retrieval-Augmented Generation with Hierarchical Chunking15 Sep 2025
- 2025Enhancing Retrieval Augmented Generation with Hierarchical Text Segmentation Chunking14 Jul 2025
- 2025Chunk Twice, Embed Once: A Systematic Study of Segmentation and Representation Trade-offs in Chemistry-Aware Retrieval-Augmented Generation13 Jun 2025
- 2025Reconstructing Context: Evaluating Advanced Chunking Strategies for Retrieval-Augmented Generation28 Apr 2025
- 2021Improving Unsupervised Dialogue Topic Segmentation with Utterance-Pair Coherence Scoringcited by 29
- 2022Toward Unifying Text Segmentation and Long Document Summarizationcited by 28
- 2021TIAGE: A Benchmark for Topic-Shift Aware Dialog Modelingcited by 22
- 2021Transformer over Pre-trained Transformer for Neural Text Segmentation with Enhanced Topic Coherencecited by 22
- 2024Detecting AI-Generated Sentences in Human-AI Collaborative Hybrid Texts: Challenges, Strategies, and Insightscited by 21
- 2023Stance Detection: A Practical Guide to Classifying Political Beliefs in Textcited by 20
- 2023Improving Long Document Topic Segmentation Models With Enhanced Coherence Modelingcited by 15
- 2021Sequence Model with Self-Adaptive Sliding Window for Efficient Spoken Document Segmentationcited by 14
- 2021Iterative Hierarchical Attention for Answering Complex Questions over Long Documentscited by 10
- 2023SuperDialseg: A Large-scale Dataset for Supervised Dialogue Segmentationcited by 10
- 2021Learning Constraints and Descriptive Segmentation for Subevent Detectioncited by 9
- 2021VT-SSum: A Benchmark Dataset for Video Transcript Segmentation and Summarizationcited by 6
12 most cited of 68 All 68 (JSON)
- 2026Reusing Latent Speech Representations for Query-Conditioned Topic Localization in Transcripts18 Sep 2026
- 2026Automated Detection and Structuring of Social Tipping Point Evidence in Climate related Documents: A Modular AI Framework10 Sep 2026
- 2026QEvict: Recoverable Quantized KV Eviction for Attention-Drift-Robust Long-Context Decoding5 Aug 2026
- 2026Right Reset: Chunking by Prefix Removal5 Aug 2026
- 2026CobSeg: Coherence Boundary Modeling for Dialogue Topic Segmentation29 May 2026
- 2026SemChunk-C: Semantic Segmentation for C Code12 May 2026
- 2026Pooling and Semantic Shift: The Fundamental Challenges in Long Text Embedding and Retrieval22 Mar 2026
- 2026CzechTopic: A Benchmark for Zero-Shot Topic Localization in Historical Czech Documents4 Mar 2026
- 2026Intent-Driven Dynamic Chunking: Segmenting Documents to Reflect Predicted Information Needs16 Feb 2026
- 2026Beyond Transcripts: A Renewed Perspective on Audio Chaptering9 Feb 2026
- 2026NLP for Local Governance Meeting Records: A Focus Article on Tasks, Datasets, Metrics and Benchmark8 Feb 2026
- 2026Reading Between the Waves: Robust Topic Segmentation Using Inter-Sentence Audio Features6 Feb 2026
12 newest of 68 All 68 (JSON)