mlsanityData to 7 Oct 2026

Text Segmentation by Cross Segment Attention

arXiv 2004.14535 ↗First posted 30 Apr 2020cs.CLcited by 54

Not on the map. Why?

Abstract (arXiv)

Document and discourse segmentation are two fundamental NLP tasks pertaining to breaking up text into constituents, which are commonly used to help downstream tasks such as information retrieval or text summarization. In this work, we propose three transformer-based architectures and provide comprehensive comparisons with previously proposed approaches on three standard datasets. We establish a new state-of-the-art, reducing in particular the error rates by a large margin in all cases. We further analyze model sizes and find that we can build models with many fewer parameters while keeping good performance, thus facilitating real-world applications.

Key facts. Cited by 54 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 5; 2022: 6; 2023: 11; 2024: 9; 2025: 12; 2026: 11.

54 papers.

Sort:

By area:

  1. 2022Toward Unifying Text Segmentation and Long Document Summarizationcited by 28
  2. 2021Transformer over Pre-trained Transformer for Neural Text Segmentation with Enhanced Topic Coherencecited by 22
  3. 2024Detecting AI-Generated Sentences in Human-AI Collaborative Hybrid Texts: Challenges, Strategies, and Insightscited by 21
  4. 2025MoC: Mixtures of Text Chunking Learners for Retrieval-Augmented Generation Systemcited by 19
  5. 2024From Text Segmentation to Smart Chaptering: A Novel Benchmark for Structuring Video Transcriptionscited by 16
  6. 2023Improving Long Document Topic Segmentation Models With Enhanced Coherence Modelingcited by 15
  7. 2021Sequence Model with Self-Adaptive Sliding Window for Efficient Spoken Document Segmentationcited by 14
  8. 2023MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videoscited by 12
  9. 2021Learning Constraints and Descriptive Segmentation for Subevent Detectioncited by 9
  10. 2024Natural Language Processing for Human Resources: A Surveycited by 9
  11. 2021Deep Discourse Analysis for Generating Personalized Feedback in Intelligent Tutor Systemscited by 8
  12. 2024PODTILE: Facilitating Podcast Episode Browsing with Auto-generated Chapterscited by 8
38 more
  1. 2021Human Guided Exploitation of Interpretable Attention Patterns in Summarization and Topic Segmentationcited by 6
  2. 2022MHMS: Multimodal Hierarchical Multimedia Summarizationcited by 6
  3. 2022Semantics-Consistent Cross-domain Summarization via Optimal Transport Alignmentcited by 6
  4. 2023Multi-Granularity Prompts for Topic Shift Detection in Dialoguecited by 6
  5. 2024Recent Trends in Linear Text Segmentation: a Surveycited by 6
  6. 2026Membox: Weaving Topic Continuity into Long-Range Memory for LLM Agentscited by 6
  7. 2022Topic Segmentation in the Wild: Towards Segmentation of Semi-structured & Unstructured Chatscited by 5
  8. 2025Chunk Twice, Embed Once: A Systematic Study of Segmentation and Representation Trade-offs in Chemistry-Aware Retrieval-Augmented Generationcited by 5
  9. 2022Topical Segmentation of Spoken Narratives: A Test Case on Holocaust Survivor Testimoniescited by 4
  10. 2025SafeRBench: Dissecting the Reasoning Safety of Large Language Modelscited by 4
  11. 2026Towards Multi-Level Transcript Segmentation: LoRA Fine-Tuning for Table-of-Contents Generationcited by 4
  12. 2023Topic Segmentation Model Focusing on Local Contextcited by 3
  13. 2023Advancing Topic Segmentation and Outline Generation in Chinese Texts: The Paragraph-level Topic Representation, Corpus, and Benchmarkcited by 3
  14. 2024TocBERT: Medical Document Structure Extraction Using Bidirectional Transformerscited by 3
  15. 2026Beyond Transcripts: A Renewed Perspective on Audio Chapteringcited by 3
  16. 2022AntPivot: Livestream Highlight Detection via Hierarchical Attention Mechanismcited by 2
  17. 2023Enhancing Pre-Trained Language Models with Sentence Position Embeddings for Rhetorical Roles Recognition in Legal Opinionscited by 2
  18. 2024Discovering Elementary Discourse Units in Textual Data Using Canonical Correlation Analysiscited by 2
  19. 2025CrossFormer: Cross-Segment Semantic Fusion for Document Segmentationcited by 2
  20. 2025Paragraph Segmentation Revisited: Towards a Standard Task for Structuring Speechcited by 2
  21. 2023Topic Segmentation of Semi-Structured and Unstructured Conversational Datasets using Language Modelscited by 1
  22. 2024Multimodal Fusion and Coherence Modeling for Video Topic Segmentationcited by 1
  23. 2025MS4UI: A Dataset for Multi-modal Summarization of User Interface Instructional Videoscited by 1
  24. 2025BoundRL: Efficient Structured Text Segmentation through Reinforced Boundary Generationcited by 1
  25. 2025Topic Segmentation Using Generative Language Modelscited by 1
  26. 2026Reading Between the Waves: Robust Topic Segmentation Using Inter-Sentence Audio Featurescited by 1
  27. 2026Linear Semantic Segmentation for Low-Resource Spoken Dialectscited by 1
  28. 2023Unsupervised Scientific Abstract Segmentation with Normalized Mutual Informationcited by 0
  29. 2023Topic-driven Distant Supervision Framework for Macro-level Discourse Parsingcited by 0
  30. 2023Grounded Complex Task Segmentation for Conversational Assistantscited by 0
  31. 2023Multi-Modal Video Topic Segmentation with Dual-Contrastive Domain Adaptationcited by 0
  32. 2024Mevaker: Conclusion Extraction and Allocation Resources for the Hebrew Languagecited by 0
  33. 2025CoMuMDR: Code-mixed Multi-modal Multi-domain corpus for Discourse paRsing in conversationscited by 0
  34. 2025Semantic Source Code Segmentation using Small and Large Language Modelscited by 0
  35. 2025Consistent Kernel Change-Point Detection under m-Dependence for Text Segmentationcited by 0
  36. 2026SegNSP: Revisiting Next Sentence Prediction for Linear Text Segmentationcited by 0
  37. 2026Unsupervised Text Segmentation via Kernel Change-Point Detection on Sentence Embeddingscited by 0
  38. 2026NLP for Local Governance Meeting Records: A Focus Article on Tasks, Datasets, Metrics and Benchmarkcited by 0

50 most cited of 54 All 54 (JSON)