mlsanityData to 7 Oct 2026

Unsupervised Topic Segmentation of Meetings with BERT Embeddings

arXiv 2106.12978 ↗First posted 24 Jun 2021cs.LG cs.CLcited by 30

Not on the map. Why?

Abstract (arXiv)

Topic segmentation of meetings is the task of dividing multi-person meeting transcripts into topic blocks. Supervised approaches to the problem have proven intractable due to the difficulties in collecting and accurately annotating large datasets. In this paper we show how previous unsupervised topic segmentation methods can be improved using pre-trained neural architectures. We introduce an unsupervised approach based on BERT embeddings that achieves a 15.5% reduction in error rate over existing unsupervised approaches applied to two popular datasets for meeting transcripts.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 11 of its 35 references that are in the map. First posted on arXiv 24 Jun 2021.

Builds on

11 of 35 references.

References · 11

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  6. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  7. 2015A large annotated corpus for learning natural language inferencecited by 1,837
  8. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,041
  9. 2017SemEval-2017 Task 1: Semantic Textual Similarity - Multilingual and Cross-lingual Focused Evaluationcited by 998
  10. 2019SECTOR: A Neural Model for Coherent Topic Segmentation and Classificationcited by 48
  11. 2018Attention-based Neural Text Segmentationcited by 26

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 10; 2024: 5; 2025: 3; 2026: 8.

30 papers.

Sort:

By area:

  1. 2023Uncovering the Potential of ChatGPT for Discourse Analysis in Dialogue: An Empirical Studycited by 24
  2. 2023Improving Long Document Topic Segmentation Models With Enhanced Coherence Modelingcited by 15
  3. 2023Unsupervised Dialogue Topic Segmentation with Topic-aware Utterance Representationcited by 11
  4. 2022Structured Summarization: Unified Text Segmentation and Segment Labeling as a Generation Taskcited by 6
  5. 2024Recent Trends in Linear Text Segmentation: a Surveycited by 6
  6. 2022Improving Topic Segmentation by Injecting Discourse Dependenciescited by 5
  7. 2022Topic Segmentation in the Wild: Towards Segmentation of Semi-structured & Unstructured Chatscited by 5
  8. 2025Chunk Twice, Embed Once: A Systematic Study of Segmentation and Representation Trade-offs in Chemistry-Aware Retrieval-Augmented Generationcited by 5
  9. 2026Towards Multi-Level Transcript Segmentation: LoRA Fine-Tuning for Table-of-Contents Generationcited by 4
  10. 2023Document Summarization with Text Segmentationcited by 3
  11. 2023Unsupervised Dialogue Topic Segmentation in Hyperdimensional Spacecited by 3
  12. 2024Unsupervised Mutual Learning of Discourse Parsing and Topic Segmentation in Dialoguecited by 3
18 more
  1. 2024TocBERT: Medical Document Structure Extraction Using Bidirectional Transformerscited by 3
  2. 2024A Novel LLM-based Two-stage Summarization Approach for Long Dialoguescited by 3
  3. 2022PREME: Preference-based Meeting Exploration through an Interactive Questionnairecited by 2
  4. 2023Action-Item-Driven Summarization of Long Meeting Transcriptscited by 2
  5. 2023Topic Segmentation of Semi-Structured and Unstructured Conversational Datasets using Language Modelscited by 1
  6. 2024Multimodal Fusion and Coherence Modeling for Video Topic Segmentationcited by 1
  7. 2026Reading Between the Waves: Robust Topic Segmentation Using Inter-Sentence Audio Featurescited by 1
  8. 2023Unsupervised Scientific Abstract Segmentation with Normalized Mutual Informationcited by 0
  9. 2023GPT-Calls: Enhancing Call Segmentation and Tagging by Generating Synthetic Conversations via Large Language Modelscited by 0
  10. 2023Grounded Complex Task Segmentation for Conversational Assistantscited by 0
  11. 2025Semantic Source Code Segmentation using Small and Large Language Modelscited by 0
  12. 2025Consistent Kernel Change-Point Detection under m-Dependence for Text Segmentationcited by 0
  13. 2026SegNSP: Revisiting Next Sentence Prediction for Linear Text Segmentationcited by 0
  14. 2026Unsupervised Text Segmentation via Kernel Change-Point Detection on Sentence Embeddingscited by 0
  15. 2026Rethinking Meeting Effectiveness: A Benchmark and Framework for Temporal Fine-grained Automatic Meeting Effectiveness Evaluationcited by 0
  16. 2026CobSeg: Coherence Boundary Modeling for Dialogue Topic Segmentationcited by 0
  17. 2026Dialogue Summarization with Emotion Dynamics Using Topic- and Participant-Centric Decompositioncited by 0
  18. 2026Zero-Shot Cue-Grounded Topic Segmentation of Spoken Documentscited by 0