mlsanityData to 7 Oct 2026

LiveSeg: Unsupervised Multimodal Temporal Segmentation of Long Livestream Videos

arXiv 2210.05840 ↗First posted 12 Oct 2022cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Livestream videos have become a significant part of online learning, where design, digital marketing, creative painting, and other skills are taught by experienced experts in the sessions, making them valuable materials. However, Livestream tutorial videos are usually hours long, recorded, and uploaded to the Internet directly after the live sessions, making it hard for other people to catch up quickly. An outline will be a beneficial solution, which requires the video to be temporally segmented according to topics. In this work, we introduced a large Livestream video dataset named MultiLive, and formulated the temporal segmentation of the long Livestream videos (TSLLV) task. We propose LiveSeg, an unsupervised Livestream video temporal Segmentation solution, which takes advantage of multimodal features from different domains. Our method achieved a 16.8% F1-score performance improvement compared with the state-of-the-art method.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 39 of its 93 references that are in the map. First posted on arXiv 12 Oct 2022.

Builds on

39 of 93 references.

References · 39

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  4. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  5. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  6. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  7. 2020MiniLM: Deep Self-Attention Distillation for Task-Agnostic Compression of Pre-Trained Transformerscited by 1,414
  8. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,224
  9. 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 899
  10. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 504
  11. 2017Temporal Segment Networks for Action Recognition in Videoscited by 279
  12. 2017Temporal Action Detection with Structured Segment Networkscited by 265
27 more
  1. 2020TransNet V2: An effective deep network architecture for fast shot transition detectioncited by 166
  2. 2016Video Summarization with Long Short-term Memorycited by 142
  3. 2020Graph Optimal Transport for Cross-Domain Alignmentcited by 103
  4. 2020A Local-to-Global Approach to Multi-modal Movie Scene Segmentationcited by 60
  5. 2021Temporally-Weighted Hierarchical Clustering for Unsupervised Action Segmentationcited by 58
  6. 2017The Microsoft 2017 Conversational Speech Recognition Systemcited by 51
  7. 2021UFO: A UniFied TransfOrmer for Vision-Language Representation Learningcited by 45
  8. 2020CO-Optimal Transportcited by 42
  9. 2018A Perceptual Prediction Framework for Self Supervised Event Segmentationcited by 40
  10. 2019Hierarchical Optimal Transport for Multimodal Distribution Alignmentcited by 38
  11. 2019Aligning Visual Regions and Textual Concepts for Semantic-Grounded Image Representationscited by 36
  12. 2019A Hybrid RNN-HMM Approach for Weakly Supervised Temporal Action Segmentationcited by 36
  13. 2021Shot Contrastive Self-Supervised Learning for Scene Boundary Detectioncited by 35
  14. 2016To Click or Not To Click: Automatic Selection of Beautiful Thumbnails from Videoscited by 33
  15. 2019Improving Sequence-to-Sequence Learning via Optimal Transportcited by 33
  16. 2019Naver at ActivityNet Challenge 2019 -- Task B Active Speaker Detection (AVA)cited by 26
  17. 2020Learning to Segment Actions from Observation and Narrationcited by 21
  18. 2020Making transport more robust and interpretable by moving data through a small number of anchor pointscited by 18
  19. 2018Fast Video Shot Transition Localization with Deep Structured Modelscited by 16
  20. 2017Large-scale, Fast and Accurate Shot Boundary Detection through Spatio-temporal Convolutional Neural Networkscited by 12
  21. 2019Canonical Correlation Analysis (CCA) Based Multi-View Learning: An Overviewcited by 10
  22. 2019Multimodal Emotion Recognition Using Deep Canonical Correlation Analysiscited by 10
  23. 2021Unsupervised Video Summarization via Multi-source Featurescited by 7
  24. 2022Semantics-Consistent Cross-domain Summarization via Optimal Transport Alignmentcited by 6
  25. 2020Weakly supervised cross-domain alignment with optimal transportcited by 5
  26. 2018Superframes, A Temporal Video Segmentationcited by 4
  27. 2018Energy Efficiency and Emission Testing for Connected and Automated Vehicles Using Real-World Driving Datacited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 3; 2024: 1; 2025: 1; 2026: 1.

6 papers.

  1. 2023Align and Attend: Multimodal Summarization with Dual Contrastive Lossescited by 65
  2. 2023Transfer Knowledge from Natural Language to Electrocardiography: Can We Detect Cardiovascular Disease Through Language Models?cited by 21
  3. 2023MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videoscited by 12
  4. 2025HierSum: A Global and Local Attention Mechanism for Video Summarizationcited by 3
  5. 2024Multimodal Fusion and Coherence Modeling for Video Topic Segmentationcited by 1
  6. 2026VPD-100K: Towards Generalizable and Fine-grained Visual Privacy Protectioncited by 0