mlsanityData to 7 Oct 2026

NeuralNetwork-Viterbi: A Framework for Weakly Supervised Video Learning

arXiv 1805.06875 ↗First posted 17 May 2018cs.CVcited by 67

Not on the map. Why?

Abstract (arXiv)

Video learning is an important task in computer vision and has experienced increasing interest over the recent years. Since even a small amount of videos easily comprises several million frames, methods that do not rely on a frame-level annotation are of special importance. In this work, we propose a novel learning algorithm with a Viterbi-based loss that allows for online and incremental learning of weakly annotated video data. We moreover show that explicit context and length modeling leads to huge improvements in video segmentation and labeling tasks andinclude these models into our framework. On several action segmentation benchmarks, we obtain an improvement of up to 10% compared to current state-of-the-art methods.

Key facts. Cited by 67 papers in the map (data through 7 Oct 2026). First posted on arXiv 17 May 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 22; 2022: 16; 2023: 11; 2024: 6; 2025: 7; 2026: 5.

67 papers.

Sort:

By area:

  1. 2021VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understandingcited by 596
  2. 2021VLM: Task-agnostic Video-Language Model Pre-training for Video Understandingcited by 102
  3. 2021TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignmentcited by 102
  4. 2022Temporal Action Segmentation: An Analysis of Modern Techniquescited by 85
  5. 2022Temporal Alignment Networks for Long-term Videocited by 84
  6. 2022My View is the Best View: Procedure Learning from Egocentric Videoscited by 81
  7. 2021Temporally-Weighted Hierarchical Clustering for Unsupervised Action Segmentationcited by 58
  8. 2022Unified Fully and Timestamp Supervised Temporal Action Segmentation via Sequence to Sequence Translationcited by 55
  9. 2022P3IV: Probabilistic Procedure Planning from Instructional Videos with Weak Supervisioncited by 52
  10. 2021Temporal Action Segmentation from Timestamp Supervisioncited by 48
  11. 2021Unsupervised Action Segmentation by Joint Representation Learning and Online Clusteringcited by 48
  12. 2021Drop-DTW: Aligning Common Signal Between Sequences While Dropping Outlierscited by 39
38 more
  1. 2023StepFormer: Self-supervised Step Discovery and Localization in Instructional Videoscited by 37
  2. 2021Action Shuffle Alternating Learning for Unsupervised Action Segmentationcited by 33
  3. 2023Learning to Ground Instructional Articles in Videos through Narrationscited by 28
  4. 2021Unsupervised Discriminative Embedding for Sub-Action Learning in Complex Activitiescited by 26
  5. 2024SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videoscited by 24
  6. 2021Learning Discriminative Prototypes with Dynamic Time Warpingcited by 23
  7. 2022C2F-TCN: A Framework for Semi and Fully Supervised Temporal Action Segmentationcited by 23
  8. 2021Iterative Contrast-Classify For Semi-supervised Temporal Action Segmentationcited by 19
  9. 2022Timestamp-Supervised Action Segmentation with Graph Convolutional Networkscited by 18
  10. 2024Hierarchical Vector Quantization for Unsupervised Action Segmentationcited by 18
  11. 2023Permutation-Aware Action Segmentation via Unsupervised Frame-to-Segment Alignmentcited by 17
  12. 2021FIFA: Fast Inference Approximation for Action Segmentationcited by 16
  13. 2021Temporal Action Segmentation with High-level Complex Activity Labelscited by 16
  14. 2021SSCAP: Self-supervised Co-occurrence Action Parsing for Unsupervised Temporal Action Segmentationcited by 15
  15. 2023LASER: A Neuro-Symbolic Framework for Learning Spatial-Temporal Scene Graphs with Weak Supervisioncited by 13
  16. 2023United We Stand, Divided We Fall: UnityGraph for Unsupervised Procedure Learning from Videoscited by 13
  17. 2024Efficient and Effective Weakly-Supervised Action Segmentation via Action-Transition-Aware Boundary Alignmentcited by 13
  18. 2022Weakly-Supervised Online Action Segmentation in Multi-View Instructional Videoscited by 12
  19. 2024Causal Temporal Representation Learning with Nonstationary Sparse Transitioncited by 12
  20. 2021Hierarchical Modeling for Task Recognition and Action Segmentation in Weakly-Labeled Instructional Videoscited by 11
  21. 2023OTAS: Unsupervised Boundary Detection for Object-Centric Temporal Action Segmentationcited by 11
  22. 2022Multi-Task Learning of Object State Changes from Uncurated Videoscited by 10
  23. 2023Leveraging triplet loss for unsupervised action segmentationcited by 10
  24. 2023Timestamp-supervised Wearable-based Activity Segmentation and Recognition with Contrastive Learning and Order-Preserving Optimal Transportcited by 10
  25. 2024Efficient Temporal Action Segmentation via Boundary-aware Query Votingcited by 10
  26. 2021Anchor-Constrained Viterbi for Set-Supervised Action Segmentationcited by 8
  27. 2023Activity Grammars for Temporal Action Segmentationcited by 8
  28. 2021Weakly Supervised Temporal Anomaly Segmentation with Dynamic Time Warpingcited by 7
  29. 2021CoSeg: Cognitively Inspired Unsupervised Generic Event Segmentationcited by 7
  30. 2024OnlineTAS: An Online Baseline for Temporal Action Segmentationcited by 7
  31. 2025HiERO: understanding the hierarchy of human behavior enhances reasoning on egocentric videoscited by 7
  32. 2022Robust Action Segmentation from Timestamp Supervisioncited by 6
  33. 2025Building Egocentric Procedural AI Assistant: Methods, Benchmarks, and Challengescited by 5
  34. 2021Unsupervised Action Segmentation for Instructional Videoscited by 4
  35. 2022Transformers in Action: Weakly Supervised Action Segmentationcited by 4
  36. 2022Graph2Vid: Flow graph to Video Grounding for Weakly-supervised Multi-Step Localizationcited by 4
  37. 2022Timestamp-Supervised Action Segmentation from the Perspective of Clusteringcited by 4
  38. 2026HOI-aware Adaptive Network for Weakly-supervised Action Segmentationcited by 3

50 most cited of 67 All 67 (JSON)