mlsanityData to 7 Oct 2026

Weakly Supervised Action Labeling in Videos Under Ordering Constraints

arXiv 1407.1208 ↗First posted 4 Jul 2014cs.CV cs.LGcited by 48

Not on the map. Why?

Abstract (arXiv)

We are given a set of video clips, each one annotated with an em ordered list of actions, such as "walk" then "sit" then "answer phone" extracted from, for example, the associated text script. We seek to temporally localize the individual actions in each clip as well as to learn a discriminative classifier for each action. We formulate the problem as a weakly supervised temporal assignment with ordering constraints. Each video clip is divided into small time intervals and each time interval of each video clip is assigned one action label, while respecting the order in which the action labels appear in the given annotations. We show that the action label assignment can be determined together with learning a classifier for each action in a discriminative manner. We evaluate the proposed model on a new and challenging dataset of 937 video clips with a total of 787720 frames containing sequences of 16 different actions from 69 Hollywood movies.

Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 4 Jul 2014.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 16; 2022: 14; 2023: 8; 2024: 4; 2025: 3; 2026: 3.

48 papers.

Sort:

  1. 2022Temporal Action Segmentation: An Analysis of Modern Techniquescited by 85
  2. 2022Temporal Alignment Networks for Long-term Videocited by 84
  3. 2022DexVIP: Learning Dexterous Grasping with Human Hand Pose Priors from Videocited by 83
  4. 2022My View is the Best View: Procedure Learning from Egocentric Videoscited by 81
  5. 2021Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videoscited by 62
  6. 2021Temporally-Weighted Hierarchical Clustering for Unsupervised Action Segmentationcited by 58
  7. 2022Unified Fully and Timestamp Supervised Temporal Action Segmentation via Sequence to Sequence Translationcited by 55
  8. 2021Temporal Action Segmentation from Timestamp Supervisioncited by 48
  9. 2023CaptainCook4D: A Dataset for Understanding Errors in Procedural Activitiescited by 47
  10. 2023Learning Procedure-aware Video Representation from Instructional Videos and Their Narrationscited by 46
  11. 2022Look for the Change: Learning Object States and State-Modifying Actions from Untrimmed Web Videoscited by 39
  12. 2022TL;DW? Summarizing Instructional Videos with Task Relevance & Cross-Modal Saliencycited by 35
36 more
  1. 2021Action Shuffle Alternating Learning for Unsupervised Action Segmentationcited by 33
  2. 2022Fine-grained Temporal Contrastive Learning for Weakly-supervised Temporal Action Localizationcited by 33
  3. 2021Deep Learning-based Action Detection in Untrimmed Videos: A Surveycited by 32
  4. 2023Learning to Ground Instructional Articles in Videos through Narrationscited by 28
  5. 2021Foreground-Action Consistency Network for Weakly Supervised Temporal Action Localizationcited by 26
  6. 2021Learning Discriminative Prototypes with Dynamic Time Warpingcited by 23
  7. 2022Weakly-supervised segmentation of referring expressionscited by 21
  8. 2021FIFA: Fast Inference Approximation for Action Segmentationcited by 16
  9. 2021Temporal Action Segmentation with High-level Complex Activity Labelscited by 16
  10. 2021SVIP: Sequence VerIfication for Procedures in Videoscited by 16
  11. 2021SSCAP: Self-supervised Co-occurrence Action Parsing for Unsupervised Temporal Action Segmentationcited by 15
  12. 2022Less is More: Surgical Phase Recognition from Timestamp Supervisioncited by 13
  13. 2023United We Stand, Divided We Fall: UnityGraph for Unsupervised Procedure Learning from Videoscited by 13
  14. 2024Efficient and Effective Weakly-Supervised Action Segmentation via Action-Transition-Aware Boundary Alignmentcited by 13
  15. 2024Causal Temporal Representation Learning with Nonstationary Sparse Transitioncited by 12
  16. 2025Bridging Sign and Spoken Languages: Pseudo Gloss Generation for Sign Language Translationcited by 12
  17. 2023Timestamp-supervised Wearable-based Activity Segmentation and Recognition with Contrastive Learning and Order-Preserving Optimal Transportcited by 10
  18. 2023Multi-Sentence Grounding for Long-term Instructional Videocited by 10
  19. 2024Enhancing Temporal Modeling of Video LLMs via Time Gatingcited by 10
  20. 2021Anchor-Constrained Viterbi for Set-Supervised Action Segmentationcited by 8
  21. 2021CoSeg: Cognitively Inspired Unsupervised Generic Event Segmentationcited by 7
  22. 2022An Efficient Framework for Few-shot Skeleton-based Temporal Action Segmentationcited by 7
  23. 2022Robust Action Segmentation from Timestamp Supervisioncited by 6
  24. 2023Sarah Frank-Wolfe: Methods for Constrained Optimization with Best Rates and Practical Featurescited by 6
  25. 2021Routing with Self-Attention for Multimodal Capsule Networkscited by 5
  26. 2021ADNet: Temporal Anomaly Detection in Surveillance Videoscited by 4
  27. 2022Transformers in Action: Weakly Supervised Action Segmentationcited by 4
  28. 2026HOI-aware Adaptive Network for Weakly-supervised Action Segmentationcited by 3
  29. 2021Unsupervised Discovery of Actions in Instructional Videoscited by 2
  30. 2023Proposal-based Temporal Action Localization with Point-level Supervisioncited by 2
  31. 2025Pose-Aware Weakly-Supervised Action Segmentationcited by 2
  32. 2026Hierarchical Action Learning for Weakly-Supervised Action Segmentationcited by 1
  33. 2022Distill and Collect for Semi-Supervised Temporal Action Segmentationcited by 0
  34. 2024Unsupervised Work Behavior Pattern Extraction Based on Hierarchical Probabilistic Modelcited by 0
  35. 2025Scalable Unsupervised Segmentation via Random Fourier Feature-based Gaussian Processcited by 0
  36. 2026Deep kernel video approximation for unsupervised action segmentationcited by 0