mlsanityData to 14 Oct 2026

Unsupervised Discovery of Long-Term Spatiotemporal Periodic Workflows in Human Activities

arXiv 2511.14945 ↗First posted 18 Nov 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Periodic human activities with implicit workflows are common in manufacturing, sports, and daily life. While short-term periodic activities -- characterized by simple structures and high-contrast patterns -- have been widely studied, long-term periodic workflows with low-contrast patterns remain largely underexplored. To bridge this gap, we introduce the first benchmark comprising 580 multimodal human activity sequences featuring long-term periodic workflows. The benchmark supports three evaluation tasks aligned with real-world applications: unsupervised periodic workflow detection, task completion tracking, and procedural anomaly detection. We also propose a lightweight, training-free baseline for modeling diverse periodic workflow patterns. Experiments show that: (i) our benchmark presents significant challenges to both unsupervised periodic detection methods and zero-shot approaches based on powerful large language models (LLMs); (ii) our baseline outperforms competing methods by a substantial margin in all evaluation tasks; and (iii) in real-world applications, our baseline demonstrates deployment advantages on par with traditional supervised workflow detection approaches, eliminating the need for annotation and retraining. Our project page is https://sites.google.com/view/periodicworkflow.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 57 of its 107 references that are in the map. First posted on arXiv 18 Nov 2025.

Builds on

57 of 107 references.

References · 57

  1. 2023GPT-4 Technical Reportcited by 18,396
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  5. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
  6. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  7. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 508
  8. 2021Anomaly Transformer: Time Series Anomaly Detection with Association Discrepancycited by 394
  9. 2019MS-TCN: Multi-Stage Temporal Convolutional Network for Action Segmentationcited by 373
  10. 2019COIN: A Large-scale Dataset for Comprehensive Instructional Video Analysiscited by 318
  11. 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 287
  12. 2023WHAM: Reconstructing World-grounded Humans with Accurate 3D Motioncited by 206
38 more
  1. 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 193
  2. 2021ASFormer: Transformer for Action Segmentationcited by 168
  3. 2024World-Grounded Human Motion Recovery via Gravity-View Coordinatescited by 137
  4. 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 124
  5. 2015Unsupervised Learning from Narrated Instruction Videoscited by 116
  6. 2024TRAM: Global Trajectory and Motion of 3D Humans from in-the-wild Videoscited by 106
  7. 2022Temporal Action Segmentation: An Analysis of Modern Techniquescited by 85
  8. 2017A Survey of Indoor Localization Systems and Technologiescited by 78
  9. 2019Unsupervised learning of action classes with continuous temporal embeddingcited by 76
  10. 2020Counting Out Time: Class Agnostic Video Repetition Counting in the Wildcited by 68
  11. 2018NeuralNetwork-Viterbi: A Framework for Weakly Supervised Video Learningcited by 67
  12. 2025HaWoR: World-Space Hand Motion Reconstruction from Egocentric Videoscited by 66
  13. 2018Unsupervised Learning and Segmentation of Complex Activities from Videocited by 61
  14. 2021Temporally-Weighted Hierarchical Clustering for Unsupervised Action Segmentationcited by 58
  15. 2020TadGAN: Time Series Anomaly Detection Using Generative Adversarial Networkscited by 55
  16. 2022Unified Fully and Timestamp Supervised Temporal Action Segmentation via Sequence to Sequence Translationcited by 55
  17. 2021Unsupervised Action Segmentation by Joint Representation Learning and Online Clusteringcited by 49
  18. 2021Temporal Action Segmentation from Timestamp Supervisioncited by 48
  19. 2022TransRAC: Encoding Multi-scale Temporal Correlation with Transformers for Repetitive Action Countingcited by 44
  20. 2022SimPer: Simple Self-Supervised Learning of Periodic Targetscited by 44
  21. 2025Recent Advances in Discrete Speech Tokens: A Reviewcited by 43
  22. 2024Temporally Consistent Unbalanced Optimal Transport for Unsupervised Action Segmentationcited by 38
  23. 2024LLMs are Good Action Recognizerscited by 37
  24. 2019Fast Weakly Supervised Action Segmentation Using Mutual Consistencycited by 30
  25. 2019Make Skeleton-based Action Recognition Model Smaller, Faster and Bettercited by 22
  26. 2022ClaSP -- Parameter-free Time Series Segmentationcited by 21
  27. 2024Hierarchical Vector Quantization for Unsupervised Action Segmentationcited by 19
  28. 2022Leveraging Action Affinity and Continuity for Semi-supervised Temporal Action Segmentationcited by 17
  29. 2023PoseRAC: Pose Saliency Transformer for Repetitive Action Countingcited by 17
  30. 2022Sintel: A Machine Learning Framework to Extract Insights from Signalscited by 16
  31. 2024Efficient and Effective Weakly-Supervised Action Segmentation via Action-Transition-Aware Boundary Alignmentcited by 13
  32. 2024Repetitive Action Counting with Hybrid Temporal Relation Modelingcited by 13
  33. 2023OTAS: Unsupervised Boundary Detection for Object-Centric Temporal Action Segmentationcited by 11
  34. 2024OVR: A Dataset for Open Vocabulary Temporal Repetition Counting in Videoscited by 10
  35. 2024Every Shot Counts: Using Exemplars for Repetition Counting in Videoscited by 9
  36. 2022AER: Auto-Encoder with Regression for Time Series Anomaly Detectioncited by 8
  37. 2022Robust Time Series Dissimilarity Measure for Outlier Detection and Periodicity Detectioncited by 5
  38. 2023CycleCL: Self-supervised Learning for Periodic Videoscited by 4

50 most cited of 57 All 57 (JSON)

Built on by

Not cited yet.