mlsanityData to 7 Oct 2026

When will you do what? - Anticipating Temporal Occurrences of Activities

arXiv 1804.00892 ↗First posted 3 Apr 2018cs.CVcited by 106

Not on the map. Why?

Abstract (arXiv)

Analyzing human actions in videos has gained increased attention recently. While most works focus on classifying and labeling observed video frames or anticipating the very recent future, making long-term predictions over more than just a few seconds is a task with many practical applications that has not yet been addressed. In this paper, we propose two methods to predict a considerably large amount of future actions and their durations. Both, a CNN and an RNN are trained to learn future video labels based on previously seen content. We show that our methods generate accurate predictions of the future even for long videos with a huge amount of different actions and can even deal with noisy or erroneous input information.

Key facts. Cited by 106 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Apr 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 22; 2022: 22; 2023: 28; 2024: 16; 2025: 11; 2026: 7.

106 papers.

Sort:

By area:

  1. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  2. 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thoughtcited by 276
  3. 2022Egocentric Video-Language Pretrainingcited by 231
  4. 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 221
  5. 2021Anticipative Video Transformercited by 197
  6. 2021Ego-Exo: Transferring Visual Representations from Third-person to First-person Videoscited by 98
  7. 2022Temporal Action Segmentation: An Analysis of Modern Techniquescited by 85
  8. 2023An Outlook into the Future of Egocentric Visioncited by 84
  9. 2023AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?cited by 79
  10. 2023HierVL: Learning Hierarchical Video-Language Embeddingscited by 66
  11. 2022Future Transformer for Long-term Action Anticipationcited by 57
  12. 2021E2(GO)MOTION: Motion Augmented Event Stream for Egocentric Action Recognitioncited by 50
38 more
  1. 2021Learning the Predictability of the Futurecited by 48
  2. 2021Forecasting Action through Contact Representations from First Person Videocited by 46
  3. 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
  4. 2022Anticipative Feature Fusion Transformer for Multi-Modal Action Anticipationcited by 41
  5. 2021Learning to Anticipate Egocentric Actions by Imaginationcited by 40
  6. 2023Egocentric Audio-Visual Object Localizationcited by 40
  7. 2024HRP: Human Affordances for Robotic Pre-Trainingcited by 40
  8. 2021Anticipating human actions by correlating past with the future with Jaccard similarity measurescited by 36
  9. 2021Predicting the Future from First Person (Egocentric) Vision: A Surveycited by 36
  10. 2022Intention-Conditioned Long-Term Human Egocentric Action Forecastingcited by 35
  11. 2023Video-Mined Task Graphs for Keystep Recognition in Instructional Videoscited by 35
  12. 2021Self-Regulated Learning for Egocentric Video Activity Anticipationcited by 32
  13. 2024Can't make an Omelette without Breaking some Eggs: Plausible Action Anticipation using Large Video-Language Modelscited by 32
  14. 2022Visual Abductive Reasoningcited by 30
  15. 2022Rethinking Learning Approaches for Long-Term Action Anticipationcited by 29
  16. 2023Pretrained Language Models as Visual Planners for Human Assistancecited by 28
  17. 2023EgoTracks: A Long-term Egocentric Visual Object Tracking Datasetcited by 27
  18. 2022Weakly-supervised Action Transition Learning for Stochastic Human Motion Predictioncited by 26
  19. 2021Spatio-Temporal Urban Knowledge Graph Enabled Mobility Predictioncited by 24
  20. 2023Object-centric Video Representation for Long-term Action Anticipationcited by 24
  21. 2021A Survey on Human-aware Robot Navigationcited by 23
  22. 2021Multi-Modal Temporal Convolutional Network for Anticipating Actions in Egocentric Videoscited by 23
  23. 2022Learning State-Aware Visual Representations from Audible Interactionscited by 23
  24. 2023Event-Guided Procedure Planning from Instructional Videos with Text Supervisioncited by 21
  25. 2021SlowFast Rolling-Unrolling LSTMs for Action Anticipation in Egocentric Videoscited by 20
  26. 2023HA-ViD: A Human Assembly Video Dataset for Comprehensive Assembly Knowledge Understandingcited by 18
  27. 2023Every Mistake Counts in Assemblycited by 18
  28. 2023Multi-label affordance mapping from egocentric visioncited by 18
  29. 2023SpotEM: Efficient Video Search for Episodic Memorycited by 17
  30. 2024ExpertAF: Expert Actionable Feedback from Videocited by 17
  31. 2022Predicting the Next Action by Modeling the Abstract Goalcited by 14
  32. 2023Action Anticipation with Goal Consistencycited by 12
  33. 2022ProActive: Self-Attentive Temporal Point Process Flows for Activity Sequencescited by 11
  34. 2023A Survey on Deep Learning Techniques for Action Anticipationcited by 11
  35. 2021Transferring Knowledge from Text to Video: Zero-Shot Anticipation for Procedural Actionscited by 10
  36. 2023DiffAnt: Diffusion Models for Action Anticipationcited by 9
  37. 2024Semantically Guided Representation Learning For Action Anticipationcited by 9
  38. 2025Action Anticipation from SoccerNet Football Video Broadcastscited by 9

50 most cited of 106 All 106 (JSON)