mlsanityData to 14 Oct 2026

A Survey on Deep Learning Techniques for Action Anticipation

arXiv 2309.17257 ↗First posted 29 Sep 2023cs.CVcited by 11

Not on the map. Why?

Abstract (arXiv)

The ability to anticipate possible future human actions is essential for a wide range of applications, including autonomous driving and human-robot interaction. Consequently, numerous methods have been introduced for action anticipation in recent years, with deep learning-based approaches being particularly popular. In this work, we review the recent advances of action anticipation algorithms with a particular focus on daily-living scenarios. Additionally, we classify these methods according to their primary contributions and summarize them in tabular form, allowing readers to grasp the details at a glance. Furthermore, we delve into the common evaluation metrics and datasets used for action anticipation and provide future directions with systematical discussions.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 164 of its 281 references that are in the map. First posted on arXiv 29 Sep 2023.

Builds on

164 of 281 references.

References · 164

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  7. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  8. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  9. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  10. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  11. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  12. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
38 more
  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  2. 2017Graph Attention Networkscited by 8,923
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
  5. 2017Mask R-CNNcited by 7,277
  6. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2022A ConvNet for the 2020scited by 3,579
  9. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  10. 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
  11. 2015SSD: Single Shot MultiBox Detectorcited by 3,130
  12. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  13. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  14. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  15. 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,367
  16. 2017Non-local Neural Networkscited by 2,293
  17. 2015Variational Inference with Normalizing Flowscited by 2,170
  18. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  19. 2018SlowFast Networks for Video Recognitioncited by 1,867
  20. 2020Rethinking Attention with Performerscited by 1,601
  21. 2016Generative Adversarial Imitation Learningcited by 1,597
  22. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  23. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  24. 2023Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understandingcited by 1,471
  25. 2021MLP-Mixer: An all-MLP Architecture for Visioncited by 1,446
  26. 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,436
  27. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
  28. 2021Perceiver: General Perception with Iterative Attentioncited by 1,104
  29. 2021Video Swin Transformercited by 1,091
  30. 2014Two-Stream Convolutional Networks for Action Recognition in Videoscited by 1,068
  31. 2015ORB-SLAM: a Versatile and Accurate Monocular SLAM Systemcited by 988
  32. 2016Temporal Segment Networks: Towards Good Practices for Deep Action Recognitioncited by 902
  33. 2018TSM: Temporal Shift Module for Efficient Video Understandingcited by 856
  34. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
  35. 2023Large Language Modelscited by 780
  36. 2019Compressive Transformers for Long-Range Sequence Modellingcited by 726
  37. 2017Poincar'e Embeddings for Learning Hierarchical Representationscited by 684
  38. 2020Rescaling Egocentric Visioncited by 540

50 most cited of 164 All 164 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 1; 2024: 4; 2025: 4; 2026: 2.

11 papers.

  1. 2023DiffAnt: Diffusion Models for Action Anticipationcited by 9
  2. 2024Human Action Anticipation: A Surveycited by 9
  3. 2025Action Anticipation from SoccerNet Football Video Broadcastscited by 9
  4. 2024Gated Temporal Diffusion for Stochastic Long-Term Dense Anticipationcited by 6
  5. 2024ActFusion: a Unified Diffusion Model for Action Segmentation and Anticipationcited by 4
  6. 2024Anticipating Object State Changes in Long Procedural Videoscited by 2
  7. 2025MixANT: Observation-dependent Memory Propagation for Stochastic Dense Action Anticipationcited by 1
  8. 2025Seeing is Believing (and Predicting): Context-Aware Multi-Human Behavior Prediction with Vision Language Modelscited by 1
  9. 2026FlowNar: Scalable Streaming Narration for Long-Form Videoscited by 1
  10. 2025Vision-Based Mistake Analysis in Procedural Activities: A Review of Advances and Challengescited by 0
  11. 2026When to Act: Calibrated Confidence for Reliable Human Intention Prediction in Assistive Roboticscited by 0