Video + CLIP Baseline for Ego4D Long-term Action Anticipation
Not on the map. Why?
Abstract (arXiv)
In this report, we introduce our adaptation of image-text models for long-term action anticipation. Our Video + CLIP framework makes use of a large-scale pre-trained paired image-text model: CLIP and a video encoder Slowfast network. The CLIP embedding provides fine-grained understanding of objects relevant for an action whereas the slowfast network is responsible for modeling temporal information within a video clip of few frames. We show that the features obtained from both encoders are complementary to each other, thus outperforming the baseline on Ego4D for the task of long-term action anticipation. Our code is available at github.com/srijandas07/clip_baseline_LTA_Ego4d.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 5 of its 6 references that are in the map. First posted on arXiv 1 Jul 2022.
Builds on
5 of 6 references.
References · 5
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2018SlowFast Networks for Video Recognitioncited by 1,867
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
- 2022A CLIP-Hitchhiker's Guide to Long Video Retrievalcited by 57
Built on by
Citing papers per year: 2022: 2; 2023: 7; 2024: 5; 2025: 4.
18 papers.
Sort:
By area:
- 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 225
- 2023AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?cited by 81
- 2023HierVL: Learning Hierarchical Video-Language Embeddingscited by 66
- 2024VideoLLM-MoD: Efficient Video-Language Streaming with Mixture-of-Depths Vision Computationcited by 55
- 2022Intention-Conditioned Long-Term Human Egocentric Action Forecastingcited by 35
- 2024Can't make an Omelette without Breaking some Eggs: Plausible Action Anticipation using Large Video-Language Modelscited by 33
- 2023PALM: Predicting Actions through Language Modelscited by 29
- 2023Object-centric Video Representation for Long-term Action Anticipationcited by 24
- 2022Egocentric Video Task Translationcited by 19
- 2023Palm: Predicting Actions through Language Models @ Ego4D Long-Term Action Anticipation Challenge 2023cited by 16
- 2025Intention-Guided Cognitive Reasoning for Egocentric Long-Term Action Anticipationcited by 10
- 2024Human Action Anticipation: A Surveycited by 9
6 more
- 2023Technical Report for Ego4D Long Term Action Anticipation Challenge 2023cited by 7
- 2024Gated Temporal Diffusion for Stochastic Long-Term Dense Anticipationcited by 6
- 2025MANTA: Diffusion Mamba for Efficient and Effective Stochastic Long-Term Dense Anticipationcited by 3
- 2023Egocentric Video Task Translation @ Ego4D Challenge 2022cited by 2
- 2025Bidirectional Action Sequence Learning for Long-term Action Anticipation with Large Language Modelscited by 2
- 2025MixANT: Observation-dependent Memory Propagation for Stochastic Dense Action Anticipationcited by 1
- 2025MixANT: Observation-dependent Memory Propagation for Stochastic Dense Action Anticipation14 Sep 2025
- 2025Intention-Guided Cognitive Reasoning for Egocentric Long-Term Action Anticipation3 Aug 2025
- 2025Bidirectional Action Sequence Learning for Long-term Action Anticipation with Large Language Models1 Aug 2025
- 2025MANTA: Diffusion Mamba for Efficient and Effective Stochastic Long-Term Dense Anticipation15 Jan 2025
- 2024Human Action Anticipation: A Survey17 Oct 2024
- 2024VideoLLM-MoD: Efficient Video-Language Streaming with Mixture-of-Depths Vision Computation29 Aug 2024
- 2024Gated Temporal Diffusion for Stochastic Long-Term Dense Anticipation16 Jul 2024
- 2024VideoLLM-online: Online Video Large Language Model for Streaming Video17 Jun 2024
- 2024Can't make an Omelette without Breaking some Eggs: Plausible Action Anticipation using Large Video-Language Models30 May 2024
- 2023PALM: Predicting Actions through Language Models29 Nov 2023
- 2023Object-centric Video Representation for Long-term Action Anticipation31 Oct 2023
- 2023AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?31 Jul 2023
6 more
- 2023Technical Report for Ego4D Long Term Action Anticipation Challenge 20234 Jul 2023
- 2023Palm: Predicting Actions through Language Models @ Ego4D Long-Term Action Anticipation Challenge 202328 Jun 2023
- 2023Egocentric Video Task Translation @ Ego4D Challenge 20223 Feb 2023
- 2023HierVL: Learning Hierarchical Video-Language Embeddings5 Jan 2023
- 2022Egocentric Video Task Translation13 Dec 2022
- 2022Intention-Conditioned Long-Term Human Egocentric Action Forecasting25 Jul 2022
- 2024VideoLLM-online: Online Video Large Language Model for Streaming Videocited by 225
- 2023AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?cited by 81
- 2023HierVL: Learning Hierarchical Video-Language Embeddingscited by 66
- 2022Intention-Conditioned Long-Term Human Egocentric Action Forecastingcited by 35
- 2024Can't make an Omelette without Breaking some Eggs: Plausible Action Anticipation using Large Video-Language Modelscited by 33
- 2023PALM: Predicting Actions through Language Modelscited by 29
- 2023Object-centric Video Representation for Long-term Action Anticipationcited by 24
- 2022Egocentric Video Task Translationcited by 19
- 2023Palm: Predicting Actions through Language Models @ Ego4D Long-Term Action Anticipation Challenge 2023cited by 16
- 2025Intention-Guided Cognitive Reasoning for Egocentric Long-Term Action Anticipationcited by 10
- 2024Human Action Anticipation: A Surveycited by 9
- 2023Technical Report for Ego4D Long Term Action Anticipation Challenge 2023cited by 7
12 most cited of 16 All 16 (JSON)
- 2025MixANT: Observation-dependent Memory Propagation for Stochastic Dense Action Anticipation14 Sep 2025
- 2025Intention-Guided Cognitive Reasoning for Egocentric Long-Term Action Anticipation3 Aug 2025
- 2025Bidirectional Action Sequence Learning for Long-term Action Anticipation with Large Language Models1 Aug 2025
- 2024Human Action Anticipation: A Survey17 Oct 2024
- 2024Gated Temporal Diffusion for Stochastic Long-Term Dense Anticipation16 Jul 2024
- 2024VideoLLM-online: Online Video Large Language Model for Streaming Video17 Jun 2024
- 2024Can't make an Omelette without Breaking some Eggs: Plausible Action Anticipation using Large Video-Language Models30 May 2024
- 2023PALM: Predicting Actions through Language Models29 Nov 2023
- 2023Object-centric Video Representation for Long-term Action Anticipation31 Oct 2023
- 2023AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?31 Jul 2023
- 2023Technical Report for Ego4D Long Term Action Anticipation Challenge 20234 Jul 2023
- 2023Palm: Predicting Actions through Language Models @ Ego4D Long-Term Action Anticipation Challenge 202328 Jun 2023
12 newest of 16 All 16 (JSON)