mlsanityData to 7 Oct 2026

Technical Report for Ego4D Long-Term Action Anticipation Challenge 2025

arXiv 2506.02550 ↗First posted 3 Jun 2025cs.CV cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

In this report, we present a novel three-stage framework developed for the Ego4D Long-Term Action Anticipation (LTA) task. Inspired by recent advances in foundation models, our method consists of three stages: feature extraction, action recognition, and long-term action anticipation. First, visual features are extracted using a high-performance visual encoder. The features are then fed into a Transformer to predict verbs and nouns, with a verb-noun co-occurrence matrix incorporated to enhance recognition accuracy. Finally, the predicted verb-noun pairs are formatted as textual prompts and input into a fine-tuned large language model (LLM) to anticipate future action sequences. Our framework achieves first place in this challenge at CVPR 2025, establishing a new state-of-the-art in long-term action prediction. Our code will be released at https://github.com/CorrineQiu/Ego4D-LTA-Challenge-2025.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 16 of its 24 references that are in the map. First posted on arXiv 3 Jun 2025.

Builds on

16 of 24 references.

References · 16

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  4. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  5. 2022Egocentric Video-Language Pretrainingcited by 231
  6. 2023VideoLLM: Modeling Video Sequence with Large Language Modelscited by 116
  7. 2023AntGPT: Can Large Language Models Help Long-term Action Anticipation from Videos?cited by 79
  8. 2024EgoVideo: Exploring Egocentric Foundation Model and Downstream Adaptationcited by 44
  9. 2023PALM: Predicting Actions through Language Modelscited by 28
  10. 2025Exo2Ego: Exocentric Knowledge Guided MLLM for Egocentric Video Understandingcited by 25
  11. 2023Palm: Predicting Actions through Language Models @ Ego4D Long-Term Action Anticipation Challenge 2023cited by 15
  12. 2025Object-Shot Enhanced Grounding Network for Egocentric Videocited by 11
4 more
  1. 2024ObjectNLQ @ Ego4D Episodic Memory Challenge 2024cited by 10
  2. 2024HCQA @ Ego4D EgoSchema Challenge 2024cited by 9
  3. 2025HCQA-1.5 @ Ego4D EgoSchema Challenge 2025cited by 6
  4. 2024QueryMamba: A Mamba-Based Encoder-Decoder Architecture with a Statistical Verb-Noun Interaction Module for Video Action Forecasting @ Ego4D Long-Term Action Anticipation Challenge 2024cited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 6.

9 papers.

  1. 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Datacited by 28
  2. 2025Intention-Guided Cognitive Reasoning for Egocentric Long-Term Action Anticipationcited by 10
  3. 2025OSGNet @ Ego4D Episodic Memory Challenge 2025cited by 6
  4. 2026VISTA: Technical Report for the Ego4D Short-Term Object Interaction Anticipation at EgoVis 2026cited by 2
  5. 2026JFAA: Technical Report for the EPIC-KITCHENS-100 Action Anticipation Challenge at EgoVis 2026cited by 2
  6. 2026MARS: Technical Report for the CASTLE Challenge at EgoVis 2026cited by 1
  7. 2026TAP-JEPA: Frozen Future-Latent Probing and Two-Stage Score Fusion for EPIC-KITCHENS-100 Action Anticipationcited by 1
  8. 2026FROST-STA: Frozen Dense Features for the Ego4D Short-Term Object Interaction Anticipationcited by 1
  9. 2026Neuro-Symbolic Hierarchical Intention Anticipation in Human Behaviorcited by 0