mlsanityData to 14 Oct 2026

InternVideo-Ego4D: A Pack of Champion Solutions to Ego4D Challenges

arXiv 2211.09529 ↗First posted 17 Nov 2022cs.CVcited by 48

Not on the map. Why?

Abstract (arXiv)

In this report, we present our champion solutions to five tracks at Ego4D challenge. We leverage our developed InternVideo, a video foundation model, for five Ego4D tasks, including Moment Queries, Natural Language Queries, Future Hand Prediction, State Change Object Detection, and Short-term Object Interaction Anticipation. InternVideo-Ego4D is an effective paradigm to adapt the strong foundation model to the downstream ego-centric video understanding tasks with simple head designs. In these five tasks, the performance of InternVideo-Ego4D comprehensively surpasses the baseline methods and the champions of CVPR2022, demonstrating the powerful representation ability of InternVideo as a video foundation model. Our code will be released at https://github.com/OpenGVLab/ego4d-eccv2022-solutions

Key facts. Cited by 48 papers in the map (data through 14 Oct 2026). Builds on 52 of its 60 references that are in the map. First posted on arXiv 17 Nov 2022.

Builds on

52 of 60 references.

References · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  5. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  6. 2020End-to-End Object Detection with Transformerscited by 7,414
  7. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
  8. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
  9. 2015Fast R-CNNcited by 2,933
  10. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  11. 2017The Kinetics Human Action Video Datasetcited by 1,909
  12. 2018SlowFast Networks for Video Recognitioncited by 1,867
38 more
  1. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,620
  2. 2021ViViT: A Video Vision Transformercited by 1,620
  3. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  4. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
  5. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
  6. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  7. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,143
  8. 2021Video Swin Transformercited by 1,091
  9. 2021Multiscale Vision Transformerscited by 897
  10. 2017Localizing Moments in Video with Natural Languagecited by 663
  11. 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
  12. 2020X3D: Expanding Architectures for Efficient Video Recognitioncited by 637
  13. 2017TALL: Temporal Activity Localization via Language Querycited by 584
  14. 2022Vision Transformer Adapter for Dense Predictionscited by 565
  15. 2017Deep Layer Aggregationcited by 436
  16. 2017Learning Spatio-Temporal Representation with Pseudo-3D Residual Networkscited by 387
  17. 2019BMN: Boundary-Matching Network for Temporal Action Proposal Generationcited by 329
  18. 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 311
  19. 2019Video Classification with Channel-Separated Convolutional Networkscited by 290
  20. 2021Video Transformer Networkcited by 272
  21. 2018BSN: Boundary Sensitive Network for Temporal Action Proposal Generationcited by 271
  22. 2020Span-based Localizing Network for Natural Language Video Localizationcited by 235
  23. 2022Egocentric Video-Language Pretrainingcited by 232
  24. 2021Keeping Your Eye on the Ball: Trajectory Attention in Video Transformerscited by 224
  25. 2022UniFormer: Unifying Convolution and Self-attention for Visual Recognitioncited by 206
  26. 2021Learning Salient Boundary Feature for Anchor-free Temporal Action Localizationcited by 156
  27. 2020TAM: Temporal Adaptive Module for Video Recognitioncited by 139
  28. 2021MoViNets: Mobile Video Networks for Efficient Video Recognitioncited by 135
  29. 2019Large-scale weakly-supervised pre-training for video action recognitioncited by 130
  30. 2021VidTr: Video Transformer Without Convolutionscited by 112
  31. 2020Video Self-Stitching Graph Network for Temporal Action Localizationcited by 104
  32. 2020Actor-Context-Actor Relation Network for Spatio-Temporal Action Localizationcited by 91
  33. 2021Negative Sample Matters: A Renaissance of Metric Learning for Temporal Groundingcited by 90
  34. 2021Space-time Mixing Attention for Video Transformercited by 84
  35. 2022AdaMixer: A Fast-Converging Query-Based Object Detectorcited by 79
  36. 2020Asynchronous Interaction Aggregation for Action Detectioncited by 65
  37. 2020BSN++: Complementary Boundary Regressor with Scale-Balanced Relation Modeling for Temporal Action Proposal Generationcited by 65
  38. 2022An Empirical Study of End-to-End Temporal Action Detectioncited by 40

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 24; 2024: 11; 2025: 9; 2026: 2.

48 papers.

Sort:

By area:

  1. 2023VideoChat: Chat-Centric Video Understandingcited by 857
  2. 2023InternVid: A Large-scale Video-Text Dataset for Multimodal Understanding and Generationcited by 497
  3. 2022InternVideo: General Video Foundation Models via Generative and Discriminative Learningcited by 447
  4. 2023VideoLLM: Modeling Video Sequence with Large Language Modelscited by 116
  5. 2023InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Languagecited by 96
  6. 2023Grounded Question-Answering in Long Egocentric Videoscited by 64
  7. 2023LifelongMemory: Leveraging LLMs for Answering Queries in Long-form Egocentric Videoscited by 51
  8. 2023End-to-End Temporal Action Detection with 1B Parameters Across 1000 Framescited by 47
  9. 2023NaQ: Leveraging Narrations as Queries to Supervise Episodic Memorycited by 46
  10. 2024Retrieval-Augmented Egocentric Video Captioningcited by 42
  11. 2023Memory-and-Anticipation Transformer for Online Action Understandingcited by 39
  12. 2023PALM: Predicting Actions through Language Modelscited by 29
36 more
  1. 2023Pretrained Language Models as Visual Planners for Human Assistancecited by 28
  2. 2023Action Sensitivity Learning for Temporal Action Localizationcited by 28
  3. 2023StillFast: An End-to-End Approach for Short-Term Object Interaction Anticipationcited by 23
  4. 2023Summarize the Past to Predict the Future: Natural Language Descriptions of Context Boost Multimodal Object Interaction Anticipationcited by 21
  5. 2023GroundNLQ @ Ego4D Natural Language Queries Challenge 2023cited by 20
  6. 2022Re^2TAL: Rewiring Pretrained Video Backbones for Reversible Temporal Action Localizationcited by 19
  7. 2024Vinci: A Real-time Embodied Smart Assistant based on Egocentric Vision-Language Modelcited by 19
  8. 2023SpotEM: Efficient Video Search for Episodic Memorycited by 17
  9. 2024UniMD: Towards Unifying Moment Retrieval and Temporal Action Detectioncited by 16
  10. 2025EgoThinker: Unveiling Egocentric Reasoning with Spatio-Temporal CoTcited by 16
  11. 2024AFF-ttention! Affordances and Attention models for Short-Term Object Interaction Anticipationcited by 14
  12. 2023ENIGMA-51: Towards a Fine-Grained Understanding of Human-Object Interactions in Industrial Scenarioscited by 11
  13. 2024Online Episodic Memory Visual Query Localization with Egocentric Streaming Object Memorycited by 11
  14. 2025Object-Shot Enhanced Grounding Network for Egocentric Videocited by 11
  15. 2023Boundary-Denoising for Video Activity Localizationcited by 10
  16. 2024ObjectNLQ @ Ego4D Episodic Memory Challenge 2024cited by 10
  17. 2025OpenTAD: A Unified Framework and Comprehensive Study of Temporal Action Detectioncited by 10
  18. 2023Graph Propagation Transformer for Graph Representation Learningcited by 9
  19. 2023Localizing Active Objects from Egocentric Vision with Symbolic World Knowledgecited by 8
  20. 2024Harnessing Temporal Causality for Advanced Temporal Action Detectioncited by 8
  21. 2025An Egocentric Vision-Language Model based Portable Real-time Smart Assistantcited by 8
  22. 2025Bridging Perspectives: A Survey on Cross-view Collaborative Intelligence with Egocentric-Exocentric Visioncited by 8
  23. 2023Action Sensitivity Learning for the Ego4D Episodic Memory Challenge 2023cited by 7
  24. 2023MINOTAUR: Multi-task Video Grounding From Multimodal Queriescited by 6
  25. 2025OSGNet @ Ego4D Episodic Memory Challenge 2025cited by 6
  26. 2025Building Egocentric Procedural AI Assistant: Methods, Benchmarks, and Challengescited by 5
  27. 2024QueryMamba: A Mamba-Based Encoder-Decoder Architecture with a Statistical Verb-Noun Interaction Module for Video Action Forecasting @ Ego4D Long-Term Action Anticipation Challenge 2024cited by 4
  28. 2023Champion Solution for the WSDM2023 Toloka VQA Challengecited by 3
  29. 2023NMS Threshold matters for Ego4D Moment Queries -- 2nd place solution to the Ego4D Moment Queries Challenge 2023cited by 3
  30. 2025iFinder: Structured Zero-Shot Vision-Based LLM Grounding for Dash-Cam Video Reasoningcited by 3
  31. 2024Anticipating Object State Changes in Long Procedural Videoscited by 2
  32. 2024Infusing Environmental Captions for Long-Form Video Language Groundingcited by 1
  33. 2026Integrating Affordances and Attention models for Short-Term Object Interaction Anticipationcited by 1
  34. 2024ZARRIO @ Ego4D Short Term Object Interaction Anticipation Challenge: Leveraging Affordances and Attention-based models for STAcited by 0
  35. 2025GazeNLQ @ Ego4D Natural Language Queries Challenge 2025cited by 0
  36. 2026CE4L: Continual Ego, Exo, and Ego-Exo Learningcited by 0