VISTA: Technical Report for the Ego4D Short-Term Object Interaction Anticipation at EgoVis 2026
Not on the map. Why?
Abstract (arXiv)
We propose VISTA, a V-JEPA Integrated StillFast Temporal Anticipator for the Ego4D Short-Term Object Interaction Anticipation (STA) Challenge at EgoVis 2026. Given an egocentric video timestamp, the task requires anticipating the next human-object interaction, including the future active object's bounding box, noun category, verb category, time-to-contact, and confidence score. VISTA follows a StillFast-style design that combines object-centric spatial detection with short-horizon temporal context. Specifically, a COCO-pretrained Faster R-CNN ResNet-50 FPN detector generates object proposals from the last observed high-resolution frame, while a frozen V-JEPA 2.1 temporal branch extracts clip-level egocentric context from the observed video. The temporal representation is injected into the detection pathway through feature modulation and ROI-level context fusion. The fused proposal features are then passed to multi-head STA predictors for box refinement, noun classification, verb classification, time-to-contact regression, and interaction confidence estimation. For the final submission, we further ensemble complementary predictions to improve robustness. Experimental results on the official challenge server show that VISTA achieves first place in the EgoVis 2026 Ego4D STA Challenge. Our code will be released at https://github.com/CorrineQiu/VISTA.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 16 of its 19 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
16 of 19 references.
References · 16
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2016Feature Pyramid Networks for Object Detectioncited by 5,021
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2018SlowFast Networks for Video Recognitioncited by 1,862
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2026V-JEPA 2.1: Unlocking Dense Features in Video Self-Supervised Learningcited by 104
- 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Datacited by 28
- 2025Exo2Ego: Exocentric Knowledge Guided MLLM for Egocentric Video Understandingcited by 25
- 2023StillFast: An End-to-End Approach for Short-Term Object Interaction Anticipationcited by 23
4 more
Built on by
Citing papers per year: 2026: 2.
2 papers.