OSGNet with MLLM Reranking @ Ego4D Episodic Memory Challenge 2026
Not on the map. Why?
Abstract (arXiv)
In this report, we present our champion solutions for the Natural Language Queries and GoalStep tracks of the Ego4D Episodic Memory Challenge at CVPR 2026. Both tracks require accurately localizing temporal segments from long untrimmed egocentric videos. To address these tasks, we propose a reranking-based framework that effectively leverages the strong video-language reasoning capability of multimodal large language model (MLLM) while preserving the efficiency and candidate recall of conventional localization pipelines. Specifically, we first obtain a set of candidate segments from existing localization model OSGNet, and then employ MLLM to select the segment that best matches the given query, thereby refining the final prediction. Ultimately, our method achieved first place in both the Natural Language Queries and GoalStep tracks. Our code can be found at https://github.com/iLearn-Lab/CVPR25-OSGNet.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 9 of its 15 references that are in the map. First posted on arXiv 20 May 2026.
Builds on
9 of 15 references.
References · 9
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 138
- 2025Spatial Understanding from Videos: Structured Prompts Meet Simulation Datacited by 28
- 2025Universal Video Temporal Grounding with Generative Multi-modal Large Language Modelscited by 26
- 2025Exo2Ego: Exocentric Knowledge Guided MLLM for Egocentric Video Understandingcited by 25
- 2023GroundNLQ @ Ego4D Natural Language Queries Challenge 2023cited by 20
- 2025Object-Shot Enhanced Grounding Network for Egocentric Videocited by 11
- 2024ObjectNLQ @ Ego4D Episodic Memory Challenge 2024cited by 10
- 2025OSGNet @ Ego4D Episodic Memory Challenge 2025cited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Detector-Empowered Video Large Language Model for Efficient Spatio-Temporal Grounding
- 2024Weakly Supervised Temporal Action Localization via Dual-Prior Collaborative Learning Guided by Multimodal Large Language Models
- 2024MLLM as Video Narrator: Mitigating Modality Imbalance in Video Moment Retrieval
- 2025EgoCross: Benchmarking Multimodal Large Language Models for Cross-Domain Egocentric Video Question Answering
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modeling
- 2026MLLMs Know When Before Speaking: Revealing and Recovering Temporal Grounding via Attention Cues
- 2026SONIC-O1: A Real-World Benchmark for Evaluating Multimodal Large Language Models on Audio-Video Understanding
- 2026FindIt: A Format-Informed Visual Detection Benchmark for Generalist Multimodal LLMs