EgoAdapt: A Multi-Scene Egocentric Adaptation Method for CVPR 2026 HD-EPIC VQA Challenge
Not on the map. Why?
Abstract (arXiv)
This technical report presents our solution, EgoAdapt (Egocentric Adaptation via Category, Calibration, and Consistency), to the CVPR 2026 HD-EPIC VQA challenge. HD-EPIC evaluates whether a vision-language model can reason over realistic first-person kitchen videos, where the evidence for an answer may be a short hand-object interaction, a long recipe trajectory, a spatial relation to a fixture, or a subtle gaze cue. The benchmark contains 26K multiple-choice questions across seven macro-categories: recipe, ingredient, nutrition, fine-grained action, 3D perception, object motion, and gaze. We observe that the main difficulty is not only model capacity, but also the mismatch between a single generic inference recipe and the heterogeneous temporal, spatial, and semantic structure of the benchmark. Our method, EgoAdapt, introduces three inference-time components: (1) category-conditioned routing with per-category prompts, frame budgets, and sampling rates; (2) calibrated option scoring that evaluates all candidate answers with letter-token likelihoods and generation agreement instead of relying only on direct generation; and (3) test-time consistency adaptation that aggregates predictions across option permutations and verification-style prompts for ambiguous cases. This design substantially improves over the available HD-EPIC baselines.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 19 of its 30 references that are in the map. First posted on arXiv 23 May 2026.
Builds on
19 of 30 references.
References · 19
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,109
- 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
- 2024Long Context Transfer from Language to Visioncited by 515
- 2025HD-EPIC: A Highly-Detailed Egocentric Video Datasetcited by 104
- 2025FineCIR: Explicit Parsing of Fine-Grained Modification Semantics for Composed Image Retrievalcited by 42
- 2021Video Contrastive Learning with Global Contextcited by 41
- 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrievalcited by 41
- 2025OFFSET: Segmentation-based Focus Shift Revision for Composed Image Retrievalcited by 40
- 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrievalcited by 32
- 2026STABLE: Efficient Hybrid Nearest Neighbor Search via Magnitude-Uniformity and Cardinality-Robustnesscited by 26
7 more
- 2026INTENT: Invariance and Discrimination-aware Noise Mitigation for Robust Composed Image Retrievalcited by 26
- 2026HABIT: Chrono-Synergia Robust Progressive Learning Framework for Composed Image Retrievalcited by 24
- 2026Air-Know: Arbiter-Calibrated Knowledge-Internalizing Robust Network for Composed Image Retrievalcited by 18
- 2026MELT: Improve Composed Image Retrieval via the Modification Frequentation-Rarity Balance Networkcited by 17
- 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrievalcited by 17
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrievalcited by 15
- 2026CoVR-R:Reason-Aware Composed Video Retrievalcited by 8
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relationscited by 11
- 2026Rethinking Layer-Wise Information Allocation for Vision Foundation Model Adaptationcited by 7
- 2026R^3: Composed Video Retrieval via Reasoning-Guided Recalling and Re-rankingcited by 5
- 2026IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrievalcited by 1
- 2026LightAIR: Lightweight Action Inversion and Riemannian Rectification for Text-based Person Anomaly Searchcited by 0
- 2026Never Look Back: Understanding Persistence in 3D Object Memory from Egocentric Videoscited by 0
- 2026MemReg: Streaming Outdoor LiDAR Point Cloud Registration with Hybrid Memory Bufferscited by 0
- 2026MemReg: Streaming Outdoor LiDAR Point Cloud Registration with Hybrid Memory Buffers8 Oct 2026
- 2026Never Look Back: Understanding Persistence in 3D Object Memory from Egocentric Videos7 Oct 2026
- 2026LightAIR: Lightweight Action Inversion and Riemannian Rectification for Text-based Person Anomaly Search10 Aug 2026
- 2026Rethinking Layer-Wise Information Allocation for Vision Foundation Model Adaptation24 Jul 2026
- 2026IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrieval6 Jun 2026
- 2026COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations3 Jun 2026
- 2026R^3: Composed Video Retrieval via Reasoning-Guided Recalling and Re-ranking31 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026The Right Inference Strategy Is All You Need: Nearly Training-Free Domain-Wise Inference for EgoCross Challenge
- 2026EgoExo-Next:Benchmarking Vision-Language Models on Visual-Option Next-State and Cross-View Reasoning
- 2026EgoSAT: A Comprehensive Benchmark of Egocentric Streaming Interaction Understanding
- 2025EgoCross: Benchmarking Multimodal Large Language Models for Cross-Domain Egocentric Video Question Answering
- 2026Minerva-Ego: Spatiotemporal Hints for Egocentric Video Understanding
- 2023EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Language Models
- 2026EgoCoT-Bench: Benchmarking Grounded and Verifiable Operation-Centric Chain of Thought Reasoning for MLLMs
- 2026OmniEgo-R2: A Routed Reasoning Framework for the 1st Cross-Domain EgoCross Challenge at CVPR 2026