EgoAction: Egocentric Action Composition with Reliability-Aware Temporal Fusion for the EPIC-KITCHENS Action Detection Challenge at CVPR 2026
Not on the map. Why?
Abstract (arXiv)
The EPIC-KITCHENS-100 Action Detection challenge evaluates whether a model can localize the start and end of each action in long untrimmed egocentric videos and assign the corresponding verb--noun action label. In this report, we formulate our submission as EgoAction (Egocentric Action Composition with Reliability-Aware Temporal Fusion), a unified decoupled detection and fusion pipeline. The pipeline uses EPIC-finetuned VideoMAE-L features, trains separate noun and verb temporal detectors with causal temporal modeling, composes action hypotheses from top noun--verb pairs, and introduces a confidence-adaptive boundary fusion rule at post-processing time. The key observation is that verb and noun streams often fail differently: verb scores are sensitive to motion transitions, whereas noun scores are sensitive to hand-object visibility and object clutter. A fixed arithmetic mean of their predicted boundaries can therefore amplify localization errors when one stream degenerates. We replace this hard-coded mean with Dynamic Weighted Fusion (DWF), which normalizes the maximum noun and verb classification confidences into proposal-wise boundary weights and linearly combines the two intervals. This lightweight tensor-only operator shifts boundary authority toward the more reliable stream while preserving the decoupled action scoring mechanism. Together with sliding-window inference, top-K noun--verb action composition, and class-wise Soft-NMS, EgoAction provides a compact and reproducible system for egocentric temporal action detection.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 26 of its 34 references that are in the map. First posted on arXiv 23 May 2026.
Builds on
26 of 34 references.
References · 26
- 2023GPT-4 Technical Reportcited by 18,396
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
- 2020Rescaling Egocentric Visioncited by 540
- 2022ActionFormer: Localizing Moments of Actions with Transformerscited by 311
- 2024Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understandingcited by 108
- 2023EgoThink: Evaluating First-Person Perspective Thinking Capability of Vision-Language Modelscited by 60
14 more
- 2025FineCIR: Explicit Parsing of Fine-Grained Modification Semantics for Composed Image Retrievalcited by 42
- 2026ReTrack: Evidence-Driven Dual-Stream Directional Anchor Calibration Network for Composed Video Retrievalcited by 41
- 2025OFFSET: Segmentation-based Focus Shift Revision for Composed Image Retrievalcited by 40
- 2025HUD: Hierarchical Uncertainty-Aware Disambiguation Network for Composed Video Retrievalcited by 32
- 2026STABLE: Efficient Hybrid Nearest Neighbor Search via Magnitude-Uniformity and Cardinality-Robustnesscited by 26
- 2026INTENT: Invariance and Discrimination-aware Noise Mitigation for Robust Composed Image Retrievalcited by 26
- 2026HABIT: Chrono-Synergia Robust Progressive Learning Framework for Composed Image Retrievalcited by 24
- 2026HINT: Composed Image Retrieval with Dual-path Compositional Contextualized Networkcited by 18
- 2026Air-Know: Arbiter-Calibrated Knowledge-Internalizing Robust Network for Composed Image Retrievalcited by 18
- 2026MELT: Improve Composed Image Retrieval via the Modification Frequentation-Rarity Balance Networkcited by 17
- 2026ConeSep: Cone-based Robust Noise-Unlearning Compositional Network for Composed Image Retrievalcited by 17
- 2026TEMA: Anchor the Image, Follow the Text for Multi-Modification Composed Image Retrievalcited by 15
- 2025OpenTAD: A Unified Framework and Comprehensive Study of Temporal Action Detectioncited by 10
- 2024Harnessing Temporal Causality for Advanced Temporal Action Detectioncited by 8
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relationscited by 11
- 2026R^3: Composed Video Retrieval via Reasoning-Guided Recalling and Re-rankingcited by 5
- 2026IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrievalcited by 1
- 2026Surfacing the Unsaid: CUE-Bench for Affective Stance in Chinese Discoursecited by 1
- 2026LightAIR: Lightweight Action Inversion and Riemannian Rectification for Text-based Person Anomaly Searchcited by 0
- 2026Reliable Egocentric Action Anticipation via Temporal Reliability Suppression and Compositional Graph Decodingcited by 0
- 2026MESSENGER: Memory-Enhanced Sequential Scene Flow Estimation via Autoregressive Next-Frame Forecastingcited by 0
- 2026MemReg: Streaming Outdoor LiDAR Point Cloud Registration with Hybrid Memory Bufferscited by 0
- 2026MemReg: Streaming Outdoor LiDAR Point Cloud Registration with Hybrid Memory Buffers8 Oct 2026
- 2026MESSENGER: Memory-Enhanced Sequential Scene Flow Estimation via Autoregressive Next-Frame Forecasting7 Oct 2026
- 2026Reliable Egocentric Action Anticipation via Temporal Reliability Suppression and Compositional Graph Decoding9 Sep 2026
- 2026Surfacing the Unsaid: CUE-Bench for Affective Stance in Chinese Discourse11 Aug 2026
- 2026LightAIR: Lightweight Action Inversion and Riemannian Rectification for Text-based Person Anomaly Search10 Aug 2026
- 2026IMAGINE: Adaptive Schema-Imagery Enhanced Composition for Composed Video Retrieval6 Jun 2026
- 2026COMBINER: Composed Image Retrieval Guided by Attribute-based Neighbor Relations3 Jun 2026
- 2026R^3: Composed Video Retrieval via Reasoning-Guided Recalling and Re-ranking31 May 2026