EventVGGT: Exploring Cross-Modal Distillation for Consistent Event-based Depth Estimation
Not on the map. Why?
Abstract (arXiv)
Event cameras offer superior sensitivity to high-speed motion and extreme lighting, making event-based monocular depth estimation a promising approach for robust 3D perception in challenging conditions. However, progress is severely hindered by the scarcity of dense depth annotations. While recent annotation-free approaches mitigate this by distilling knowledge from Vision Foundation Models (VFMs), a critical limitation persists: they process event streams as independent frames. By neglecting the inherent temporal continuity of event data, these methods fail to leverage the rich temporal priors encoded in VFMs, ultimately yielding temporally inconsistent and less accurate depth predictions. To address this, we introduce EventVGGT, a novel framework that explicitly models the event stream as a coherent video sequence. To the best of our knowledge, we are the first to distill spatio-temporal and multi-view geometric priors from the Visual Geometry Grounded Transformer (VGGT) into the event domain. We achieve this via a comprehensive tri-level distillation strategy: (i) Cross-Modal Feature Mixture (CMFM) bridges the modality gap at the output level by fusing RGB and event features to generate auxiliary depth predictions; (ii) Spatio-Temporal Feature Distillation (STFD) distills VGGT's powerful spatio-temporal representations at the feature level; and (iii) Temporal Consistency Distillation (TCD) enforces cross-frame coherence at the temporal level by aligning inter-frame depth changes. Extensive experiments demonstrate that EventVGGT consistently outperforms existing methods -- reducing the absolute mean depth error at 30m by over 53% on EventScape (from 2.30 to 1.06) -- while exhibiting robust zero-shot generalization on the unseen DENSE and MVSEC datasets. The code is available at https://github.com/yinruiRen/EventVGGT.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 37 of its 49 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
37 of 49 references.
References · 37
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2015Distilling the Knowledge in a Neural Networkcited by 10,076
- 2023Segment Anythingcited by 8,158
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Depth Anything V2cited by 1,385
- 2025DINOv3cited by 1,297
- 2019Event-based Vision: A Surveycited by 1,010
- 2020Knowledge Distillation and Student-Teacher Learning for Visual Intelligence: A Review and New Outlookscited by 312
25 more
- 2018The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perceptioncited by 251
- 2015Cross Modal Distillation for Supervision Transfercited by 173
- 2022Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusioncited by 110
- 2023Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarkscited by 90
- 2021Combining Events and Frames using Recurrent Asynchronous Multimodal Networks for Monocular Depth Predictioncited by 88
- 2020Learning Monocular Dense Depth from Eventscited by 84
- 2021Object Tracking by Jointly Exploiting Frame and Event Domaincited by 83
- 2022Event Transformer. A sparse-aware solution for efficient event data processingcited by 48
- 2024Towards Robust Event-guided Low-Light Image Enhancement: A Large-Scale Real-World Event-Image Dataset and Novel Approachcited by 48
- 2023Hierarchical Neural Memory Network for Low Latency Event Processingcited by 45
- 2024OpenESS: Event-based Semantic Scene Understanding with Open Vocabulariescited by 37
- 2023A Good Student is Cooperative and Reliable: CNN-Transformer Collaborative Learning for Semantic Segmentationcited by 33
- 2017Learning 3D Object Categories by Looking Around Themcited by 26
- 2021StereoSpike: Depth Learning with a Spiking Neural Networkcited by 21
- 2024PanDA: Towards Panoramic Depth Anything with Unlabeled Panoramas and Mobius Spatial Augmentationcited by 21
- 2023EVEN: An Event-Based Framework for Monocular Depth Estimation at Adverse Night Conditionscited by 19
- 2022Cross-Modal Knowledge Transfer Without Task-Relevant Source Datacited by 17
- 2022Event Transformer+. A multi-purpose solution for efficient event data processingcited by 13
- 2025Depth AnyEvent: A Cross-Modal Distillation Paradigm for Event-Based Monocular Depth Estimationcited by 13
- 2023Decomposed Cross-modal Distillation for RGB-based Temporal Action Detectioncited by 12
- 2023SRFNet: Monocular Depth Estimation with Fine-grained Structure via Spatial Reliability-oriented Fusion of Frames and Eventscited by 11
- 2024eMoE-Tracker: Environmental MoE-based Transformer for Robust Event-guided Object Trackingcited by 10
- 2024HPL-ESS: Hybrid Pseudo-Labeling for Unsupervised Event-based Semantic Segmentationcited by 9
- 2024CLIP the Divergence: Language-guided Unsupervised Domain Adaptationcited by 5
- 2024Source-Free Cross-Modal Knowledge Transfer by Unleashing the Potential of Task-Irrelevant Datacited by 4
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Modelcited by 2
- 2026Interp3R: Continuous-time 3D Geometry Estimation with Frames and Eventscited by 0
- 2026EventFace: Event-Based Face Recognition via Structure-Driven Spatiotemporal Modelingcited by 0
- 2026DarkVGGT: Seeing Through Darkness Using Thermal Geometry without Daylight Taxcited by 0
- 2026SFE-VGGT: Source-Free VGGT Distillation for Event-Based Monocular Depth Estimationcited by 0
- 2026SFE-VGGT: Source-Free VGGT Distillation for Event-Based Monocular Depth Estimation29 Sep 2026
- 2026Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Model28 Jun 2026
- 2026DarkVGGT: Seeing Through Darkness Using Thermal Geometry without Daylight Tax9 Jun 2026
- 2026EventFace: Event-Based Face Recognition via Structure-Driven Spatiotemporal Modeling8 Apr 2026
- 2026Interp3R: Continuous-time 3D Geometry Estimation with Frames and Events15 Mar 2026