DEVO: Depth-Event Camera Visual Odometry in Challenging Conditions
Not on the map. Why?
Abstract (arXiv)
We present a novel real-time visual odometry framework for a stereo setup of a depth and high-resolution event camera. Our framework balances accuracy and robustness against computational efficiency towards strong performance in challenging scenarios. We extend conventional edge-based semi-dense visual odometry towards time-surface maps obtained from event streams. Semi-dense depth maps are generated by warping the corresponding depth values of the extrinsically calibrated depth camera. The tracking module updates the camera pose through efficient, geometric semi-dense 3D-2D edge alignment. Our approach is validated on both public and self-collected datasets captured under various conditions. We show that the proposed method performs comparable to state-of-the-art RGB-D camera-based alternatives in regular conditions, and eventually outperforms in challenging conditions such as high dynamics or low illumination.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 9 of its 31 references that are in the map. First posted on arXiv 5 Feb 2022.
Builds on
9 of 31 references.
References · 9
- 2019Event-based Vision: A Surveycited by 1,010
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 405
- 2018The Multi Vehicle Stereo Event Camera Dataset: An Event Camera Dataset for 3D Perceptioncited by 251
- 2017Ultimate SLAM? Combining Events, Images, and IMU for Robust Visual SLAM in HDR and High Speed Scenarioscited by 150
- 2020Event-based Stereo Visual Odometrycited by 105
- 2019Focus Is All You Need: Loss Functions For Event-based Visioncited by 83
- 2020Globally Optimal Contrast Maximisation for Event-based Motion Estimationcited by 33
- 2020Canny-VO: Visual Odometry with RGB-D Cameras based on Geometric 3D-2D Edge Alignmentcited by 12
- 2019Neuromorphic Visual Odometry System for Intelligent Vehicle Application with Bio-inspired Vision Sensorcited by 11
Built on by
Citing papers per year: 2022: 3; 2023: 12; 2024: 12; 2025: 8; 2026: 1.
36 papers.
Sort:
- 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Cameracited by 92
- 2022E-NeRF: Neural Radiance Fields from a Moving Event Cameracited by 70
- 2024Recent Event Camera Innovations: A Surveycited by 67
- 2023SODFormer: Streaming Object Detection with Transformer Using Events and Framescited by 39
- 2023Deep Event Visual Odometrycited by 29
- 2023Neuromorphic Event-based Facial Expression Recognitioncited by 18
- 2024Ev-GS: Event-based Gaussian splatting for Efficient and Accurate Radiance Field Renderingcited by 18
- 2023Event-based Simultaneous Localization and Mapping: A Comprehensive Surveycited by 17
- 2023EvDNeRF: Reconstructing Event Data with Dynamic Neural Radiance Fieldscited by 17
- 2023Implicit Event-RGBD Neural SLAMcited by 16
- 2023Deep Visual Odometry with Events and Framescited by 13
- 2023A 5-Point Minimal Solver for Event Camera Relative Motion Estimationcited by 13
24 more
- 2024An N-Point Linear Solver for Line and Motion Estimation with Event Camerascited by 11
- 2024SweepEvGS: Event-Based 3D Gaussian Splatting for Macro and Micro Radiance Field Rendering from a Single Sweepcited by 10
- 2023EVI-SAM: Robust, Real-time, Tightly-coupled Event-Visual-Inertial State Estimation and 3D Dense Mappingcited by 9
- 2024Cross-Modal Semi-Dense 6-DoF Tracking of an Event Camera in Challenging Conditionscited by 9
- 2023Event-Free Moving Object Segmentation from Moving Ego Vehiclecited by 8
- 2024EventRPG: Event Data Augmentation with Relevance Propagation Guidancecited by 7
- 2024ES-PTAM: Event-based Stereo Parallel Tracking and Mappingcited by 7
- 2024Tight Fusion of Events and Inertial Measurements for Direct Velocity Estimationcited by 6
- 2023Event Camera-based Visual Odometry for Dynamic Motion Tracking of a Legged Robot Using Adaptive Time Surfacecited by 5
- 2025Dark-EvGS: Event Camera as an Eye for Radiance Field in the Darkcited by 5
- 2024GS-EVT: Cross-Modal Event Camera Tracking based on Gaussian Splattingcited by 4
- 2025A Survey of 3D Reconstruction with Event Camerascited by 4
- 2024EVIT: Event-based Visual-Inertial Tracking in Semi-Dense Maps Using Windowed Nonlinear Optimizationcited by 3
- 2025Hardware, Algorithms, and Applications of the Neuromorphic Vision Sensor: a Reviewcited by 3
- 2025EAG3R: Event-Augmented 3D Geometry Estimation for Dynamic and Extreme-Lighting Scenescited by 3
- 2024Event-Based Visual Odometry on Non-Holonomic Ground Vehiclescited by 2
- 2025A Survey on Event-driven 3D Reconstruction: Development under Different Categoriescited by 2
- 2022Ego-motion Estimation Based on Fusion of Images and Eventscited by 1
- 2023Cross-modal Place Recognition in Image Databases using Event-based Sensorscited by 1
- 2024Monocular Event-Inertial Odometry with Adaptive decay-based Time Surface and Polarity-aware Trackingcited by 1
- 2025SaENeRF: Suppressing Artifacts in Event-based Neural Radiance Fieldscited by 1
- 2025SuperEIO: Self-Supervised Event Feature Learning for Event Inertial Odometrycited by 0
- 2025S3CE-Net: Spike-guided Spatiotemporal Semantic Coupling and Expansion Network for Long Sequence Event Re-Identificationcited by 0
- 2026CMTFormer: Marrying Transformer with Hierarchical Information Interaction for RGB-Event Object Detectioncited by 0
- 2026CMTFormer: Marrying Transformer with Hierarchical Information Interaction for RGB-Event Object Detection28 Jun 2026
- 2025EAG3R: Event-Augmented 3D Geometry Estimation for Dynamic and Extreme-Lighting Scenes30 Nov 2025
- 2025Dark-EvGS: Event Camera as an Eye for Radiance Field in the Dark16 Jul 2025
- 2025S3CE-Net: Spike-guided Spatiotemporal Semantic Coupling and Expansion Network for Long Sequence Event Re-Identification30 May 2025
- 2025A Survey of 3D Reconstruction with Event Cameras13 May 2025
- 2025SaENeRF: Suppressing Artifacts in Event-based Neural Radiance Fields23 Apr 2025
- 2025Hardware, Algorithms, and Applications of the Neuromorphic Vision Sensor: a Review11 Apr 2025
- 2025SuperEIO: Self-Supervised Event Feature Learning for Event Inertial Odometry29 Mar 2025
- 2025A Survey on Event-driven 3D Reconstruction: Development under Different Categories25 Mar 2025
- 2024SweepEvGS: Event-Based 3D Gaussian Splatting for Macro and Micro Radiance Field Rendering from a Single Sweep16 Dec 2024
- 2024GS-EVT: Cross-Modal Event Camera Tracking based on Gaussian Splatting28 Sep 2024
- 2024Monocular Event-Inertial Odometry with Adaptive decay-based Time Surface and Polarity-aware Tracking21 Sep 2024
24 more
- 2024ES-PTAM: Event-based Stereo Parallel Tracking and Mapping28 Aug 2024
- 2024Recent Event Camera Innovations: A Survey24 Aug 2024
- 2024EVIT: Event-based Visual-Inertial Tracking in Semi-Dense Maps Using Windowed Nonlinear Optimization2 Aug 2024
- 2024Ev-GS: Event-based Gaussian splatting for Efficient and Accurate Radiance Field Rendering16 Jul 2024
- 2024An N-Point Linear Solver for Line and Motion Estimation with Event Cameras1 Apr 2024
- 2024EventRPG: Event Data Augmentation with Relevance Propagation Guidance14 Mar 2024
- 2024Event-Based Visual Odometry on Non-Holonomic Ground Vehicles17 Jan 2024
- 2024Tight Fusion of Events and Inertial Measurements for Direct Velocity Estimation17 Jan 2024
- 2024Cross-Modal Semi-Dense 6-DoF Tracking of an Event Camera in Challenging Conditions16 Jan 2024
- 2023EVI-SAM: Robust, Real-time, Tightly-coupled Event-Visual-Inertial State Estimation and 3D Dense Mapping19 Dec 2023
- 2023Deep Event Visual Odometry15 Dec 2023
- 2023Implicit Event-RGBD Neural SLAM18 Nov 2023
- 2023EvDNeRF: Reconstructing Event Data with Dynamic Neural Radiance Fields3 Oct 2023
- 2023A 5-Point Minimal Solver for Event Camera Relative Motion Estimation29 Sep 2023
- 2023Deep Visual Odometry with Events and Frames18 Sep 2023
- 2023SODFormer: Streaming Object Detection with Transformer Using Events and Frames8 Aug 2023
- 2023Cross-modal Place Recognition in Image Databases using Event-based Sensors3 Jul 2023
- 2023Event Camera-based Visual Odometry for Dynamic Motion Tracking of a Legged Robot Using Adaptive Time Surface15 May 2023
- 2023Event-Free Moving Object Segmentation from Moving Ego Vehicle28 Apr 2023
- 2023Event-based Simultaneous Localization and Mapping: A Comprehensive Survey19 Apr 2023
- 2023Neuromorphic Event-based Facial Expression Recognition13 Apr 2023
- 2022E-NeRF: Neural Radiance Fields from a Moving Event Camera24 Aug 2022
- 2022Ego-motion Estimation Based on Fusion of Images and Events12 Jul 2022
- 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Camera23 Jun 2022
- 2022EventNeRF: Neural Radiance Fields from a Single Colour Event Cameracited by 92
- 2022E-NeRF: Neural Radiance Fields from a Moving Event Cameracited by 70
- 2024Recent Event Camera Innovations: A Surveycited by 67
- 2023SODFormer: Streaming Object Detection with Transformer Using Events and Framescited by 39
- 2023Deep Event Visual Odometrycited by 29
- 2023Neuromorphic Event-based Facial Expression Recognitioncited by 18
- 2024Ev-GS: Event-based Gaussian splatting for Efficient and Accurate Radiance Field Renderingcited by 18
- 2023Event-based Simultaneous Localization and Mapping: A Comprehensive Surveycited by 17
- 2023EvDNeRF: Reconstructing Event Data with Dynamic Neural Radiance Fieldscited by 17
- 2023Implicit Event-RGBD Neural SLAMcited by 16
- 2023Deep Visual Odometry with Events and Framescited by 13
- 2023A 5-Point Minimal Solver for Event Camera Relative Motion Estimationcited by 13
12 most cited of 36 All 36 (JSON)
- 2026CMTFormer: Marrying Transformer with Hierarchical Information Interaction for RGB-Event Object Detection28 Jun 2026
- 2025EAG3R: Event-Augmented 3D Geometry Estimation for Dynamic and Extreme-Lighting Scenes30 Nov 2025
- 2025Dark-EvGS: Event Camera as an Eye for Radiance Field in the Dark16 Jul 2025
- 2025S3CE-Net: Spike-guided Spatiotemporal Semantic Coupling and Expansion Network for Long Sequence Event Re-Identification30 May 2025
- 2025A Survey of 3D Reconstruction with Event Cameras13 May 2025
- 2025SaENeRF: Suppressing Artifacts in Event-based Neural Radiance Fields23 Apr 2025
- 2025Hardware, Algorithms, and Applications of the Neuromorphic Vision Sensor: a Review11 Apr 2025
- 2025SuperEIO: Self-Supervised Event Feature Learning for Event Inertial Odometry29 Mar 2025
- 2025A Survey on Event-driven 3D Reconstruction: Development under Different Categories25 Mar 2025
- 2024SweepEvGS: Event-Based 3D Gaussian Splatting for Macro and Micro Radiance Field Rendering from a Single Sweep16 Dec 2024
- 2024GS-EVT: Cross-Modal Event Camera Tracking based on Gaussian Splatting28 Sep 2024
- 2024Monocular Event-Inertial Odometry with Adaptive decay-based Time Surface and Polarity-aware Tracking21 Sep 2024
12 newest of 36 All 36 (JSON)