# GS-EVT: Cross-Modal Event Camera Tracking based on Gaussian Splatting

arXiv: https://arxiv.org/abs/2409.19228 · HTML: https://mlsanity.com/paper/2409.19228/

## Key facts

- Cited by 4 papers in the map (data through 14 Oct 2026).
- Builds on 18 of its 35 references that are in the map.
- First posted on arXiv 28 Sep 2024.

## Builds on (most cited first, 18 of 18)

- [3D Gaussian Splatting for Real-Time Radiance Field Rendering](https://mlsanity.com/paper/2308.04079/) (2023)
- [Event-based Vision: A Survey](https://mlsanity.com/paper/1904.08405/) (2019)
- [Gaussian Splatting SLAM](https://mlsanity.com/paper/2312.06741/) (2023)
- [SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM](https://mlsanity.com/paper/2312.02126/) (2023)
- [GS-SLAM: Dense Visual SLAM with 3D Gaussian Splatting](https://mlsanity.com/paper/2311.11700/) (2023)
- [COLMAP-Free 3D Gaussian Splatting](https://mlsanity.com/paper/2312.07504/) (2023)
- [Gaussian-SLAM: Photo-realistic Dense SLAM with Gaussian Splatting](https://mlsanity.com/paper/2312.10070/) (2023)
- [Ultimate SLAM? Combining Events, Images, and IMU for Robust Visual SLAM in HDR and High Speed Scenarios](https://mlsanity.com/paper/1709.06310/) (2017)
- [Photo-SLAM: Real-time Simultaneous Localization and Photorealistic Mapping for Monocular, Stereo, and RGB-D Cameras](https://mlsanity.com/paper/2311.16728/) (2023)
- [Event-based Stereo Visual Odometry](https://mlsanity.com/paper/2007.15548/) (2020)
- [Event-aided Direct Sparse Odometry](https://mlsanity.com/paper/2204.07640/) (2022)
- [RGBD GS-ICP SLAM](https://mlsanity.com/paper/2403.12550/) (2024)
- [Event-based, 6-DOF Camera Tracking from Photometric Depth Maps](https://mlsanity.com/paper/1607.03468/) (2016)
- [VECtor: A Versatile Event-Centric Benchmark for Multi-Sensor SLAM](https://mlsanity.com/paper/2207.01404/) (2022)
- [DEVO: Depth-Event Camera Visual Odometry in Challenging Conditions](https://mlsanity.com/paper/2202.02556/) (2022)
- [Visual Odometry with an Event Camera Using Continuous Ray Warping and Volumetric Contrast Maximization](https://mlsanity.com/paper/2107.03011/) (2021)
- [Cross-Modal Semi-Dense 6-DoF Tracking of an Event Camera in Challenging Conditions](https://mlsanity.com/paper/2401.08043/) (2024)
- [EVIT: Event-based Visual-Inertial Tracking in Semi-Dense Maps Using Windowed Nonlinear Optimization](https://mlsanity.com/paper/2408.01370/) (2024)

## Built on by (most cited first, 4 of 4)

- [E2EGS: Event-to-Edge Gaussian Splatting for Pose-Free 3D Reconstruction](https://mlsanity.com/paper/2603.14684/) (2026)
- [Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Model](https://mlsanity.com/paper/2606.29384/) (2026)
- [Geometric-Photometric Event-based 3D Gaussian Ray Tracing](https://mlsanity.com/paper/2512.18640/) (2025)
- [LEAR: Learning Edge-Aware Representations for Event-to-LiDAR Localization](https://mlsanity.com/paper/2603.01839/) (2026)

## Abstract (arXiv)

Reliable self-localization is a foundational skill for many intelligent mobile platforms. This paper explores the use of event cameras for motion tracking thereby providing a solution with inherent robustness under difficult dynamics and illumination. In order to circumvent the challenge of event camera-based mapping, the solution is framed in a cross-modal way. It tracks a map representation that comes directly from frame-based cameras. Specifically, the proposed method operates on top of gaussian splatting, a state-of-the-art representation that permits highly efficient and realistic novel view synthesis. The key of our approach consists of a novel pose parametrization that uses a reference pose plus first order dynamics for local differential image rendering. The latter is then compared against images of integrated events in a staggered coarse-to-fine optimization scheme. As demonstrated by our results, the realistic view rendering ability of gaussian splatting leads to stable and accurate tracking across a variety of both publicly available and newly recorded data sequences.