LEAR: Learning Edge-Aware Representations for Event-to-LiDAR Localization
Not on the map. Why?
Abstract (arXiv)
Event cameras offer high-temporal-resolution sensing that remains reliable under high-speed motion and challenging lighting, making them promising for localization from LiDAR point clouds in GPS-denied and visually degraded environments. However, aligning sparse, asynchronous events with dense LiDAR maps is fundamentally ill-posed, as direct correspondence estimation suffers from modality gaps. We propose LEAR, a dual-task learning framework that jointly estimates edge structures and dense event-depth flow fields to bridge the sensing-modality divide. Instead of treating edges as a post-hoc aid, LEAR couples them with flow estimation through a cross-modal fusion mechanism that injects modality-invariant geometric cues into the motion representation, and an iterative refinement strategy that enforces mutual consistency between the two tasks over multiple update steps. This synergy produces edge-aware, depth-aligned flow fields that enable more robust and accurate pose recovery via Perspective-n-Point (PnP) solvers. On several popular and challenging datasets, LEAR achieves superior performance over the best prior method. The source code, trained models, and demo videos are made publicly available online.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 34 references that are in the map. First posted on arXiv 2 Mar 2026.
Builds on
20 of 34 references.
References · 20
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2015Holistically-Nested Edge Detectioncited by 590
- 2021DSEC: A Stereo Event Camera Dataset for Driving Scenarioscited by 297
- 2021DeepI2P: Image-to-Point Cloud Registration via Deep Classificationcited by 58
- 2016Event-based, 6-DOF Camera Tracking from Photometric Depth Mapscited by 54
- 2020Event-based visual place recognition with ensembles of temporal windowscited by 35
- 2019LCD: Learned Cross-Domain Descriptors for 2D-3D Matchingcited by 29
- 2022How Many Events do You Need? Event-based Visual Place Recognition Using Sparse But Varying Pixelscited by 17
- 2024A Simple and Effective Point-based Network for Event Camera 6-DOFs Pose Relocalizationcited by 17
- 2022L2E: Lasers to Events for 6-DoF Extrinsic Calibration of Lidars and Event Camerascited by 15
- 2023E2PNet: Event to Point Cloud Registration with Spatio-Temporal Representation Learningcited by 11
8 more
- 2024Enhancing Visual Place Recognition via Fast and Slow Adaptive Biasing in Event Camerascited by 10
- 2023Applications of Spiking Neural Networks in Visual Place Recognitioncited by 9
- 2024Cross-Modal Semi-Dense 6-DoF Tracking of an Event Camera in Challenging Conditionscited by 9
- 2024Improving Visual Place Recognition Based Robot Navigation By Verifying Localization Estimatescited by 7
- 2023Target-free Extrinsic Calibration of Event-LiDAR Dyad using Edge Correspondencescited by 6
- 2024GS-EVT: Cross-Modal Event Camera Tracking based on Gaussian Splattingcited by 4
- 2024EVIT: Event-based Visual-Inertial Tracking in Semi-Dense Maps Using Windowed Nonlinear Optimizationcited by 3
- 2025EVLoc: Event-based Visual Localization in LiDAR Maps via Event-Depth Registrationcited by 2
Built on by
Not cited yet.