Simplified Cross-Modal Calibration for Heterogeneous Event-RGB Stereo Systems
Not on the map. Why?
Abstract (arXiv)
Accurate extrinsic calibration between event-based and frame-based cameras remains a practical bottleneck for heterogeneous stereo systems. Existing approaches often require sensor or target motion, precise synchronization, or computationally expensive event-to-image reconstruction. We propose a simple, motion-free cross-modal calibration framework that uses a temporally modulated, blended ChArUco target presented on standard consumer displays. By alternating between the original pattern and a partially blended version, the target reliably triggers events while remaining continuously observable to a frame-based camera, avoiding blank frames and reducing synchronization constraints to a coarse, trigger-based alignment. We discretize events into frames coarsely aligned with the RGB images, apply lightweight denoising, and perform ChArUco-based intrinsic and stereo extrinsic calibration. Extensive experiments assess robustness to blending opacity, display brightness, external illumination, viewing angle, and handheld acquisition. Compared to the strongest motion-based reference (E2Calib + Kalibr) and a non-motion-based reference (Plasberg et al.), our approach reduces the mean reprojection error by 44% and 6%, respectively, while substantially simplifying the calibration procedure. Finally, we demonstrate practical utility in a robotic eye-to-hand calibration case study, showing consistent transformations and stable downstream geometric measurements even under partial occlusions. Code is publicly available at https://github.com/nhessenthaler/simple-evrgb-cal.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 31 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
13 of 31 references.
References · 13
- 2019Event-based Vision: A Surveycited by 1,010
- 2019High Speed and High Dynamic Range Video with an Event Cameracited by 344
- 2021How to Calibrate Your Event Cameracited by 53
- 2021Dynamic Event Camera Calibrationcited by 14
- 2024TUMTraf Event: Calibration and Fusion Resulting in a Dataset for Roadside Event-Based and RGB Camerascited by 13
- 2020RGB-D-E: Event Camera Calibration for Fast 6-DOF Object Trackingcited by 12
- 2023E-Calib: A Fast, Robust and Accurate Calibration Toolbox for Event Camerascited by 9
- 2024MULi-Ev: Maintaining Unperturbed LiDAR-Event Calibrationcited by 7
- 2023eWand: A calibration framework for wide baseline frame-based and event-based camera systemscited by 6
- 2024EF-Calib: Spatiotemporal Calibration of Event- and Frame-Based Cameras Using Continuous-Time Trajectoriescited by 5
- 2025SEBVS: Synthetic Event-based Visual Servoing for Robot Navigation and Manipulationcited by 5
- 2025eKalibr: Dynamic Intrinsic Calibration for Event Cameras From First Principles of Eventscited by 2
Built on by
Not cited yet.