mlsanityData to 7 Oct 2026

Simplified Cross-Modal Calibration for Heterogeneous Event-RGB Stereo Systems

arXiv 2608.22965 ↗First posted 24 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Accurate extrinsic calibration between event-based and frame-based cameras remains a practical bottleneck for heterogeneous stereo systems. Existing approaches often require sensor or target motion, precise synchronization, or computationally expensive event-to-image reconstruction. We propose a simple, motion-free cross-modal calibration framework that uses a temporally modulated, blended ChArUco target presented on standard consumer displays. By alternating between the original pattern and a partially blended version, the target reliably triggers events while remaining continuously observable to a frame-based camera, avoiding blank frames and reducing synchronization constraints to a coarse, trigger-based alignment. We discretize events into frames coarsely aligned with the RGB images, apply lightweight denoising, and perform ChArUco-based intrinsic and stereo extrinsic calibration. Extensive experiments assess robustness to blending opacity, display brightness, external illumination, viewing angle, and handheld acquisition. Compared to the strongest motion-based reference (E2Calib + Kalibr) and a non-motion-based reference (Plasberg et al.), our approach reduces the mean reprojection error by 44% and 6%, respectively, while substantially simplifying the calibration procedure. Finally, we demonstrate practical utility in a robotic eye-to-hand calibration case study, showing consistent transformations and stable downstream geometric measurements even under partial occlusions. Code is publicly available at https://github.com/nhessenthaler/simple-evrgb-cal.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 31 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

13 of 31 references.

References · 13

  1. 2019Event-based Vision: A Surveycited by 1,010
  2. 2019High Speed and High Dynamic Range Video with an Event Cameracited by 344
  3. 2021How to Calibrate Your Event Cameracited by 53
  4. 2021Dynamic Event Camera Calibrationcited by 14
  5. 2024TUMTraf Event: Calibration and Fusion Resulting in a Dataset for Roadside Event-Based and RGB Camerascited by 13
  6. 2020RGB-D-E: Event Camera Calibration for Fast 6-DOF Object Trackingcited by 12
  7. 2023E-Calib: A Fast, Robust and Accurate Calibration Toolbox for Event Camerascited by 9
  8. 2024MULi-Ev: Maintaining Unperturbed LiDAR-Event Calibrationcited by 7
  9. 2023eWand: A calibration framework for wide baseline frame-based and event-based camera systemscited by 6
  10. 2024EF-Calib: Spatiotemporal Calibration of Event- and Frame-Based Cameras Using Continuous-Time Trajectoriescited by 5
  11. 2025SEBVS: Synthetic Event-based Visual Servoing for Robot Navigation and Manipulationcited by 5
  12. 2025eKalibr: Dynamic Intrinsic Calibration for Event Cameras From First Principles of Eventscited by 2
1 more
  1. 2025One target to align them all: LiDAR, RGB and event cameras extrinsic calibration for Autonomous Drivingcited by 1

Built on by

Not cited yet.