DST-Calib: A Dual-Path, Self-Supervised, Target-Free LiDAR-Camera Extrinsic Calibration Network
Not on the map. Why?
Abstract (arXiv)
LiDAR-camera extrinsic calibration is essential for multi-modal data fusion in robotic perception systems. However, existing approaches typically rely on handcrafted calibration targets (e.g., checkerboards) or specific, static scene types, limiting their adaptability and deployment in real-world autonomous and robotic applications. This article presents the first self-supervised LiDAR-camera extrinsic calibration network that operates in an online fashion and eliminates the need for specific calibration targets. We first identify a significant generalization degradation problem in prior methods, caused by the conventional single-sided data augmentation strategy. To overcome this limitation, we propose a novel double-sided data augmentation technique that generates multi-perspective camera views using estimated depth maps, thereby enhancing robustness and diversity during training. Built upon this augmentation strategy, we design a dual-path, self-supervised calibration framework that reduces the dependence on high-precision ground truth labels and supports fully adaptive online calibration. Furthermore, to improve cross-modal feature association, we replace the traditional dual-branch feature extraction design with a difference map construction process that explicitly correlates LiDAR and camera features. This not only enhances calibration accuracy but also reduces model complexity. Extensive experiments conducted on five public benchmark datasets, as well as our own recorded dataset, demonstrate that the proposed method significantly outperforms existing approaches in terms of generalizability.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 24 of its 40 references that are in the map. First posted on arXiv 3 Jan 2026.
Builds on
24 of 40 references.
References · 24
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2019SuperGlue: Learning Feature Matching with Graph Neural Networkscited by 1,443
- 2024Depth Anything V2cited by 1,422
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2017RegNet: Multimodal Sensor Registration Using Deep Neural Networkscited by 69
- 2021Kimera-Multi: Robust, Distributed, Dense Metric-Semantic SLAM for Multi-Robot Systemscited by 54
- 2021Pixel-level Extrinsic Self Calibration of High Resolution LiDAR and Camera in Targetless Environmentscited by 49
- 2018LEGO: Learning Edge with Geometry all at Once by Watching Videoscited by 47
12 more
- 2024FAST-LIVO2: Fast, Direct LiDAR-Inertial-Visual Odometrycited by 44
- 2023General, Single-shot, Target-less, and Automatic LiDAR-Camera Extrinsic Calibration Toolboxcited by 41
- 2023Towards Robust Robot 3D Perception in Urban Environments: The UT Campus Object Datasetcited by 28
- 2021CRLF: Automatic Calibration and Refinement based on Line Feature for LiDAR and Camera in Road Scenescited by 19
- 2024CMRNext: Camera to LiDAR Matching in the Wild for Localization and Extrinsic Calibrationcited by 15
- 2021CalibDNN: Multimodal Sensor Calibration for Perception Using Deep Neural Networkscited by 14
- 2021Advancing Self-supervised Monocular Depth Learning with Sparse LiDARcited by 13
- 2024Online,Target-Free LiDAR-Camera Extrinsic Calibration via Cross-Modal Mask Matchingcited by 12
- 2020ACSC: Automatic Calibration for Non-repetitive Scanning Solid-State LiDAR and Camera Systemscited by 7
- 2023From Chaos to Calibration: A Geometric Mutual Information Approach to Target-Free Camera LiDAR Extrinsic Calibrationcited by 6
- 2020Auto-calibration Method Using Stop Signs for Urban Autonomous Driving Applicationscited by 5
- 2025Environment-Driven Online LiDAR-Camera Extrinsic Calibrationcited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.