# SensorX2car: Sensors-to-car calibration for autonomous driving in road scenarios

arXiv: https://arxiv.org/abs/2301.07279 · HTML: https://mlsanity.com/paper/2301.07279/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 19 of its 61 references that are in the map.
- First posted on arXiv 18 Jan 2023.

## Builds on (most cited first, 19 of 19)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [CARLA: An Open Urban Driving Simulator](https://mlsanity.com/paper/1711.03938/) (2017)
- [Stacked Hourglass Networks for Human Pose Estimation](https://mlsanity.com/paper/1603.06937/) (2016)
- [RegNet: Multimodal Sensor Registration Using Deep Neural Networks](https://mlsanity.com/paper/1707.03167/) (2017)
- [F-LOAM: Fast LiDAR Odometry And Mapping](https://mlsanity.com/paper/2107.00822/) (2021)
- [CTRL-C: Camera calibration TRansformer with Line-Classification](https://mlsanity.com/paper/2109.02259/) (2021)
- [Horizon Lines in the Wild](https://mlsanity.com/paper/1604.02129/) (2016)
- [Online Temporal Calibration for Monocular Visual-Inertial Systems](https://mlsanity.com/paper/1808.00692/) (2018)
- [NeurVPS: Neural Vanishing Point Scanning via Conic Convolution](https://mlsanity.com/paper/1910.06316/) (2019)
- [CRLF: Automatic Calibration and Refinement based on Line Feature for LiDAR and Camera in Road Scenes](https://mlsanity.com/paper/2103.04558/) (2021)
- [Deep vanishing point detection: Geometric priors make dataset variations vanish](https://mlsanity.com/paper/2203.08586/) (2022)
- [OpenCalib: A Multi-sensor Calibration Toolbox for Autonomous Driving](https://mlsanity.com/paper/2205.14087/) (2022)
- [Detecting Dominant Vanishing Points in Natural Scenes with Application to Composition-Sensitive Image Retrieval](https://mlsanity.com/paper/1608.04267/) (2016)
- [Targetless Rotational Auto-Calibration of Radar and Camera for Intelligent Transportation Systems](https://mlsanity.com/paper/1904.08743/) (2019)
- [Temporally Consistent Horizon Lines](https://mlsanity.com/paper/1907.10014/) (2019)
- [Deep Learning for Vanishing Point Detection Using an Inverse Gnomonic Projection](https://mlsanity.com/paper/1707.02427/) (2017)
- [A Novel Dual-Lidar Calibration Algorithm Using Planar Surfaces](https://mlsanity.com/paper/1904.12116/) (2019)
- [Vanishing point detection with convolutional neural networks](https://mlsanity.com/paper/1609.00967/) (2016)
- [End-to-End Monocular Vanishing Point Detection Exploiting Lane Annotations](https://mlsanity.com/paper/2108.13699/) (2021)

## Built on by (most cited first, 3 of 3)

- [Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review](https://mlsanity.com/paper/2304.10410/) (2023)
- [Deep-BrownConrady: Prediction of Camera Calibration and Distortion Parameters Using Deep Learning and Synthetic Data](https://mlsanity.com/paper/2501.14510/) (2025)
- [CLRNet: Targetless Extrinsic Calibration for Camera, Lidar and 4D Radar Using Deep Learning](https://mlsanity.com/paper/2603.15767/) (2026)

## Abstract (arXiv)

Properly-calibrated sensors are the prerequisite for a dependable autonomous driving system. However, most prior methods focus on extrinsic calibration between sensors, and few focus on the misalignment between the sensors and the vehicle coordinate system. Existing targetless approaches rely on specific prior knowledge, such as driving routes and road features, to handle this misalignment. This work removes these limitations and proposes more general calibration methods for four commonly used sensors: Camera, LiDAR, GNSS/INS, and millimeter-wave Radar. By utilizing sensor-specific patterns: image feature, 3D LiDAR points, GNSS/INS solved pose, and radar speed, we design four corresponding methods to mainly calibrate the rotation from sensor to car during normal driving within minutes, composing a toolbox named SensorX2car. Real-world and simulated experiments demonstrate the practicality of our proposed methods. Meanwhile, the related codes have been open-sourced to benefit the community. To the best of our knowledge, SensorX2car is the first open-source sensor-to-car calibration toolbox. The code is available at https://github.com/OpenCalib/SensorX2car.
