mlsanityData to 14 Oct 2026

4D-CAAL: 4D Radar-Camera Calibration and Auto-Labeling for Autonomous Driving

arXiv 2601.21454 ↗First posted 29 Jan 2026cs.RO cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

4D radar has emerged as a critical sensor for autonomous driving, primarily due to its enhanced capabilities in elevation measurement and higher resolution compared to traditional 3D radar. Effective integration of 4D radar with cameras requires accurate extrinsic calibration, and the development of radar-based perception algorithms demands large-scale annotated datasets. However, existing calibration methods often employ separate targets optimized for either visual or radar modalities, complicating correspondence establishment. Furthermore, manually labeling sparse radar data is labor-intensive and unreliable. To address these challenges, we propose 4D-CAAL, a unified framework for 4D radar-camera calibration and auto-labeling. Our approach introduces a novel dual-purpose calibration target design, integrating a checkerboard pattern on the front surface for camera detection and a corner reflector at the center of the back surface for radar detection. We develop a robust correspondence matching algorithm that aligns the checkerboard center with the strongest radar reflection point, enabling accurate extrinsic calibration. Subsequently, we present an auto-labeling pipeline that leverages the calibrated sensor relationship to transfer annotations from camera-based segmentations to radar point clouds through geometric projection and multi-feature optimization. Extensive experiments demonstrate that our method achieves high calibration accuracy while significantly reducing manual annotation effort, thereby accelerating the development of robust multi-modal perception systems for autonomous driving.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 30 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

16 of 30 references.

References · 16

  1. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  2. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
  3. 2017A Survey on Multi-Task Learningcited by 840
  4. 2020Deep Learning for Image and Point Cloud Fusion in Autonomous Driving: A Reviewcited by 108
  5. 2022TJ4DRadSet: A 4D Radar Dataset for Autonomous Drivingcited by 75
  6. 2020A Deep Learning-based Radar and Camera Sensor Fusion Architecture for Object Detectioncited by 70
  7. 2023Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Reviewcited by 58
  8. 2023WaterScenes: A Multi-Task 4D Radar-Camera Fusion Dataset and Benchmarks for Autonomous Driving on Water Surfacescited by 35
  9. 20234D Millimeter-Wave Radar in Autonomous Driving: A Surveycited by 29
  10. 2023Exploring Radar Data Representations in Autonomous Driving: A Comprehensive Reviewcited by 22
  11. 2023RaTrack: Moving Object Detection and Tracking with 4D Radar Point Cloudcited by 21
  12. 2023Tackling Clutter in Radar Data -- Label Generation and Detection Using PointNet++cited by 7
4 more
  1. 2023Online Targetless Radar-Camera Extrinsic Calibration Based on the Common Features of Radar and Cameracited by 6
  2. 2024Efficient 4D Radar Data Auto-labeling Method using LiDAR-based Object Detection Networkcited by 6
  3. 2025USVTrack: USV-Based 4D Radar-Camera Tracking Dataset for Autonomous Driving in Inland Waterwayscited by 4
  4. 2025A 4D Radar Camera Extrinsic Calibration Tool Based on 3D Uncertainty Perspective N Pointscited by 1

Built on by

Not cited yet.