Understanding Cross-Rig Generalization in Automotive Perception: a Multi-Rig Benchmark and Rig Variation Metrics
Not on the map. Why?
Abstract (arXiv)
Camera-based perception systems for autonomous driving are typically developed and evaluated using fixed sensor rigs, while real-world vehicle fleets exhibit substantial variation in camera placement, orientation, field of view, and camera count. This mismatch introduces a cross-rig domain gap in which only the geometric observation process changes. To study this effect under controlled conditions, we introduce Plentiful CARLA Camera Rigs, a benchmark that renders identical driving scenes under 14 systematically designed camera rigs. This setup enables direct analysis of cross-rig generalization without confounding changes in scene content or appearance. Using the benchmark, we analyze cross-rig transfer behavior of representative multi-view perception architectures and observe substantial performance shifts induced by geometric rig variation. To facilitate structured analysis, we further introduce two calibration-based descriptors derived from rig metadata: Rig Variance, capturing internal rig diversity, and Rig Contrastive Distance, measuring geometric discrepancy between rigs. Our experiments show that geometric rig differences strongly correlate with relative cross-rig performance shifts and that Rig Contrastive Distance provides a reliable proxy for ranking transfer difficulty between sensor rigs.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 44 references that are in the map. First posted on arXiv 25 Jun 2026.
Builds on
28 of 44 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2020Center-based 3D Object Detection and Trackingcited by 1,144
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2021BEVDet: High-performance Multi-camera 3D Object Detection in Bird-Eye-Viewcited by 713
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 658
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 552
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
16 more
- 2025Fast3R: Towards 3D Reconstruction of 1000+ Images in One Forward Passcited by 367
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 352
- 2022BEVFusion: A Simple and Robust LiDAR-Camera Fusion Frameworkcited by 336
- 2022BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervisioncited by 302
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 20223D Object Detection for Autonomous Driving: A Comprehensive Surveycited by 132
- 2024A Survey on Autonomous Driving Datasets: Statistics, Annotation Quality, and a Future Outlookcited by 66
- 2024Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Reviewcited by 41
- 2023Fast-BEV: A Fast and Strong Bird's-Eye View Perception Baselinecited by 40
- 2023Detecting As Labeling: Rethinking LiDAR-camera Fusion in 3D Object Detectioncited by 28
- 2021Investigating the Impact of Multi-LiDAR Placement on Object Detection for Autonomous Drivingcited by 22
- 2023Towards Viewpoint Robustness in Bird's Eye View Segmentationcited by 13
- 2018Where Should We Place LiDARs on the Autonomous Vehicle? - An Optimal Design Approachcited by 12
- 2023Influence of Camera-LiDAR Configuration on 3D Object Detection for Autonomous Drivingcited by 6
- 2021Towards Sensor Data Abstraction of Autonomous Vehicle Perception Systemscited by 2
- 2025Neural Rendering for Sensor Adaptation in 3D Object Detectioncited by 1
Built on by
Not cited yet.