DualCross: Cross-Modality Cross-Domain Adaptation for Monocular BEV Perception
Not on the map. Why?
Abstract (arXiv)
Closing the domain gap between training and deployment and incorporating multiple sensor modalities are two challenging yet critical topics for self-driving. Existing work only focuses on single one of the above topics, overlooking the simultaneous domain and modality shift which pervasively exists in real-world scenarios. A model trained with multi-sensor data collected in Europe may need to run in Asia with a subset of input sensors available. In this work, we propose DualCross, a cross-modality cross-domain adaptation framework to facilitate the learning of a more robust monocular bird's-eye-view (BEV) perception model, which transfers the point cloud knowledge from a LiDAR sensor in one domain during the training phase to the camera-only testing scenario in a different domain. This work results in the first open analysis of cross-domain cross-sensor perception and adaptation for monocular 3D tasks in the wild. We benchmark our approach on large-scale datasets under a wide range of domain shifts and show state-of-the-art results against various baselines.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 47 of its 55 references that are in the map. First posted on arXiv 5 May 2023.
Builds on
47 of 55 references.
References · 47
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,917
- 2020Lift, Splat, Shoot: Encoding Images From Arbitrary Camera Rigs by Implicitly Unprojecting to 3Dcited by 1,044
- 2019Improved Knowledge Distillation via Teacher Assistantcited by 573
- 2022BEVDepth: Acquisition of Reliable Depth for Multi-view 3D Object Detectioncited by 572
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 457
- 2019PointPainting: Sequential Fusion for 3D Object Detectioncited by 449
- 2021FCOS3D: Fully Convolutional One-Stage Monocular 3D Object Detectioncited by 447
35 more
- 2018Domain Adaptive Faster R-CNN for Object Detection in the Wildcited by 443
- 2019On the Efficacy of Knowledge Distillationcited by 381
- 2019M3D-RPN: Monocular 3D Region Proposal Network for Object Detectioncited by 252
- 2018SqueezeSegV2: Improved Model Structure and Unsupervised Domain Adaptation for Road-Object Segmentation from a LiDAR Point Cloudcited by 228
- 2020Multi-Task Multi-Sensor Fusion for 3D Object Detectioncited by 203
- 2018Orthographic Feature Transform for Monocular 3D Object Detectioncited by 202
- 2022Unifying Voxel-based Representation with Transformer for 3D Object Detectioncited by 202
- 2021Probabilistic and Geometric Depth: Detecting Objects in Perspectivecited by 191
- 20203D-CVF: Generating Joint Camera and LiDAR Features Using Cross-View Spatial Feature Fusion for 3D Object Detectioncited by 176
- 2019Cross-view Semantic Segmentation for Sensing Surroundingscited by 174
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 159
- 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 158
- 2019xMUDA: Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentationcited by 129
- 2021Cross-Domain Adaptive Teacher for Object Detectioncited by 126
- 2020ImVoteNet: Boosting 3D Object Detection in Point Clouds with Image Votescited by 119
- 2019PointDAN: A Multi-Scale 3D Domain Adaption Network for Point Cloud Representationcited by 114
- 2019Monocular 3D Object Detection with Pseudo-LiDAR Point Cloudcited by 113
- 2020GNN3DMOT: Graph Neural Network for 3D Multi-Object Tracking with Multi-Feature Learningcited by 113
- 2021Structured Bird's-Eye-View Traffic Scene Understanding from Onboard Imagescited by 98
- 2021SPG: Unsupervised Domain Adaptation for 3D Object Detection via Semantic Point Generationcited by 94
- 2021LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detectorcited by 70
- 2022MonoDistill: Learning Spatial Features for Monocular 3D Object Detectioncited by 68
- 2022BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detectioncited by 66
- 2021Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistencycited by 63
- 2019Geometry-Aware Symmetric Domain Adaptation for Monocular Depth Estimationcited by 61
- 2021Object DGCNN: 3D Object Detection using Dynamic Graphscited by 58
- 2020FISHING Net: Future Inference of Semantic Heatmaps In Gridscited by 55
- 2018AdaDepth: Unsupervised Content Congruent Adaptation for Depth Estimationcited by 54
- 2020MonoLayout: Amodal scene layout from a single imagecited by 49
- 2022Cross-Modality Knowledge Distillation Network for Monocular 3D Object Detectioncited by 48
- 2021Sparse-to-dense Feature Matching: Intra and Inter domain Cross-modal Learning in Domain Adaptation for 3D Semantic Segmentationcited by 46
- 2020mDALU: Multi-Source Domain Adaptation and Label Unification with Partial Datasetscited by 19
- 2020Cross-Modality 3D Object Detectioncited by 12
- 2021Multi-Modality Task Cascade for 3D Object Detectioncited by 7
- 2021Multi-Echo LiDAR for 3D Object Detectioncited by 3
Built on by
Citing papers per year: 2024: 3; 2025: 3; 2026: 2.
8 papers.
- 2024Benchmarking and Improving Bird's Eye View Perception Robustness in Autonomous Drivingcited by 41
- 2025Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Modelscited by 23
- 2024Exploring Semi-Supervised Learning for Online Mappingcited by 6
- 2024PCT: Perspective Cue Training Framework for Multi-Camera BEV Segmentationcited by 5
- 2025HierDAMap: Towards Universal Domain Adaptive BEV Mapping via Hierarchical Perspective Priorscited by 2
- 2025NRSeg: Noise-Resilient Learning for BEV Semantic Segmentation via Driving World Modelscited by 2
- 2026XD-MAP: Cross-Modal Domain Adaptation via Semantic Parametric Maps for Scalable Training Data Generationcited by 0
- 2026PanDA: Unsupervised Domain Adaptation for Multimodal 3D Panoptic Segmentation in Autonomous Drivingcited by 0
- 2026PanDA: Unsupervised Domain Adaptation for Multimodal 3D Panoptic Segmentation in Autonomous Driving21 Apr 2026
- 2026XD-MAP: Cross-Modal Domain Adaptation via Semantic Parametric Maps for Scalable Training Data Generation20 Jan 2026
- 2025NRSeg: Noise-Resilient Learning for BEV Semantic Segmentation via Driving World Models5 Jul 2025
- 2025HierDAMap: Towards Universal Domain Adaptive BEV Mapping via Hierarchical Perspective Priors10 Mar 2025
- 2025Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models30 Jan 2025
- 2024Exploring Semi-Supervised Learning for Online Mapping14 Oct 2024
- 2024Benchmarking and Improving Bird's Eye View Perception Robustness in Autonomous Driving27 May 2024
- 2024PCT: Perspective Cue Training Framework for Multi-Camera BEV Segmentation19 Mar 2024