xMUDA: Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
Unsupervised Domain Adaptation (UDA) is crucial to tackle the lack of annotations in a new domain. There are many multi-modal datasets, but most UDA approaches are uni-modal. In this work, we explore how to learn from multi-modality and propose cross-modal UDA (xMUDA) where we assume the presence of 2D images and 3D point clouds for 3D semantic segmentation. This is challenging as the two input spaces are heterogeneous and can be impacted differently by domain shift. In xMUDA, modalities learn from each other through mutual mimicking, disentangled from the segmentation objective, to prevent the stronger modality from adopting false predictions from the weaker one. We evaluate on new UDA scenarios including day-to-night, country-to-country and dataset-to-dataset, leveraging recent autonomous driving datasets. xMUDA brings large improvements over uni-modal UDA on all tested scenarios, and is complementary to state-of-the-art UDA techniques. Code is available at https://github.com/valeoai/xmuda.
Key facts. Cited by 129 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 26; 2023: 36; 2024: 21; 2025: 18; 2026: 9.
129 papers.
Sort:
By area:
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 159
- 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 158
- 2021The Norm Must Go On: Dynamic Unsupervised Domain Adaptation by Normalizationcited by 131
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 129
- 2022Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Datacited by 126
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 125
- 2021Bidirectional Projection Network for Cross Dimension Scene Understandingcited by 95
- 2022MM-TTA: Multi-Modal Test-Time Adaptation for 3D Semantic Segmentationcited by 76
- 2022PolarMix: A General Data Augmentation Technique for LiDAR Point Cloudscited by 74
- 2022Scene Graph Generation: A Comprehensive Surveycited by 73
- 2021Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistencycited by 63
- 2021Learning 3D Semantic Segmentation with only 2D Image Supervisioncited by 60
38 more
- 2021EPMF: Efficient Perception-aware Multi-sensor Fusion for 3D Semantic Segmentationcited by 59
- 2021ST3D++: Denoised Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 57
- 2022LiDAR Distillation: Bridging the Beam-Induced Domain Gap for 3D Object Detectioncited by 55
- 2022CoSMix: Compositional Semantic Mix for Domain Adaptation in 3D LiDAR Segmentationcited by 54
- 2024Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Drivingcited by 54
- 2021A Survey on Deep Domain Adaptation for LiDAR Perceptioncited by 47
- 2021Sparse-to-dense Feature Matching: Intra and Inter domain Cross-modal Learning in Domain Adaptation for 3D Semantic Segmentationcited by 46
- 2023Three Pillars improving Vision Foundation Model Distillation for Lidarcited by 44
- 2022Multi-Modal Cross-Domain Alignment Network for Video Moment Retrievalcited by 43
- 2023Cross-modal Orthogonal High-rank Augmentation for RGB-Event Transformer-trackerscited by 43
- 2021ConDA: Unsupervised Domain Adaptation for LiDAR Segmentation via Regularized Domain Concatenationcited by 41
- 2021Cross-modal Learning for Domain Adaptation in 3D Semantic Segmentationcited by 40
- 2022GIPSO: Geometrically Informed Propagation for Online Adaptation in 3D LiDAR Segmentationcited by 35
- 2023Less is More: Reducing Task and Model Complexity for 3D Point Cloud Semantic Segmentationcited by 33
- 20244D Contrastive Superflows are Dense 3D Representation Learnerscited by 33
- 2023TTA-COPE: Test-Time Adaptation for Category-Level Object Pose Estimationcited by 32
- 2022Deformation and Correspondence Aware Unsupervised Synthetic-to-Real Scene Flow Estimation for Point Cloudscited by 28
- 2024MultiOOD: Scaling Out-of-Distribution Detection for Multiple Modalitiescited by 28
- 2022CL3D: Unsupervised Domain Adaptation for Cross-LiDAR 3D Detectioncited by 27
- 2024Is Your LiDAR Placement Optimized for 3D Scene Understanding?cited by 26
- 2021UDA-COPE: Unsupervised Domain Adaptation for Category-level Object Pose Estimationcited by 25
- 2024Multi-Space Alignments Towards Universal LiDAR Segmentationcited by 25
- 2023Point-TTA: Test-Time Adaptation for Point Cloud Registration Using Multitask Meta-Auxiliary Learningcited by 23
- 2025Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Modelscited by 23
- 2021Unsupervised Domain Adaptation in LiDAR Semantic Segmentation with Self-Supervision and Gated Adapterscited by 21
- 2023SALUDA: Surface-based Automotive Lidar Unsupervised Domain Adaptationcited by 21
- 2022DetMatch: Two Teachers are Better Than One for Joint 2D and 3D Semi-Supervised Object Detectioncited by 20
- 2023Multi-Modal Continual Test-Time Adaptation for 3D Semantic Segmentationcited by 20
- 2023A Survey of Label-Efficient Deep Learning for 3D Point Cloudscited by 20
- 2023Compositional Semantic Mix for Domain Adaptation in Point Cloud Segmentationcited by 20
- 2023Learning to Adapt SAM for Segmenting Cross-domain Point Cloudscited by 20
- 2022Drive&Segment: Unsupervised Semantic Segmentation of Urban Scenes via Cross-modal Distillationcited by 19
- 2021Uncertainty-aware Mean Teacher for Source-free Unsupervised Domain Adaptive 3D Object Detectioncited by 18
- 2023LiDAR2Map: In Defense of LiDAR-Based Semantic Map Construction Using Online Camera Distillationcited by 18
- 2023MoPA: Multi-Modal Prior Aided Domain Adaptation for 3D Semantic Segmentationcited by 17
- 2023Instant Domain Augmentation for LiDAR Semantic Segmentationcited by 16
- 2023U3DS3: Unsupervised 3D Semantic Scene Segmentationcited by 16
- 2021See Eye to Eye: A Lidar-Agnostic 3D Detection Framework for Unsupervised Multi-Target Domain Adaptationcited by 15
50 most cited of 129 All 129 (JSON)
- 2026Embodied Semantic Communication for Collective Autonomous Agents: A Tutorial on Representation, Wireless Delivery, and Closed-Loop Coordination28 Sep 2026
- 2026MSSP: Multi-Scale Spatially-Constrained Partition for Unsupervised Semantic Segmentation of 3D Point Clouds7 Sep 2026
- 2026FrozenDrive: Zero-Shot Text-Guided Driving Scene Generation and Data Augmentation with Parameter-Free Frozen Diffusion Model18 Jun 2026
- 2026UniD-Shift: Towards Unified Semantic Segmentation via Interpretable Share-Private Multimodal Decomposition8 May 2026
- 2026LIE: LiDAR-only HD Map Construction with Intensity Enhancement via Online Knowledge Distillation2 May 2026
- 2026PanDA: Unsupervised Domain Adaptation for Multimodal 3D Panoptic Segmentation in Autonomous Driving21 Apr 2026
- 2026AdaSFormer: Adaptive Serialized Transformers for Monocular Semantic Scene Completion from Indoor Environments26 Mar 2026
- 2026LiDAR-Anchored Collaborative Distillation for Robust 2D Representations13 Feb 2026
- 2026Evolving Without Ending: Unifying Multimodal Incremental Learning for Continual Panoptic Perception22 Jan 2026
- 2025U4D: Uncertainty-Aware 4D World Modeling from LiDAR Sequences2 Dec 2025
- 2025Improving Multimodal Distillation for 3D Semantic Segmentation under Domain Shift21 Nov 2025
- 20253EED: Ground Everything Everywhere in 3D3 Nov 2025
38 more
- 2025BlendCLIP: Bridging Synthetic and Real Domains for Zero-Shot 3D Object Classification with Multimodal Pretraining21 Oct 2025
- 2025MOCHA: Multi-modal Objects-aware Cross-arcHitecture Alignment17 Sep 2025
- 2025Domain Adaptation-Based Crossmodal Knowledge Distillation for 3D Semantic Segmentation30 Aug 2025
- 2025Unsupervised Domain Adaptation for 3D LiDAR Semantic Segmentation Using Contrastive Learning and Multi-Model Pseudo Labeling24 Jul 2025
- 2025Heterogeneous-Modal Unsupervised Domain Adaptation via Latent Space Bridging19 Jun 2025
- 2025SPIRAL: Semantic-Aware Progressive LiDAR Scene Generation and Understanding28 May 2025
- 2025Extremely Simple Multimodal Outlier Synthesis for Out-of-Distribution Detection and Segmentation22 May 2025
- 20252D-3D Attention and Entropy for Pose Robust 2D Facial Recognition14 May 2025
- 2025Exploring Modality Guidance to Enhance VFM-based Feature Fusion for UDA in 3D Semantic Segmentation19 Apr 2025
- 2025SAM-guided Pseudo Label Enhancement for Multi-modal 3D Semantic Segmentation2 Feb 2025
- 2025Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models30 Jan 2025
- 2025Towards Robust Multimodal Open-set Test-time Adaptation via Adaptive Entropy-aware Optimization23 Jan 2025
- 2025Robust Single Object Tracking in LiDAR Point Clouds under Adverse Weather Conditions13 Jan 2025
- 2025LargeAD: Large-Scale Cross-Sensor Data Pretraining for Autonomous Driving7 Jan 2025
- 2025A Novel Vision Transformer for Camera-LiDAR Fusion based Traffic Object Segmentation6 Jan 2025
- 2024Density-aware global-local attention network for point cloud segmentation30 Nov 2024
- 2024Robust 3D Semantic Occupancy Prediction with Calibration-free Spatial Transformation19 Nov 2024
- 2024Fusion-then-Distillation: Toward Cross-modal Positive Distillation for Domain Adaptive 3D Semantic Segmentation25 Oct 2024
- 2024LiOn-XA: Unsupervised Domain Adaptation via LiDAR-Only Cross-Modal Adversarial Training21 Oct 2024
- 2024Towards Semi-supervised Dual-modal Semantic Segmentation20 Sep 2024
- 2024MICDrop: Masking Image and Depth Features via Complementary Dropout for Domain-Adaptive Semantic Segmentation29 Aug 2024
- 2024Segment Anything with Multiple Modalities17 Aug 2024
- 2024Deep Mutual Learning among Partially Labeled Datasets for Multi-Organ Segmentation17 Jul 2024
- 20244D Contrastive Superflows are Dense 3D Representation Learners8 Jul 2024
- 2024MultiOOD: Scaling Out-of-Distribution Detection for Multiple Modalities27 May 2024
- 2024An Empirical Study of Training State-of-the-Art LiDAR Segmentation Models23 May 2024
- 2024Multi-Modal Data-Efficient 3D Scene Understanding for Autonomous Driving8 May 2024
- 2024Multi-Space Alignments Towards Universal LiDAR Segmentation2 May 2024
- 2024CLFT: Camera-LiDAR Fusion Transformer for Semantic Segmentation in Autonomous Driving27 Apr 2024
- 2024Weakly Supervised LiDAR Semantic Segmentation via Scatter Image Annotation19 Apr 2024
- 2024RaSim: A Range-aware High-fidelity RGB-D Data Simulation Pipeline for Real-world Applications5 Apr 2024
- 2024UADA3D: Unsupervised Adversarial Domain Adaptation for 3D Object Detection with Sparse LiDAR and Large Domain Gaps26 Mar 2024
- 2024Calib3D: Calibrating Model Preferences for Reliable 3D Scene Understanding25 Mar 2024
- 2024Is Your LiDAR Placement Optimized for 3D Scene Understanding?25 Mar 2024
- 2024TTT-KD: Test-Time Training for 3D Semantic Segmentation through Knowledge Distillation from Foundation Models18 Mar 2024
- 2024Visual Foundation Models Boost Cross-Modal Unsupervised Domain Adaptation for 3D Semantic Segmentation15 Mar 2024
- 2023U3DS3: Unsupervised 3D Semantic Scene Segmentation10 Nov 2023
- 2023COLA: COarse-LAbel multi-source LiDAR semantic segmentation for autonomous driving6 Nov 2023
50 newest of 129 All 129 (JSON)
- 2024TTT-KD: Test-Time Training for 3D Semantic Segmentation through Knowledge Distillation from Foundation Modelscited by 5
- 2025Domain Adaptation-Based Crossmodal Knowledge Distillation for 3D Semantic Segmentationcited by 0
- 2026LIE: LiDAR-only HD Map Construction with Intensity Enhancement via Online Knowledge Distillationcited by 0
- 2026LIE: LiDAR-only HD Map Construction with Intensity Enhancement via Online Knowledge Distillation2 May 2026
- 2025Domain Adaptation-Based Crossmodal Knowledge Distillation for 3D Semantic Segmentation30 Aug 2025
- 2024TTT-KD: Test-Time Training for 3D Semantic Segmentation through Knowledge Distillation from Foundation Models18 Mar 2024
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 159
- 20222DPASS: 2D Priors Assisted Semantic Segmentation on LiDAR Point Cloudscited by 158
- 2021The Norm Must Go On: Dynamic Unsupervised Domain Adaptation by Normalizationcited by 131
- 2023Robo3D: Towards Robust and Reliable 3D Perception against Corruptionscited by 129
- 2022Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Datacited by 126
- 2023Segment Any Point Cloud Sequences by Distilling Vision Foundation Modelscited by 125
- 2021Bidirectional Projection Network for Cross Dimension Scene Understandingcited by 95
- 2022MM-TTA: Multi-Modal Test-Time Adaptation for 3D Semantic Segmentationcited by 76
- 2022PolarMix: A General Data Augmentation Technique for LiDAR Point Cloudscited by 74
- 2022Scene Graph Generation: A Comprehensive Surveycited by 73
- 2021Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistencycited by 63
- 2021Learning 3D Semantic Segmentation with only 2D Image Supervisioncited by 60
12 most cited of 122 All 122 (JSON)
- 2026Embodied Semantic Communication for Collective Autonomous Agents: A Tutorial on Representation, Wireless Delivery, and Closed-Loop Coordination28 Sep 2026
- 2026MSSP: Multi-Scale Spatially-Constrained Partition for Unsupervised Semantic Segmentation of 3D Point Clouds7 Sep 2026
- 2026UniD-Shift: Towards Unified Semantic Segmentation via Interpretable Share-Private Multimodal Decomposition8 May 2026
- 2026PanDA: Unsupervised Domain Adaptation for Multimodal 3D Panoptic Segmentation in Autonomous Driving21 Apr 2026
- 2026AdaSFormer: Adaptive Serialized Transformers for Monocular Semantic Scene Completion from Indoor Environments26 Mar 2026
- 2026LiDAR-Anchored Collaborative Distillation for Robust 2D Representations13 Feb 2026
- 2026Evolving Without Ending: Unifying Multimodal Incremental Learning for Continual Panoptic Perception22 Jan 2026
- 2025Improving Multimodal Distillation for 3D Semantic Segmentation under Domain Shift21 Nov 2025
- 20253EED: Ground Everything Everywhere in 3D3 Nov 2025
- 2025BlendCLIP: Bridging Synthetic and Real Domains for Zero-Shot 3D Object Classification with Multimodal Pretraining21 Oct 2025
- 2025MOCHA: Multi-modal Objects-aware Cross-arcHitecture Alignment17 Sep 2025
- 2025Unsupervised Domain Adaptation for 3D LiDAR Semantic Segmentation Using Contrastive Learning and Multi-Model Pseudo Labeling24 Jul 2025
12 newest of 122 All 122 (JSON)