DIS2: Disentanglement Meets Distillation with Classwise Attention for Robust Remote Sensing Segmentation under Missing Modalities
On the map: Knowledge distillation → Detection and dense prediction distillation
Abstract (arXiv)
The efficacy of multimodal learning in remote sensing (RS) is severely undermined by missing modalities. The challenge is exacerbated by the RS highly heterogeneous data and huge scale variation. Consequently, paradigms proven effective in other domains often fail when confronted with these unique data characteristics. Conventional disentanglement learning, which relies on significant feature overlap between modalities (modality-invariant), is insufficient for this heterogeneity. Similarly, knowledge distillation becomes an ill-posed mimicry task where a student fails to focus on the necessary compensatory knowledge, leaving the semantic gap unaddressed. Our work is therefore built upon three pillars uniquely designed for RS: (1) principled missing information compensation, (2) class-specific modality contribution, and (3) multi-resolution feature importance. We propose a novel method DIS2, a new paradigm shifting from modality-shared feature dependence and untargeted imitation to active, guided missing features compensation. Its core novelty lies in a reformulated synergy between disentanglement learning and knowledge distillation, termed DLKD. Compensatory features are explicitly captured which, when fused with the features of the available modality, approximate the ideal fused representation of the full-modality case. To address the class-specific challenge, our Classwise Feature Learning Module (CFLM) adaptively learn discriminative evidence for each target depending on signal availability. Both DLKD and CFLM are supported by a hierarchical hybrid fusion (HF) structure using features across resolutions to strengthen prediction. Extensive experiments validate that our proposed approach significantly outperforms state-of-the-art methods across benchmarks.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 19 of its 32 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
19 of 32 references.
References · 19
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2021SMIL: Multimodal Learning with Severely Missing Modalitycited by 245
- 2021ResViT: Residual vision transformers for multi-modal medical image synthesiscited by 177
- 2023Multi-modal Learning with Missing Modality via Shared-Specific Feature Modellingcited by 163
- 2020More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classificationcited by 126
- 2022PMR: Prototypical Modal Rebalance for Multimodal Learningcited by 116
- 2022mmFormer: Multimodal Medical Transformer for Incomplete Multimodal Learning of Brain Tumor Segmentationcited by 95
- 2024Deep Multimodal Learning with Missing Modality: A Surveycited by 92
- 2020Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesiscited by 86
- 2021TransMed: Transformers Advance Multi-modal Medical Image Classificationcited by 86
- 2023Multimodal Representation Learning by Alternating Unimodal Adaptationcited by 75
7 more
- 2024DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistencycited by 53
- 2021On the Limitations of Multimodal VAEscited by 38
- 2024TIP: Tabular-Image Pre-training for Multimodal Classification with Incomplete Datacited by 32
- 2017Urban Land Cover Classification with Missing Data Modalities Using Deep Convolutional Neural Networkscited by 14
- 2024A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognitioncited by 12
- 2023General-Purpose Multimodal Transformer meets Remote Sensing Semantic Segmentationcited by 3
- 2025Filling the Gaps: A Multitask Hybrid Multiscale Generative Framework for Missing Modality in Remote Sensing Semantic Segmentationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Rethinking Efficient Mixture-of-Experts for Remote Sensing Modality-Missing Classification
- 2025DiffRIS: Enhancing Referring Remote Sensing Image Segmentation with Pre-trained Text-to-Image Diffusion Models
- 2026ConInfer: Context-Aware Inference for Training-Free Open-Vocabulary Remote Sensing Segmentation
- 2025Cross-modal Context-aware Learning for Visual Prompt Guided Multimodal Image Understanding in Remote Sensing
- 2026Towards Realistic Remote Sensing Dataset Distillation with Discriminative Prototype-guided Diffusion
- 2024DiffCLIP: Few-shot Language-driven Multimodal Classifier
- 2026Any2Any: Unified Arbitrary Modality Translation for Remote Sensing
- 2025Revisiting Cross-Modal Knowledge Distillation: A Disentanglement Approach for RGBD Semantic Segmentation