Rethinking Efficient Mixture-of-Experts for Remote Sensing Modality-Missing Classification
On the map: Mixture-of-experts → Vision mixture-of-experts
Abstract (arXiv)
Multimodal remote sensing classification often suffers from missing modalities caused by sensor failures and environmental interference, leading to severe performance degradation. In this work, we rethink missing-modality learning from a conditional computation perspective and investigate whether Mixture-of-Experts (MoE) models can inherently adapt to diverse modality-missing scenarios. We first conduct a systematic study of representative MoE paradigms under various missing-modality settings, revealing both their potential and limitations. Building on these insights, we propose a Missing-aware Mixture-of-LoRAs (MaMOL), a parameter-efficient MoE framework that unifies multiple modality-missing cases within a single model. MaMOL introduces a dual-routing mechanism to decouple modality-invariant shared experts and modality-aware dynamic experts, enabling automatic expert activation conditioned on available modalities. Extensive experiments on multiple remote sensing benchmarks demonstrate that MaMOL significantly improves robustness and generalization under diverse missing-modality scenarios with minimal computational overhead. Transfer experiments on natural image datasets further validate its scalability and cross-domain applicability.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Vision mixture-of-experts, one of 12 directions in Mixture-of-experts. Builds on 35 of its 58 references that are in the map. First posted on arXiv 14 Nov 2025.
Builds on
35 of 58 references.
Closest ancestors · 3
Same direction, newest first
- 2024Task-Customized Mixture of Adapters for General Image Fusion19 Mar
- 2023Enhancing NeRF akin to Enhancing LLMs: Generalizable NeRF Transformer with Mixture-of-View-Experts22 Aug
- 2021Scaling Vision with Sparse Mixture of Experts10 Jun
Other references · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2022DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scalecited by 404
- 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
- 2024Boosting Continual Learning of Vision-Language Models via Mixture-of-Experts Adapterscited by 199
- 2022Are Multimodal Transformers Robust to Missing Modality?cited by 186
- 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
- 2023Multimodal Prompting with Missing Modalities for Visual Recognitioncited by 121
- 2023When MOE Meets LLMs: Parameter Efficient Fine-tuning for Multi-task Medical Applicationscited by 111
- 2024Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Expertscited by 108
- 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 95
20 more
- 2024Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Expertscited by 70
- 2024FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusioncited by 68
- 2024Multi-Task Dense Prediction via Mixture of Low-Rank Expertscited by 58
- 2023TaskExpert: Dynamically Assembling Multi-Task Representations with Memorial Mixture-of-Expertscited by 45
- 2023Multimodal Industrial Anomaly Detection by Crossmodal Feature Mappingcited by 42
- 2022Tag-assisted Multimodal Sentiment Analysis under Uncertain Missing Modalitiescited by 28
- 2023Omni-SMoLA: Boosting Generalist Multimodal Models with Soft Mixture of Low-rank Expertscited by 26
- 2024Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Mergingcited by 23
- 2024Missing Modality Prediction for Unpaired Multimodal Learning via Joint Embedding of Unimodal Modelscited by 20
- 2024Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration Ratecited by 20
- 2024Deep Correlated Prompting for Visual Recognition with Missing Modalitiescited by 18
- 2024COMO: Cross-Mamba Interaction and Offset-Guided Fusion for Multimodal Object Detectioncited by 18
- 2025Post-pre-training for Modality Alignment in Vision-Language Foundation Modelscited by 18
- 2023Preserving Modality Structure Improves Multi-Modal Learningcited by 13
- 2023Domain Generalization Using Large Pretrained Models with Mixture-of-Adapterscited by 11
- 2025Knowledge Bridger: Towards Training-free Missing Modality Completioncited by 9
- 2024ReMix: Training Generalized Person Re-identification on a Mixture of Datacited by 8
- 2025Synergistic Prompting for Robust Visual Recognition with Missing Modalitiescited by 8
- 2024Not Just Text: Uncovering Vision Modality Typographic Threats in Image Generation Modelscited by 7
- 2024Quantifying Uncertainty in Motion Prediction with Variational Bayesian Mixturecited by 6
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026DIS2: Disentanglement Meets Distillation with Classwise Attention for Robust Remote Sensing Segmentation under Missing Modalities
- 2026UniRoute: Unified Routing Mixture-of-Experts for Modality-Adaptive Remote Sensing Change Detection
- 2025CSMoE: An Efficient Remote Sensing Foundation Model with Soft Mixture-of-Experts
- 2025SkyMoE: A Vision-Language Foundation Model for Enhancing Geospatial Interpretation with Mixture of Experts
- 2026Any2Any: Unified Arbitrary Modality Translation for Remote Sensing
- 2025RingMoE: Mixture-of-Modality-Experts Multi-Modal Foundation Models for Universal Remote Sensing Image Interpretation
- 2026MEOX: Compact Multimodal Mixture-of-Experts for Earth Observation
- 2025Cross-modal Context-aware Learning for Visual Prompt Guided Multimodal Image Understanding in Remote Sensing