Towards Robust Optical-SAR Object Detection under Missing Modalities: A Dynamic Quality-Aware Fusion Framework
Not on the map. Why?
Abstract (arXiv)
Optical and Synthetic Aperture Radar (SAR) fusion-based object detection has attracted significant research interest in remote sensing, as these modalities provide complementary information for all-weather monitoring. However, practical deployment is severely limited by inherent challenges. Due to distinct imaging mechanisms, temporal asynchrony, and registration difficulties, obtaining well-aligned optical-SAR image pairs remains extremely difficult, frequently resulting in missing or degraded modality data. Although recent approaches have attempted to address this issue, they still suffer from limited robustness to random missing modalities and lack effective mechanisms to ensure consistent performance improvement in fusion-based detection. To address these limitations, we propose a novel Quality-Aware Dynamic Fusion Network (QDFNet) for robust optical-SAR object detection. Our proposed method leverages learnable reference tokens to dynamically assess feature reliability and guide adaptive fusion in the presence of missing modalities. In particular, we design a Dynamic Modality Quality Assessment (DMQA) module that employs learnable reference tokens to iteratively refine feature reliability assessment, enabling precise identification of degraded regions and providing quality guidance for subsequent fusion. Moreover, we develop an Orthogonal Constraint Normalization Fusion (OCNF) module that employs orthogonal constraints to preserve modality independence while dynamically adjusting fusion weights based on reliability scores, effectively suppressing unreliable feature propagation. Extensive experiments on the SpaceNet6-OTD and OGSOD-2.0 datasets demonstrate the superiority and effectiveness of QDFNet compared to state-of-the-art methods, particularly under partial modality corruption or missing data scenarios.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 27 of its 71 references that are in the map. First posted on arXiv 27 Dec 2025.
Builds on
27 of 71 references.
References · 27
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2017Multimodal Machine Learning: A Survey and Taxonomycited by 1,013
- 2022Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detectioncited by 317
- 2022Balanced Multimodal Learning via On-the-fly Gradient Modulationcited by 264
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 223
- 2016Semantic Image Inpainting with Deep Generative Modelscited by 157
- 2021Invertible Image Signal Processingcited by 94
- 2017Orthogonal Weight Normalization: Solution to Optimization over Multiple Dependent Stiefel Manifolds in Deep Neural Networkscited by 92
- 2021Cross-Modality Fusion Transformer for Multispectral Object Detectioncited by 86
- 2023ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detectioncited by 76
- 2023M3AE: Multimodal Representation Learning for Brain Tumor Segmentation with Missing Modalitiescited by 56
- 2024DrFuse: Learning Disentangled Representation for Clinical Multi-Modal Fusion with Missing Modality and Modal Inconsistencycited by 53
15 more
- 2022SuperYOLO: Super Resolution Assisted Object Detection in Multimodal Remote Sensing Imagerycited by 47
- 2022Learning in Audio-visual Context: A Review, Analysis, and New Perspectivecited by 44
- 2021Multimodal Remote Sensing Benchmark Datasets for Land Cover Classification with A Shared and Specific Feature Learning Modelcited by 43
- 2021Cross Modal Focal Loss for RGBD Face Anti-Spoofingcited by 41
- 2023MMANet: Margin-aware Distillation and Modality-aware Regularization for Incomplete Multimodal Learningcited by 40
- 2024CrossFuse: A Novel Cross Attention Mechanism based Infrared and Visible Image Fusion Approachcited by 38
- 2020Multi-Modal Face Anti-Spoofing Based on Central Difference Networkscited by 36
- 2017VIGAN: Missing View Imputation with Generative Adversarial Networkscited by 33
- 2024Token Transformation Matters: Towards Faithful Post-hoc Explanation for Vision Transformercited by 19
- 2023TFDet: Target-Aware Fusion for RGB-T Pedestrian Detectioncited by 18
- 2024PASSION: Towards Effective Incomplete Multi-Modal Medical Image Segmentation with Imbalanced Missing Ratescited by 17
- 2024Quantifying and Enhancing Multi-modal Robustness with Modality Preferencecited by 16
- 2021Feature-enhanced Generation and Multi-modality Fusion based Deep Neural Network for Brain Tumor Segmentation with Missing MR Modalitiescited by 13
- 2023Reliable Representation Learning for Incomplete Multi-View Missing Multi-Label Classificationcited by 12
- 2023Multi-view Inversion for 3D-aware Generative Adversarial Networkscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.