IB-HFN: Information Bottleneck-Driven SAR-Optical Fusion Network for High-Fidelity Cloud Removal
Not on the map. Why?
Abstract (arXiv)
Synthetic aperture radar (SAR)-assisted optical cloud removal aims to recover surface information obscured by clouds in optical remote sensing images by exploiting complementary SAR observations. Existing multimodal fusion methods typically rely on direct spatial concatenation and pixel-wise supervision, which can propagate SAR speckle noise into optical reconstruction and lead to over-smoothed results. To address these limitations, we propose an Information Bottleneck-driven High-Fidelity Network (IB-HFN) for SAR-assisted optical cloud removal. IB-HFN employs a dual-stream backbone to preserve modality-specific representations before deep semantic fusion, thereby mitigating premature cross-modal contamination. At the fusion stage, we introduce a Spatial Information Bottleneck Fusion module that compresses SAR features through a channel-wise variational information bottleneck to suppress unstructured speckle noise. In parallel, a local-global gating mechanism predicts clear-sky regions and routes reliable optical details through a Dirac-initialized skip connection, decoupling noise suppression from texture preservation. We further develop a joint optimization strategy that integrates feature-level bottleneck regularization with image-level constraints on reconstruction accuracy, structural consistency, spectral fidelity, and contrastive sharpness. A dynamic weighting schedule balances these objectives to stabilize training and reduce hazy artifacts. Experiments on the SEN12MS-CR dataset under challenging spatio-temporal splits demonstrate that IB-HFN achieves superior structural preservation and spectral fidelity over existing methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 49 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
25 of 49 references.
References · 25
- 2016Deep Variational Information Bottleneckcited by 915
- 2015Deep Learning and the Information Bottleneck Principlecited by 793
- 2021Contrastive Learning for Compact Single Image Dehazingcited by 219
- 2023Advancing Pose-Guided Image Synthesis with Progressive Conditional Diffusion Modelscited by 104
- 2024IMAGDressing-v1: Customizable Virtual Dressingcited by 100
- 2025Long-Term TalkingFace Generation via Motion-Prior Conditional Diffusion Modelcited by 49
- 2025IMAGGarment: Fine-Grained Garment Generation for Controllable Fashion Designcited by 36
- 2022SEN12MS-CR-TS: A Remote Sensing Data Set for Multi-modal Multi-temporal Cloud Removalcited by 32
- 2023UnCRtainTS: Uncertainty Quantification for Cloud Removal in Optical Satellite Time Seriescited by 28
- 2025IMAGHarmony: Controllable Image Editing with Consistent Object Quantity and Layoutcited by 28
- 2023DiffCR: A Fast Conditional Diffusion Framework for Cloud Removal from Optical Satellite Imagescited by 26
- 2022GLF-CR: SAR-Enhanced Cloud Removal with Global-Local Fusioncited by 24
13 more
- 2023Graph Information Bottleneck for Remote Sensing Segmentationcited by 24
- 2024IDF-CR: Iterative Diffusion Process for Divide-and-Conquer Cloud Removal in Remote-sensing Imagescited by 13
- 2025Projection Head is Secretly an Information Bottleneckcited by 11
- 2026VIB-Probe: Detecting and Mitigating Hallucinations in Vision-Language Models via Variational Information Bottleneckcited by 8
- 2025Comprehensive Information Bottleneck for Unveiling Universal Attribution to Interpret Vision Transformerscited by 6
- 2026Task-Driven Prompt Learning: A Joint Framework for Multi-modal Cloud Removal and Segmentationcited by 3
- 2025Multimodal Diffusion Bridge with Attention-Based SAR Fusion for Satellite Image Cloud Removalcited by 2
- 2025Information-Bottleneck Driven Binary Neural Network for Change Detectioncited by 2
- 2025Cloud-Aware SAR Fusion for Enhanced Optical Sensing in Space Missionscited by 1
- 2026SADER: Structure-Aware Diffusion Framework with DEterministic Resampling for Multi-Temporal Remote Sensing Cloud Removalcited by 1
- 2026Refining the Information Bottleneck via Adversarial Information Separationcited by 1
- 2026CBEN -- A Multimodal Machine Learning Dataset for Cloud Robust Remote Sensing Image Understandingcited by 1
- 2026ATT-CR: Adaptive Triangular Transformer for Cloud Removalcited by 1
Built on by
Not cited yet.