PAD: Phase-Amplitude Decoupling Fusion for Multi-Modal Land Cover Classification
Not on the map. Why?
Abstract (arXiv)
The fusion of Synthetic Aperture Radar (SAR) and RGB imagery for land cover classification remains challenging due to modality heterogeneity and underexploited spectral complementarity. Existing approaches often fail to decouple shared structural features from modality-complementary radiometric attributes, resulting in feature conflicts and information loss. To address this, we propose Phase-Amplitude Decoupling (PAD), a frequency-aware framework that separates phase (modality-shared) and amplitude (modality-complementary) components in the Fourier domain. This design reinforces shared structures while preserving complementary characteristics, thereby enhancing fusion quality. Unlike previous methods that overlook the distinct physical properties encoded in frequency spectra, PAD explicitly introduces amplitude-phase decoupling for multi-modal fusion. Specifically, PAD comprises two key components: 1) Phase Spectrum Correction (PSC), which aligns cross-modal phase features via convolution-guided scaling to improve geometric consistency; and 2) Amplitude Spectrum Fusion (ASF), which dynamically integrates high- and low-frequency patterns using frequency-adaptive multilayer perceptrons, effectively exploiting SAR's morphological sensitivity and RGB's spectral richness. Extensive experiments on WHU-OPT-SAR and DDHR-SK demonstrate state-of-the-art performance. This work establishes a new paradigm for physics-aware multi-modal fusion in remote sensing. The code will be available at https://github.com/RanFeng2/PAD.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 31 of its 68 references that are in the map. First posted on arXiv 27 Apr 2025.
Builds on
31 of 68 references.
References · 31
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
- 2018Dual Attention Network for Scene Segmentationcited by 1,001
- 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
- 2021Global Filter Networks for Image Classificationcited by 257
- 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
- 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
- 2022Efficient Frequency Domain-based Transformers for High-Quality Image Deblurringcited by 164
19 more
- 2020Style Normalization and Restitution for Generalizable Person Re-identificationcited by 136
- 2022Multimodal Token Fusion for Vision Transformerscited by 132
- 2020More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classificationcited by 126
- 2020Deep Multimodal Fusion by Channel Exchangingcited by 117
- 2018CGNet: A Light-weight Context Guided Network for Semantic Segmentationcited by 94
- 2022PIDNet: A Real-time Semantic Segmentation Network Inspired by PID Controllerscited by 84
- 2022Deep Learning in Multimodal Remote Sensing Data Fusion: A Comprehensive Reviewcited by 73
- 2021Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domaincited by 70
- 2024Frequency-aware Feature Fusion for Dense Image Predictioncited by 48
- 2024Frequency-Assisted Mamba for Remote Sensing Image Super-Resolutioncited by 47
- 2022Deep Frequency Filtering for Domain Generalizationcited by 41
- 2023Decompose, Adjust, Compose: Effective Normalization by Playing with Frequency for Domain Generalizationcited by 25
- 2018Identifying Corresponding Patches in SAR and Optical Images with a Pseudo-Siamese CNNcited by 18
- 2022Refined Semantic Enhancement towards Frequency Diffusion for Video Captioningcited by 18
- 2024A Unified Framework with Multimodal Fine-tuning for Remote Sensing Semantic Segmentationcited by 15
- 2024MaDiNet: Mamba Diffusion Network for SAR Target Detectioncited by 13
- 2024Fourier-enhanced Implicit Neural Fusion Network for Multispectral and Hyperspectral Image Fusioncited by 10
- 2024ASANet: Asymmetric Semantic Aligning Network for RGB and SAR image land cover classificationcited by 10
- 2024Complementary Advantages: Exploiting Cross-Field Frequency Correlation for NIR-Assisted Image Denoisingcited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.