mlsanityData to 7 Oct 2026

PAD: Phase-Amplitude Decoupling Fusion for Multi-Modal Land Cover Classification

arXiv 2504.19136 ↗First posted 27 Apr 2025cs.CV cs.AI eess.IVcited by 2

Not on the map. Why?

Abstract (arXiv)

The fusion of Synthetic Aperture Radar (SAR) and RGB imagery for land cover classification remains challenging due to modality heterogeneity and underexploited spectral complementarity. Existing approaches often fail to decouple shared structural features from modality-complementary radiometric attributes, resulting in feature conflicts and information loss. To address this, we propose Phase-Amplitude Decoupling (PAD), a frequency-aware framework that separates phase (modality-shared) and amplitude (modality-complementary) components in the Fourier domain. This design reinforces shared structures while preserving complementary characteristics, thereby enhancing fusion quality. Unlike previous methods that overlook the distinct physical properties encoded in frequency spectra, PAD explicitly introduces amplitude-phase decoupling for multi-modal fusion. Specifically, PAD comprises two key components: 1) Phase Spectrum Correction (PSC), which aligns cross-modal phase features via convolution-guided scaling to improve geometric consistency; and 2) Amplitude Spectrum Fusion (ASF), which dynamically integrates high- and low-frequency patterns using frequency-adaptive multilayer perceptrons, effectively exploiting SAR's morphological sensitivity and RGB's spectral richness. Extensive experiments on WHU-OPT-SAR and DDHR-SK demonstrate state-of-the-art performance. This work establishes a new paradigm for physics-aware multi-modal fusion in remote sensing. The code will be available at https://github.com/RanFeng2/PAD.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 31 of its 68 references that are in the map. First posted on arXiv 27 Apr 2025.

Builds on

31 of 68 references.

References · 31

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,923
  3. 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,338
  4. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  5. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
  6. 2018Dual Attention Network for Scene Segmentationcited by 1,001
  7. 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
  8. 2021Global Filter Networks for Image Classificationcited by 257
  9. 2021Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformerscited by 237
  10. 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
  11. 2022CDDFuse: Correlation-Driven Dual-Branch Feature Decomposition for Multi-Modality Image Fusioncited by 222
  12. 2022Efficient Frequency Domain-based Transformers for High-Quality Image Deblurringcited by 164
19 more
  1. 2020Style Normalization and Restitution for Generalizable Person Re-identificationcited by 136
  2. 2022Multimodal Token Fusion for Vision Transformerscited by 132
  3. 2020More Diverse Means Better: Multimodal Deep Learning Meets Remote Sensing Imagery Classificationcited by 126
  4. 2020Deep Multimodal Fusion by Channel Exchangingcited by 117
  5. 2018CGNet: A Light-weight Context Guided Network for Semantic Segmentationcited by 94
  6. 2022PIDNet: A Real-time Semantic Segmentation Network Inspired by PID Controllerscited by 84
  7. 2022Deep Learning in Multimodal Remote Sensing Data Fusion: A Comprehensive Reviewcited by 73
  8. 2021Amplitude-Phase Recombination: Rethinking Robustness of Convolutional Neural Networks in Frequency Domaincited by 70
  9. 2024Frequency-aware Feature Fusion for Dense Image Predictioncited by 48
  10. 2024Frequency-Assisted Mamba for Remote Sensing Image Super-Resolutioncited by 47
  11. 2022Deep Frequency Filtering for Domain Generalizationcited by 41
  12. 2023Decompose, Adjust, Compose: Effective Normalization by Playing with Frequency for Domain Generalizationcited by 25
  13. 2018Identifying Corresponding Patches in SAR and Optical Images with a Pseudo-Siamese CNNcited by 18
  14. 2022Refined Semantic Enhancement towards Frequency Diffusion for Video Captioningcited by 18
  15. 2024A Unified Framework with Multimodal Fine-tuning for Remote Sensing Semantic Segmentationcited by 15
  16. 2024MaDiNet: Mamba Diffusion Network for SAR Target Detectioncited by 13
  17. 2024Fourier-enhanced Implicit Neural Fusion Network for Multispectral and Hyperspectral Image Fusioncited by 10
  18. 2024ASANet: Asymmetric Semantic Aligning Network for RGB and SAR image land cover classificationcited by 10
  19. 2024Complementary Advantages: Exploiting Cross-Field Frequency Correlation for NIR-Assisted Image Denoisingcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.