# Learning Multi-scale Spatial-frequency Features for Image Denoising

arXiv: https://arxiv.org/abs/2506.16307 · HTML: https://mlsanity.com/paper/2506.16307/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- Builds on 25 of its 47 references that are in the map.
- First posted on arXiv 19 Jun 2025.

## Builds on (most cited first, 25 of 25)

- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [SwinIR: Image Restoration Using Swin Transformer](https://mlsanity.com/paper/2108.10257/) (2021)
- [Restormer: Efficient Transformer for High-Resolution Image Restoration](https://mlsanity.com/paper/2111.09881/) (2021)
- [Enhanced Deep Residual Networks for Single Image Super-Resolution](https://mlsanity.com/paper/1707.02921/) (2017)
- [Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoising](https://mlsanity.com/paper/1608.03981/) (2016)
- [Uformer: A General U-Shaped Transformer for Image Restoration](https://mlsanity.com/paper/2106.03106/) (2021)
- [Benchmarking Denoising Algorithms with Real Photographs](https://mlsanity.com/paper/1707.01313/) (2017)
- [Fast and Accurate Image Super-Resolution with Deep Laplacian Pyramid Networks](https://mlsanity.com/paper/1710.01992/) (2017)
- [Wavelet-based Fourier Information Interaction with Frequency Diffusion Adjustment for Underwater Image Restoration](https://mlsanity.com/paper/2311.16845/) (2023)
- [Curricular Contrastive Regularization for Physics-aware Single Image Dehazing](https://mlsanity.com/paper/2303.14218/) (2023)
- [Fourier Space Losses for Efficient Perceptual Image Super-Resolution](https://mlsanity.com/paper/2106.00783/) (2021)
- [Exploiting Multimodal Spatial-temporal Patterns for Video Object Tracking](https://mlsanity.com/paper/2412.15691/) (2024)
- [SUNet: Swin Transformer UNet for Image Denoising](https://mlsanity.com/paper/2202.14009/) (2022)
- [Multi-stage image denoising with the wavelet transform](https://mlsanity.com/paper/2209.12394/) (2022)
- [Toward Sufficient Spatial-Frequency Interaction for Gradient-aware Underwater Image Enhancement](https://mlsanity.com/paper/2309.04089/) (2023)
- [Variational Deep Image Restoration](https://mlsanity.com/paper/2207.01074/) (2022)
- [Designing and Training of A Dual CNN for Image Denoising](https://mlsanity.com/paper/2007.03951/) (2020)
- [Multi-Scale Adaptive Network for Single Image Denoising](https://mlsanity.com/paper/2203.04313/) (2022)
- [Deep Height Decoupling for Precise Vision-based 3D Occupancy Prediction](https://mlsanity.com/paper/2409.07972/) (2024)
- [DORNet: A Degradation Oriented and Regularized Network for Blind Depth Super-Resolution](https://mlsanity.com/paper/2410.11666/) (2024)
- [Occluded Person Re-Identification with Deep Learning: A Survey and Perspectives](https://mlsanity.com/paper/2311.00603/) (2023)
- [SHaRPose: Sparse High-Resolution Representation for Human Pose Estimation](https://mlsanity.com/paper/2312.10758/) (2023)
- [Dual Residual Attention Network for Image Denoising](https://mlsanity.com/paper/2305.04269/) (2023)
- [NODE-ImgNet: a PDE-informed effective and robust model for image denoising](https://mlsanity.com/paper/2305.11049/) (2023)
- [Not All Parameters Matter: Masking Diffusion Models for Enhancing Generation Ability](https://mlsanity.com/paper/2505.03097/) (2025)

## Built on by (most cited first, 7 of 7)

- [LUVE : Latent-Cascaded Ultra-High-Resolution Video Generation with Dual Frequency Experts](https://mlsanity.com/paper/2602.11564/) (2026)
- [From Zero to Detail: A Progressive Spectral Decoupling Paradigm for UHD Image Restoration with New Benchmark](https://mlsanity.com/paper/2604.15654/) (2026)
- [Temporal and Cross-Modal Alignment for Enhanced Audiovisual Video Captioning](https://mlsanity.com/paper/2607.01667/) (2026)
- [Spiking Pyramid Wavelet Transformation for High-efficient and Low-energy Image Restoration](https://mlsanity.com/paper/2606.18644/) (2026)
- [Personalized federated prototype learning in mixed heterogeneous data scenarios](https://mlsanity.com/paper/2510.03726/) (2025)
- [Cross-Layer Feature Self-Attention Module for Multi-Scale Object Detection](https://mlsanity.com/paper/2510.14726/) (2025)
- [Structured Stateful Relational Scripts with a High-Quality Dataset for Multi-Shot Audio-Visual Video Generation](https://mlsanity.com/paper/2610.15512/) (2026)

## Abstract (arXiv)

Recent advancements in multi-scale architectures have demonstrated exceptional performance in image denoising tasks. However, existing architectures mainly depends on a fixed single-input single-output Unet architecture, ignoring the multi-scale representations of pixel level. In addition, previous methods treat the frequency domain uniformly, ignoring the different characteristics of high-frequency and low-frequency noise. In this paper, we propose a novel multi-scale adaptive dual-domain network (MADNet) for image denoising. We use image pyramid inputs to restore noise-free results from low-resolution images. In order to realize the interaction of high-frequency and low-frequency information, we design an adaptive spatial-frequency learning unit (ASFU), where a learnable mask is used to separate the information into high-frequency and low-frequency components. In the skip connections, we design a global feature fusion block to enhance the features at different scales. Extensive experiments on both synthetic and real noisy image datasets verify the effectiveness of MADNet compared with current state-of-the-art denoising approaches.
