mlsanityData to 14 Oct 2026

Efficient Frequency Domain-based Transformers for High-Quality Image Deblurring

arXiv 2211.12250 ↗First posted 22 Nov 2022cs.CVcited by 165

Not on the map. Why?

Abstract (arXiv)

We present an effective and efficient method that explores the properties of Transformers in the frequency domain for high-quality image deblurring. Our method is motivated by the convolution theorem that the correlation or convolution of two signals in the spatial domain is equivalent to an element-wise product of them in the frequency domain. This inspires us to develop an efficient frequency domain-based self-attention solver (FSAS) to estimate the scaled dot-product attention by an element-wise product operation instead of the matrix multiplication in the spatial domain. In addition, we note that simply using the naive feed-forward network (FFN) in Transformers does not generate good deblurred results. To overcome this problem, we propose a simple yet effective discriminative frequency domain-based FFN (DFFN), where we introduce a gated mechanism in the FFN based on the Joint Photographic Experts Group (JPEG) compression algorithm to discriminatively determine which low- and high-frequency information of the features should be preserved for latent clear image restoration. We formulate the proposed FSAS and DFFN into an asymmetrical network based on an encoder and decoder architecture, where the FSAS is only used in the decoder module for better image deblurring. Experimental results show that the proposed method performs favorably against the state-of-the-art approaches. Code will be available at urlhttps://github.com/kkkls/FFTformer.

Key facts. Cited by 165 papers in the map (data through 14 Oct 2026). Builds on 31 of its 40 references that are in the map. First posted on arXiv 22 Nov 2022.

Builds on

31 of 40 references.

References · 31

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2020End-to-End Object Detection with Transformerscited by 7,414
  5. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  6. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  7. 2020GLU Variants Improve Transformercited by 1,804
  8. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  9. 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,369
  10. 2020Pre-Trained Image Processing Transformercited by 893
  11. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 866
  12. 2021Multi-Stage Progressive Image Restorationcited by 816
19 more
  1. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
  2. 2022Simple Baselines for Image Restorationcited by 708
  3. 2017DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networkscited by 367
  4. 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 362
  5. 2018Scale-recurrent Network for Deep Image Deblurringcited by 333
  6. 2021Rethinking Coarse-to-Fine Approach in Single Image Deblurringcited by 326
  7. 2022MAXIM: Multi-Axis MLP for Image Processingcited by 302
  8. 2021Co-Scale Conv-Attentional Image Transformerscited by 224
  9. 2019Deep Stacked Hierarchical Multi-patch Network for Image Deblurringcited by 206
  10. 2017Image De-raining Using a Conditional Generative Adversarial Networkcited by 197
  11. 2020Human-Aware Motion Deblurringcited by 175
  12. 2022Stripformer: Strip Transformer for Fast Image Deblurringcited by 140
  13. 2022Multi-class Token Transformer for Weakly Supervised Semantic Segmentationcited by 138
  14. 2020Spatially-Attentive Patch-Hierarchical Network for Adaptive Motion Deblurringcited by 119
  15. 2021Improving Image Restoration by Revisiting Global Information Aggregationcited by 61
  16. 2021Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Predictioncited by 57
  17. 2021BANet: Blur-aware Attention Networks for Dynamic Scene Deblurringcited by 45
  18. 2018Physics-Based Generative Adversarial Models for Image Restoration and Beyondcited by 37
  19. 2021DWDN: Deep Wiener Deconvolution Network for Non-Blind Image Deblurringcited by 36

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 9; 2024: 46; 2025: 69; 2026: 40.

165 papers.

Sort:

By area:

  1. 2024AdaIR: Adaptive All-in-One Image Restoration via Frequency Mining and Modulationcited by 111
  2. 2023Hierarchical Integration Diffusion Model for Realistic Image Deblurringcited by 88
  3. 2024Complexity Experts are Task-Discriminative Learners for Any Image Restorationcited by 77
  4. 2024DarkIR: Robust Low-Light Image Restorationcited by 48
  5. 2024BAGS: Blur Agnostic Gaussian Splatting through Multi-Scale Kernel Modelingcited by 42
  6. 2023Image Restoration Through Generalized Ornstein-Uhlenbeck Bridgecited by 41
  7. 2024Correlation Matching Transformation Transformers for UHD Image Restorationcited by 39
  8. 2024FoundIR: Unleashing Million-scale Training Data to Advance Foundation Models for Image Restorationcited by 39
  9. 2024DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Modelscited by 34
  10. 2024Efficient Visual State Space Model for Image Deblurringcited by 29
  11. 2024FMA-Net: Flow-Guided Dynamic Filtering and Iterative Feature Refinement with Multi-Attention for Joint Video Super-Resolution and Deblurringcited by 28
  12. 2024Learning Enriched Features via Selective State Spaces Model for Efficient Image Deblurringcited by 25
38 more
  1. 2024AdaRevD: Adaptive Patch Exiting Reversible Decoder Pushes the Limit of Image Deblurringcited by 25
  2. 2023Efficient Multi-scale Network with Learnable Discrete Wavelet Transform for Blind Motion Deblurringcited by 24
  3. 2024CU-Mamba: Selective State Space Models with Channel Learning for Image Restorationcited by 24
  4. 2025From Zero to Detail: Deconstructing Ultra-High-Definition Image Restoration from Progressive Spectral Perspectivecited by 23
  5. 2023Prompt-based Ingredient-Oriented All-in-One Image Restorationcited by 22
  6. 2024Towards Real-world Event-guided Low-light Video Enhancement and Deblurringcited by 22
  7. 2025NTIRE 2025 Challenge on Day and Night Raindrop Removal for Dual-Focused Images: Methods and Resultscited by 22
  8. 2024Effective Diffusion Transformer Architecture for Image Super-Resolutioncited by 21
  9. 2023ID-Blau: Image Deblurring by Implicit Diffusion-based reBLurring AUgmentationcited by 20
  10. 2024Motion-adaptive Separable Collaborative Filters for Blind Motion Deblurringcited by 20
  11. 2024LoFormer: Local Frequency Transformer for Image Deblurringcited by 20
  12. 2024Deblur4DGS: 4D Gaussian Splatting from Blurry Monocular Videocited by 20
  13. 2024Dropout the High-rate Downsampling: A Novel Design Paradigm for UHD Image Restorationcited by 19
  14. 2024Seeing the Unseen: A Frequency Prompt Guided Transformer for Image Restorationcited by 18
  15. 2025Instant GaussianImage: A Generalizable and Self-Adaptive Image Representation via 2D Gaussian Splattingcited by 18
  16. 2023Mixed Hierarchy Network for Image Restorationcited by 14
  17. 2023Multi-task Image Restoration Guided By Robust DINO Featurescited by 14
  18. 2024Ultra-High-Definition Image Restoration: New Benchmarks and A Dual Interaction Prior-Driven Solutioncited by 14
  19. 2026ClearAIR: A Human-Visual-Perception-Inspired All-in-One Image Restorationcited by 12
  20. 2024FSTA-SNN:Frequency-based Spatial-Temporal Attention Module for Spiking Neural Networkscited by 10
  21. 2025Intra and Inter Parser-Prompted Transformers for Effective Image Restorationcited by 10
  22. 2025Gradient as Conditions: Rethinking HOG for All-in-one Image Restorationcited by 10
  23. 2024NTIRE 2024 Restore Any Image Model (RAIM) in the Wild Challengecited by 9
  24. 2024MixNet: Efficient Global Modeling for Ultra-High-Definition Image Restorationcited by 8
  25. 2025DeblurDiff: Real-World Image Deblurring with Generative Diffusion Modelscited by 8
  26. 2025Dual-domain Modulation Network for Lightweight Image Super-Resolutioncited by 8
  27. 2025Efficient Degradation-agnostic Image Restoration via Channel-Wise Functional Decomposition and Manifold Regularizationcited by 8
  28. 2026Scan Clusters, Not Pixels: A Cluster-Centric Paradigm for Efficient Ultra-high-definition Image Restorationcited by 8
  29. 2025EvoIR: Towards All-in-One Image Restoration via Evolutionary Frequency Modulationcited by 7
  30. 2026Neural Discrimination-Prompted Transformers for Efficient UHD Image Restoration and Enhancementcited by 7
  31. 2026From Zero to Detail: A Progressive Spectral Decoupling Paradigm for UHD Image Restoration with New Benchmarkcited by 7
  32. 2024RSHazeDiff: A Unified Fourier-aware Diffusion Model for Remote Sensing Image Dehazingcited by 6
  33. 2024A Hybrid Transformer-Mamba Network for Single Image Derainingcited by 6
  34. 2025MP-HSIR: A Multi-Prompt Framework for Universal Hyperspectral Image Restorationcited by 6
  35. 2025Deep Learning-Driven Ultra-High-Definition Image Restoration: A Surveycited by 6
  36. 2024Deep learning in motion deblurring: current status, benchmarks and future prospectscited by 5
  37. 2024Learning to Deblur Polarized Imagescited by 5
  38. 2024Complementary Advantages: Exploiting Cross-Field Frequency Correlation for NIR-Assisted Image Denoisingcited by 5

50 most cited of 165 All 165 (JSON)