mlsanityData to 14 Oct 2026

DiffFNO: Diffusion Fourier Neural Operator

arXiv 2411.09911 ↗First posted 15 Nov 2024cs.CVcited by 13

Not on the map. Why?

Abstract (arXiv)

We introduce DiffFNO, a novel diffusion framework for arbitrary-scale super-resolution strengthened by a Weighted Fourier Neural Operator (WFNO). Mode Rebalancing in WFNO effectively captures critical frequency components, significantly improving the reconstruction of high-frequency image details that are crucial for super-resolution tasks. Gated Fusion Mechanism (GFM) adaptively complements WFNO's spectral features with spatial features from an Attention-based Neural Operator (AttnNO). This enhances the network's capability to capture both global structures and local details. Adaptive Time-Step (ATS) ODE solver, a deterministic sampling strategy, accelerates inference without sacrificing output quality by dynamically adjusting integration step sizes ATS. Extensive experiments demonstrate that DiffFNO achieves state-of-the-art (SOTA) results, outperforming existing methods across various scaling factors by a margin of 2-4 dB in PSNR, including those beyond the training distribution. It also achieves this at lower inference time. Our approach sets a new standard in super-resolution, delivering both superior accuracy and computational efficiency.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 45 of its 59 references that are in the map. First posted on arXiv 15 Nov 2024.

Builds on

45 of 59 references.

References · 45

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2020Denoising Diffusion Implicit Modelscited by 9,781
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
  6. 2017Squeeze-and-Excitation Networkscited by 4,789
  7. 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
  8. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,908
  9. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  10. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  11. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
  12. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
33 more
  1. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  2. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
  3. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  4. 2018On the Spectral Bias of Neural Networkscited by 1,341
  5. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
  6. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
  7. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  8. 2018Residual Dense Network for Image Super-Resolutioncited by 799
  9. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  10. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
  11. 2021Physics-Informed Neural Operator for Learning Partial Differential Equationscited by 527
  12. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
  13. 2022Activating More Pixels in Image Super-Resolution Transformercited by 438
  14. 2022Fourier Neural Operator with Learned Deformations for PDEs on General Geometriescited by 427
  15. 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Modelscited by 415
  16. 2021Choose a Transformer: Fourier or Galerkincited by 343
  17. 2022Analytic-DPM: an Analytic Estimate of the Optimal Reverse Variance in Diffusion Probabilistic Modelscited by 334
  18. 2021Factorized Fourier Neural Operatorscited by 249
  19. 2021Multiwavelet-based Operator Learning for Differential Equationscited by 234
  20. 2021Score-Based Generative Modeling with Critically-Damped Langevin Diffusioncited by 233
  21. 2023Implicit Diffusion Models for Continuous Super-Resolutioncited by 218
  22. 2015Conditional Random Fields as Recurrent Neural Networkscited by 214
  23. 2019Meta-SR: A Magnification-Arbitrary Network for Super-Resolutioncited by 181
  24. 2022Fast Sampling of Diffusion Models via Operator Learningcited by 175
  25. 2021On Fast Sampling of Diffusion Probabilistic Modelscited by 170
  26. 2021Transformer for Single Image Super-Resolutioncited by 150
  27. 2021Local Texture Estimator for Implicit Representation Functioncited by 127
  28. 2024Align Your Steps: Optimizing Sampling Schedules in Diffusion Modelscited by 96
  29. 2023AutoDiffusion: Training-Free Optimization of Time Steps and Architectures for Automated Diffusion Model Accelerationcited by 70
  30. 2023Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolutioncited by 52
  31. 2023Super-Resolution Neural Operatorcited by 49
  32. 2023Fourier Neural Operators for Arbitrary Resolution Climate Data Downscalingcited by 26
  33. 2024Hierarchical Neural Operator Transformer with Learnable Frequency-aware Loss Prior for Arbitrary-scale Super-resolutioncited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 8.

13 papers.

Sort:

By area:

  1. 2025FreqPolicy: Frequency Autoregressive Visuomotor Policy with Continuous Tokenscited by 9
  2. 2026Learning PDE Solvers with Physics and Data: A Unifying View of Physics-Informed Neural Networks and Neural Operatorscited by 6
  3. 2025Mechanistic Interpretability with Sparse Autoencoder Neural Operatorscited by 3
  4. 2024MGHF: Multi-Granular High-Frequency Perceptual Loss for Image Super-Resolutioncited by 2
  5. 2025Operator Flow Matching for Timeseries Forecastingcited by 1
  6. 2026Adaptive Physics Transformer with Fused Global-Local Attention for Subsurface Energy Systemscited by 1
  7. 2026Beyond Visual Fidelity: Benchmarking Super-Resolution Models for Large-Scale Remote Sensing Imagery via Downstream Task Integrationcited by 1
  8. 2025GeoFunFlow: Geometric Function Flow Matching for Inverse Operator Learning over Complex Geometriescited by 0
  9. 2026UFO: A Domain-Unification-Free Operator Framework for Generalized Operator Learningcited by 0
  10. 2026Discontinuous Galerkin Neural Operator for Pathology Defocus Deblurringcited by 0
  11. 2026Starter-Iterator Neural Operator: A Unified Architecture for High-Fidelity Forward and Inverse PDE Problemscited by 0
  12. 2026Dual-Prior Guided Null-Space Learning with Mixture-of-Splines for Arbitrary Medical Slice Super-Resolutioncited by 0
1 more
  1. 2026LaST-SR: Laplace-Inspired Steady-Transient Complex-Frequency Decomposition for Single Image Super-Resolutioncited by 0