FreqOrtho-SR: Frequency-Guided Orthogonal Expert Learning for Real-World Image Super-Resolution
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Diffusion prior-based methods have shown impressive results in real-world image super-resolution (ISR), yet two key challenges persist: balancing pixel-level fidelity with semantic quality, and adapting to diverse degradations. Existing dual-branch approaches freeze the pixel module during semantic training, but the semantic branch can still expand capacity within the pixel subspace, precluding genuine perceptual improvement. Moreover, using a single static adapter cannot generalize across heterogeneous real-world corruptions. To address both issues, we propose FreqOrtho-SR, which comprises: Frequency-guided Mixture of LoRA Experts (FreqMoE), it routes inputs to specialized experts via a non-parametric FFT-based degradation-feature extractor that encodes frequency-domain signatures, enabling stable and interpretable specialization across corruption types; and Orthogonal Gradient Projection (OGP), which reframes the dual-objective optimization as a subspace-constrained problem: by extracting the pixel-fidelity subspace via SVD on combined expert weight deltas and projecting semantic gradients onto its null space, OGP guarantees orthogonality between the two objectives, enabling genuinely complementary learning without mutual interference. Experiments show that FreqOrtho-SR achieves competitive overall performance and a strong fidelity-perception trade-off across multiple benchmarks with efficient single-step inference. The source code of our method can be found at hrefhttps://github.com/sonhm3029/FreqOrtho-SRtextttsonhm3029/FreqOrtho-SR.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 57 of its 82 references that are in the map. First posted on arXiv 27 Jun 2026.
Builds on
57 of 82 references.
Closest ancestors · 11
Same direction, newest first
- 2025Fine-structure Preserved Real-world Image Super-resolution via Transfer VAE Training27 Jul
- 2024Arbitrary-steps Image Super-resolution via Diffusion Inversion12 Dec
- 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approach4 Dec
- 2024TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolution27 Nov
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolution12 Jun
- 2024AddSR: Accelerating Diffusion-based Blind Super-Resolution with Adversarial Diffusion Distillation2 Apr
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution27 Nov
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Step23 Nov
- 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization28 Aug
- 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting23 Jul
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May
Other references · 46
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
- 2017Gradient Episodic Memory for Continual Learningcited by 1,898
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
34 more
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 903
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2022Mixture-of-Experts with Expert Choice Routingcited by 623
- 2017The Perception-Distortion Tradeoffcited by 587
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
- 2019Deep Learning for Image Super-resolution: A Surveycited by 369
- 2019Orthogonal Gradient Descent for Continual Learningcited by 369
- 2021Gradient Projection Memory for Continual Learningcited by 348
- 2019On Tiny Episodic Memories in Continual Learningcited by 307
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
- 2021Global Filter Networks for Image Classificationcited by 260
- 2023From Sparse to Soft Mixtures of Expertscited by 248
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 246
- 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
- 2018Continual Learning of Context-dependent Processing in Neural Networkscited by 179
- 2021Training Networks in Null Space of Feature Covariance for Continual Learningcited by 143
- 2023Text-to-3D with Classifier Score Distillationcited by 128
- 2021Continual World: A Robotic Benchmark For Continual Reinforcement Learningcited by 116
- 2022Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolutioncited by 114
- 2022Efficient and Degradation-Adaptive Network for Real-World Image Super-Resolutioncited by 96
- 2021ClassSR: A General Framework to Accelerate Super-Resolution Networks by Data Characteristiccited by 81
- 2023SwinFSR: Stereo Image Super-Resolution using SwinIR and Frequency Domain Knowledgecited by 10
- 2024Channel-Partitioned Windowed Attention And Frequency Learning for Single Image Super-Resolutioncited by 5
- 2025VSRM: A Robust Mamba-Based Framework for Video Super-Resolutioncited by 5
- 2026SAT: Selective Aggregation Transformer for Image Super-Resolutioncited by 2
- 2025Mixture of Ranks with Degradation-Aware Routing for One-Step Real-World Image Super-Resolutioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Realism Control One-step Diffusion for Real-World Image Super-Resolution
- 2026Q-DiT4SR: Exploration of Detail-Preserving Diffusion Transformer Quantization for Real-World Image Super-Resolution
- 2023Image Super-resolution Via Latent Diffusion: A Sampling-space Mixture Of Experts And Frequency-augmented Decoder Approach
- 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priors
- 2026SRGAN-CKAN: Expressive Super-Resolution with Nonlinear Functional Operators under Minimal Resources
- 2025RealSR-R1: Reinforcement Learning for Real-World Image Super-Resolution with Vision-Language Chain-of-Thought
- 2024DeeDSR: Towards Real-World Image Super-Resolution via Degradation-Aware Stable Diffusion
- 2025FRAMER: Frequency-Aligned Self-Distillation with Adaptive Modulation Leveraging Diffusion Priors for Real-World Image Super-Resolution