Boosting Flow-based Generative Super-Resolution Models via Learned Prior
Not on the map. Why?
Abstract (arXiv)
Flow-based super-resolution (SR) models have demonstrated astonishing capabilities in generating high-quality images. However, these methods encounter several challenges during image generation, such as grid artifacts, exploding inverses, and suboptimal results due to a fixed sampling temperature. To overcome these issues, this work introduces a conditional learned prior to the inference phase of a flow-based SR model. This prior is a latent code predicted by our proposed latent module conditioned on the low-resolution image, which is then transformed by the flow model into an SR image. Our framework is designed to seamlessly integrate with any contemporary flow-based SR model without modifying its architecture or pre-trained weights. We evaluate the effectiveness of our proposed framework through extensive experiments and ablation analyses. The proposed framework successfully addresses all the inherent issues in flow-based SR models and enhances their performance in various SR scenarios. Our code is available at: https://github.com/liyuantsao/BFSR
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 66 of its 81 references that are in the map. First posted on arXiv 16 Mar 2024.
Builds on
66 of 81 references.
References · 66
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2016Densely Connected Convolutional Networkscited by 6,691
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2017Neural Discrete Representation Learningcited by 4,650
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
38 more
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
- 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
- 2017The Perception-Distortion Tradeoffcited by 582
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
- 2017Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolutioncited by 452
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
- 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Modelscited by 415
- 2016Accelerating the Super-Resolution Convolutional Neural Networkcited by 393
- 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 369
- 2018Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Networkcited by 263
- 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
- 2017VAE with a VampPriorcited by 247
- 2018Deep Back-Projection Networks For Super-Resolutioncited by 224
- 2016Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoderscited by 219
- 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
- 2019Meta-SR: A Magnification-Arbitrary Network for Super-Resolutioncited by 180
- 2016Variational Lossy Autoencodercited by 175
- 2019RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolutioncited by 145
- 2019From Variational to Deterministic Autoencoderscited by 131
- 2021Local Texture Estimator for Implicit Representation Functioncited by 126
- 2022Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolutioncited by 114
- 2021Flow-based Kernel Prior with Application to Blind Super-Resolutioncited by 74
- 2021Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescalingcited by 73
- 2020Understanding and Mitigating Exploding Inverses in Invertible Neural Networkscited by 71
- 2016PixelVAE: A Latent Variable Model for Natural Imagescited by 69
- 2022CiaoSR: Continuous Implicit Attention-in-Attention Network for Arbitrary-Scale Image Super-Resolutioncited by 69
50 most cited of 66 All 66 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 3; 2026: 2.
7 papers.
- 2025The Power of Context: How Multimodality Improves Image Super-Resolutioncited by 15
- 2024HoliSDiP: Image Super-Resolution via Holistic Semantics and Diffusion Priorcited by 8
- 2025VQualA 2025 Challenge on Image Super-Resolution Generated Content Quality Assessment: Methods and Resultscited by 5
- 2026CASR: A Robust Cyclic Framework for Arbitrary Large-Scale Super-Resolution with Distribution Alignment and Self-Similarity Awarenesscited by 1
- 2026Tuning Real-World Image Restoration at Inference: A Test-Time Scaling Paradigm for Flow Matching Modelscited by 1
- 2024Image Quality Assessment: Enhancing Perceptual Exploration and Interpretation with Collaborative Feature Refinement and Hausdorff distancecited by 0
- 2025Stroke-based Cyclic Amplifier: Image Super-Resolution at Arbitrary Ultra-Large Scalescited by 0
- 2026Tuning Real-World Image Restoration at Inference: A Test-Time Scaling Paradigm for Flow Matching Models23 Mar 2026
- 2026CASR: A Robust Cyclic Framework for Arbitrary Large-Scale Super-Resolution with Distribution Alignment and Self-Similarity Awareness25 Feb 2026
- 2025VQualA 2025 Challenge on Image Super-Resolution Generated Content Quality Assessment: Methods and Results8 Sep 2025
- 2025Stroke-based Cyclic Amplifier: Image Super-Resolution at Arbitrary Ultra-Large Scales12 Jun 2025
- 2025The Power of Context: How Multimodality Improves Image Super-Resolution18 Mar 2025
- 2024Image Quality Assessment: Enhancing Perceptual Exploration and Interpretation with Collaborative Feature Refinement and Hausdorff distance20 Dec 2024
- 2024HoliSDiP: Image Super-Resolution via Holistic Semantics and Diffusion Prior27 Nov 2024