mlsanityData to 7 Oct 2026

Boosting Flow-based Generative Super-Resolution Models via Learned Prior

arXiv 2403.10988 ↗First posted 16 Mar 2024cs.CV cs.AIcited by 7

Not on the map. Why?

Abstract (arXiv)

Flow-based super-resolution (SR) models have demonstrated astonishing capabilities in generating high-quality images. However, these methods encounter several challenges during image generation, such as grid artifacts, exploding inverses, and suboptimal results due to a fixed sampling temperature. To overcome these issues, this work introduces a conditional learned prior to the inference phase of a flow-based SR model. This prior is a latent code predicted by our proposed latent module conditioned on the low-resolution image, which is then transformed by the flow model into an SR image. Our framework is designed to seamlessly integrate with any contemporary flow-based SR model without modifying its architecture or pre-trained weights. We evaluate the effectiveness of our proposed framework through extensive experiments and ablation analyses. The proposed framework successfully addresses all the inherent issues in flow-based SR models and enhances their performance in various SR scenarios. Our code is available at: https://github.com/liyuantsao/BFSR

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 66 of its 81 references that are in the map. First posted on arXiv 16 Mar 2024.

Builds on

66 of 81 references.

References · 66

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  7. 2016Densely Connected Convolutional Networkscited by 6,691
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  9. 2017Neural Discrete Representation Learningcited by 4,650
  10. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  11. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  12. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
38 more
  1. 2015Variational Inference with Normalizing Flowscited by 2,161
  2. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  3. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  4. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  5. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  6. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
  7. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  8. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  9. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  10. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
  11. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  12. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
  13. 2018Residual Dense Network for Image Super-Resolutioncited by 796
  14. 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 636
  15. 2017The Perception-Distortion Tradeoffcited by 582
  16. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
  17. 2017Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolutioncited by 452
  18. 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
  19. 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Modelscited by 415
  20. 2016Accelerating the Super-Resolution Convolutional Neural Networkcited by 393
  21. 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 369
  22. 2018Fast, Accurate, and Lightweight Super-Resolution with Cascading Residual Networkcited by 263
  23. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
  24. 2017VAE with a VampPriorcited by 247
  25. 2018Deep Back-Projection Networks For Super-Resolutioncited by 224
  26. 2016Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoderscited by 219
  27. 2020SRFlow: Learning the Super-Resolution Space with Normalizing Flowcited by 209
  28. 2019Meta-SR: A Magnification-Arbitrary Network for Super-Resolutioncited by 180
  29. 2016Variational Lossy Autoencodercited by 175
  30. 2019RankSRGAN: Generative Adversarial Networks with Ranker for Image Super-Resolutioncited by 145
  31. 2019From Variational to Deterministic Autoencoderscited by 131
  32. 2021Local Texture Estimator for Implicit Representation Functioncited by 126
  33. 2022Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolutioncited by 114
  34. 2021Flow-based Kernel Prior with Application to Blind Super-Resolutioncited by 74
  35. 2021Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescalingcited by 73
  36. 2020Understanding and Mitigating Exploding Inverses in Invertible Neural Networkscited by 71
  37. 2016PixelVAE: A Latent Variable Model for Natural Imagescited by 69
  38. 2022CiaoSR: Continuous Implicit Attention-in-Attention Network for Arbitrary-Scale Image Super-Resolutioncited by 69

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 3; 2026: 2.

7 papers.