mlsanityData to 14 Oct 2026

Chain-of-Zoom: Extreme Super-Resolution via Scale Autoregression and Preference Alignment

arXiv 2505.18600 ↗First posted 24 May 2025cs.CV cs.AI cs.LGcited by 8

On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment

Abstract (arXiv)

Modern single-image super-resolution (SISR) models deliver photo-realistic results at the scale factors on which they are trained, but collapse when asked to magnify far beyond that regime. We address this scalability bottleneck with Chain-of-Zoom (CoZ), a model-agnostic framework that factorizes SISR into an autoregressive chain of intermediate scale-states with multi-scale-aware prompts. CoZ repeatedly re-uses a backbone SR model, decomposing the conditional probability into tractable sub-problems to achieve extreme resolutions without additional training. Because visual cues diminish at high magnifications, we augment each zoom step with multi-scale-aware text prompts generated by a vision-language model (VLM). The prompt extractor itself is fine-tuned using Generalized Reward Policy Optimization (GRPO) with a critic VLM, aligning text guidance towards human preference. Experiments show that a standard 4x diffusion SR model wrapped in CoZ attains beyond 256x enlargement with high perceptual quality and fidelity. Project Page: https://bryanswkim.github.io/chain-of-zoom/.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 45 of its 61 references that are in the map. First posted on arXiv 24 May 2025.

Builds on

45 of 61 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Aligning Large Multimodal Models with Factually Augmented RLHF25 Sep

Other references · 44

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  5. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  6. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  7. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
  8. 2021Image Super-Resolution via Iterative Refinementcited by 1,511
  9. 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
  10. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
  11. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
  12. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
32 more
  1. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  2. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  3. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  4. 2016Conditional Image Generation with PixelCNN Decoderscited by 862
  5. 2016Pixel Recurrent Neural Networkscited by 816
  6. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
  7. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  8. 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 508
  9. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
  10. 2019Deep Learning for Image Super-resolution: A Surveycited by 369
  11. 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
  12. 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
  13. 2025Demystifying Long Chain-of-Thought Reasoning in LLMscited by 326
  14. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 315
  15. 2017"Zero-Shot" Super-Resolution using Deep Internal Learningcited by 286
  16. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  17. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
  18. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
  19. 2024LLaVA-Critic: Learning to Evaluate Multimodal Modelscited by 134
  20. 2023Decomposed Diffusion Sampler for Accelerating Large-Scale Inverse Problemscited by 132
  21. 2022Any-resolution Training for High-resolution Image Synthesiscited by 72
  22. 2023Prompt-tuning latent diffusion models for inverse problemscited by 70
  23. 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 69
  24. 2025FlowDPS: Flow-Driven Posterior Sampling for Inverse Problemscited by 68
  25. 2024Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptationcited by 51
  26. 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaversecited by 51
  27. 2017Pixel Recursive Super Resolutioncited by 44
  28. 2023Regularization by Texts for Latent Diffusion Inverse Solverscited by 32
  29. 2024ZoomLDM: Latent Diffusion Model for multi-scale image generationcited by 16
  30. 2023Generative Powers of Tencited by 15
  31. 2024Learning Images Across Scales Using Adversarial Trainingcited by 3
  32. 2024Zoomed In, Diffused Out: Towards Local Degradation-Aware Multi-Diffusion for Extreme Image Super-Resolutioncited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 5.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025DP2O-SR: Direct Perceptual Preference Optimization for Real-World Image Super-Resolution
  2. 2026RefReward-SR: LR-Conditioned Reward Modeling for Preference-Aligned Super-Resolution
  3. 2025The Power of Context: How Multimodality Improves Image Super-Resolution
  4. 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors
  5. 2025LinearSR: Unlocking Linear Attention for Stable and Efficient Image Super-Resolution
  6. 2026GramSR: Visual Feature Conditioning for Diffusion-Based Super-Resolution
  7. 2025Local-Global Context-Aware and Structure-Preserving Image Super-Resolution
  8. 2026LucidNFT: LR-Anchored Multi-Reward Preference Optimization for Flow-Based Real-World Super-Resolution