Chain-of-Zoom: Extreme Super-Resolution via Scale Autoregression and Preference Alignment
On the map: LLM alignment / RLHF / preference optimisation → Diffusion and multimodal model alignment
Abstract (arXiv)
Modern single-image super-resolution (SISR) models deliver photo-realistic results at the scale factors on which they are trained, but collapse when asked to magnify far beyond that regime. We address this scalability bottleneck with Chain-of-Zoom (CoZ), a model-agnostic framework that factorizes SISR into an autoregressive chain of intermediate scale-states with multi-scale-aware prompts. CoZ repeatedly re-uses a backbone SR model, decomposing the conditional probability into tractable sub-problems to achieve extreme resolutions without additional training. Because visual cues diminish at high magnifications, we augment each zoom step with multi-scale-aware text prompts generated by a vision-language model (VLM). The prompt extractor itself is fine-tuned using Generalized Reward Policy Optimization (GRPO) with a critic VLM, aligning text guidance towards human preference. Experiments show that a standard 4x diffusion SR model wrapped in CoZ attains beyond 256x enlargement with high perceptual quality and fidelity. Project Page: https://bryanswkim.github.io/chain-of-zoom/.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Diffusion and multimodal model alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 45 of its 61 references that are in the map. First posted on arXiv 24 May 2025.
Builds on
45 of 61 references.
Closest ancestors · 1
Same direction, newest first
Other references · 44
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,552
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
32 more
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2016Conditional Image Generation with PixelCNN Decoderscited by 862
- 2016Pixel Recurrent Neural Networkscited by 816
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2022Improving Diffusion Models for Inverse Problems using Manifold Constraintscited by 508
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
- 2019Deep Learning for Image Super-resolution: A Surveycited by 369
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2024SWIFT:A Scalable lightWeight Infrastructure for Fine-Tuningcited by 355
- 2025Demystifying Long Chain-of-Thought Reasoning in LLMscited by 326
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 315
- 2017"Zero-Shot" Super-Resolution using Deep Internal Learningcited by 286
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
- 2024LLaVA-Critic: Learning to Evaluate Multimodal Modelscited by 134
- 2023Decomposed Diffusion Sampler for Accelerating Large-Scale Inverse Problemscited by 132
- 2022Any-resolution Training for High-resolution Image Synthesiscited by 72
- 2023Prompt-tuning latent diffusion models for inverse problemscited by 70
- 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priorscited by 69
- 2025FlowDPS: Flow-Driven Posterior Sampling for Inverse Problemscited by 68
- 2024Make a Cheap Scaling: A Self-Cascade Diffusion Model for Higher-Resolution Adaptationcited by 51
- 2025MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaversecited by 51
- 2017Pixel Recursive Super Resolutioncited by 44
- 2023Regularization by Texts for Latent Diffusion Inverse Solverscited by 32
- 2024ZoomLDM: Latent Diffusion Model for multi-scale image generationcited by 16
- 2023Generative Powers of Tencited by 15
- 2024Learning Images Across Scales Using Adversarial Trainingcited by 3
- 2024Zoomed In, Diffused Out: Towards Local Degradation-Aware Multi-Diffusion for Extreme Image Super-Resolutioncited by 2
Built on by
Citing papers per year: 2025: 3; 2026: 5.
8 papers.
- 2025WonderZoom: Multi-Scale 3D World Generationcited by 1
- 2026OracleZoom: On-Policy Self-Distillation Inspired Reference-Constrained Recursive Image Super Resolutioncited by 1
- 2025Extreme Blind Image Restoration via Prompt-Conditioned Information Bottleneckcited by 0
- 2025EraseLoRA: MLLM-Driven Foreground Exclusion and Background Subtype Aggregation for Dataset-Free Object Removalcited by 0
- 2026Tiled Prompts: Overcoming Prompt Misguidance in Image and Video Super-Resolutioncited by 0
- 2026GaussianZoom: Progressive Zoom-in Generative 3D Gaussian Splatting with Geometric and Semantic Guidancecited by 0
- 2026VICR: Visual In-Context Restoration for Real-World Image Super-Resolutioncited by 0
- 2026MicroZoom: Structure-Preserving Detail Synthesis at Extreme Scalecited by 0
- 2026OracleZoom: On-Policy Self-Distillation Inspired Reference-Constrained Recursive Image Super Resolution6 Sep 2026
- 2026MicroZoom: Structure-Preserving Detail Synthesis at Extreme Scale27 Jul 2026
- 2026VICR: Visual In-Context Restoration for Real-World Image Super-Resolution30 May 2026
- 2026GaussianZoom: Progressive Zoom-in Generative 3D Gaussian Splatting with Geometric and Semantic Guidance18 May 2026
- 2026Tiled Prompts: Overcoming Prompt Misguidance in Image and Video Super-Resolution3 Feb 2026
- 2025EraseLoRA: MLLM-Driven Foreground Exclusion and Background Subtype Aggregation for Dataset-Free Object Removal25 Dec 2025
- 2025WonderZoom: Multi-Scale 3D World Generation9 Dec 2025
- 2025Extreme Blind Image Restoration via Prompt-Conditioned Information Bottleneck1 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025DP2O-SR: Direct Perceptual Preference Optimization for Real-World Image Super-Resolution
- 2026RefReward-SR: LR-Conditioned Reward Modeling for Preference-Aligned Super-Resolution
- 2025The Power of Context: How Multimodality Improves Image Super-Resolution
- 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors
- 2025LinearSR: Unlocking Linear Attention for Stable and Efficient Image Super-Resolution
- 2026GramSR: Visual Feature Conditioning for Diffusion-Based Super-Resolution
- 2025Local-Global Context-Aware and Structure-Preserving Image Super-Resolution
- 2026LucidNFT: LR-Anchored Multi-Reward Preference Optimization for Flow-Based Real-World Super-Resolution