Tiled Prompts: Overcoming Prompt Misguidance in Image and Video Super-Resolution
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Text-conditioned diffusion models have advanced image and video super-resolution by using prompts as semantic priors, and modern super-resolution pipelines typically rely on latent tiling to scale to high resolutions. In practice, a single global caption is used with the latent tiling, often causing prompt misguidance. Specifically, a coarse global prompt often misses localized details (errors of omission) and provides locally irrelevant guidance (errors of commission) which leads to substandard results at the tile level. To solve this, we propose Tiled Prompts, a unified framework for image and video super-resolution that generates a tile-specific prompt for each latent tile and performs super-resolution under locally text-conditioned posteriors to resolve prompt misguidance with minimal overhead. Our experiments on high resolution real-world images and videos show that tiled prompts bring consistent gains in perceptual quality and fidelity, while reducing hallucinations and tile-level artifacts that can be found in global-prompt baselines. Project Page: https://bryanswkim.github.io/tiled-prompts/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 49 of its 67 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
49 of 67 references.
Closest ancestors · 15
Same direction, newest first
- 2025Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusion29 Dec
- 2025One-Step Diffusion for Detail-Rich and Temporally Consistent Video Super-Resolution18 Jun
- 2025Text-Aware Image Restoration with Diffusion Models11 Jun
- 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Training5 Jun
- 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolution30 Mar
- 2025DiffVSR: Revealing an Effective Recipe for Taming Robust Video Super-Resolution Against Complex Degradations17 Jan
- 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolution6 Jan
- 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restoration2 Jan
- 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approach4 Dec
- 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curation24 Oct
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolution12 Jun
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution11 Dec
3 more
Other references · 34
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2023Visual Instruction Tuningcited by 7,792
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 2,994
22 more
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2023Human Preference Score v2: A Solid Benchmark for Evaluating Human Preferences of Text-to-Image Synthesiscited by 847
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 465
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
- 2018Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transformcited by 369
- 2023LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignmentcited by 366
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 343
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 314
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 243
- 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
- 2023Mixture of Diffusers for scene composition and high resolution image generationcited by 56
- 2022Benchmark Dataset and Effective Inter-Frame Alignment for Real-World Video Super-Resolutioncited by 20
- 2025Chain-of-Zoom: Extreme Super-Resolution via Scale Autoregression and Preference Alignmentcited by 8
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Local-Global Context-Aware and Structure-Preserving Image Super-Resolution
- 2024Improving Consistency in Diffusion Models for Image Super-Resolution
- 2023Image Super-Resolution with Text Prompt Diffusion
- 2025The Power of Context: How Multimodality Improves Image Super-Resolution
- 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors
- 2026Revisiting the Perception-Distortion Trade-off with Spatial-Semantic Guided Super-Resolution
- 2025Diversifying Long Prompt Image Generation through Structured Prompt Embedding Space Sampling
- 2025Creatively Upscaling Images with Global-Regional Priors