High-Resolution Artwork Outpainting with Global Blueprint Guidance and Layout Control
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Image outpainting extends an image beyond its original borders, requiring seamless style integration and globally coherent scene completion. Building on the success of diffusion models, recent methods have achieved substantial improvements in visual quality. In practice, however, high-resolution outpainting is commonly performed via progressive expansion around a fixed source image, particularly in artwork scenarios. Despite this progress, existing approaches still suffer from three key limitations: (i) the absence of a reliable global planning mechanism, which leads to structural instability and error accumulation at high resolutions; (ii) limited spatial controllability beyond text prompts, making it difficult to place objects at user-specified locations; and (iii) high inference latency caused by inherently sequential patch generation. To address these issues, we propose a global blueprint-guided two-stage diffusion framework for layout-controllable high-resolution outpainting with efficient parallel synthesis. In Stage 1, we generate a low-resolution global blueprint using a layout adapter that injects bounding-box conditions into a Stable Diffusion inpainting backbone, producing a globally consistent structural plan while extracting global guidance features. In Stage 2, we synthesize high-resolution local patches in parallel by injecting the blueprint-derived global guidance and initializing each patch from the blueprint using the low-frequency preservation property of forward diffusion. This design eliminates sequential dependency while maintaining global coherence. Extensive experiments on large-scale artwork datasets demonstrate improved visual fidelity, stronger semantic consistency, and substantially reduced inference time compared to prior baselines, while uniquely supporting explicit layout control for artwork outpainting.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 52 of its 67 references that are in the map. First posted on arXiv 7 Jul 2026.
Builds on
52 of 67 references.
Closest ancestors · 3
Same direction, newest first
- 2024Improving Diffusion Models for Authentic Virtual Try-on in the Wild8 Mar
- 2024OOTDiffusion: Outfitting Fusion based Latent Diffusion for Controllable Virtual Try-on4 Mar
- 2023Hierarchical Masked 3D Diffusion Model for Video Outpainting5 Sep
Other references · 49
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2023Segment Anythingcited by 8,158
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,439
37 more
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 683
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
- 2023MagicAnimate: Temporally Consistent Human Image Animation using Diffusion Modelcited by 330
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
- 2024Champ: Controllable and Consistent Human Image Animation with 3D Parametric Guidancecited by 271
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 168
- 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 123
- 2023FreeInit: Bridging Initialization Gap in Video Diffusion Modelscited by 93
- 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approachcited by 93
- 2022Any-resolution Training for High-resolution Image Synthesiscited by 72
- 2022NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesiscited by 71
- 2023Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenescited by 68
- 2019Boundless: Generative Adversarial Networks for Image Extensioncited by 62
- 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55
- 2019Very Long Natural Scenery Image Prediction by Outpaintingcited by 50
- 2024DRCT: Saving Image Super-resolution away from Information Bottleneckcited by 40
- 2024MIGC++: Advanced Multi-Instance Generation Controller for Image Synthesiscited by 35
- 2018Painting Outside the Box: Image Outpainting with GANscited by 30
- 2018Weakly Supervised Object Detection in Artworkscited by 27
- 2024Continuous-Multiple Image Outpainting in One-Step via Positional Query and A Diffusion-based Approachcited by 18
- 2024PrefPaint: Aligning Image Inpainting Diffusion Model with Human Preferencecited by 17
- 2019Controllable and Progressive Image Extrapolationcited by 13
- 2024Image Neural Field Diffusion Modelscited by 13
- 2020Sketch-Guided Scenery Image Outpaintingcited by 12
- 2022Outpainting by Queriescited by 12
- 2022Generalised Image Outpainting with U-Transformercited by 11
- 2022Scene Graph Expansion for Semantics-Guided Image Outpaintingcited by 11
- 2025LightsOut: Diffusion-based Outpainting for Enhanced Lens Flare Removalcited by 9
- 2024VIP: Versatile Image Outpainting Empowered by Multimodal Large Language Modelcited by 8
- 2021SemIE: Semantically-aware Image Extrapolationcited by 7
- 2021ReGO: Reference-Guided Outpainting for Scenery Imagecited by 6
- 2021Boosting Image Outpainting with Semantic Layout Predictioncited by 6
- 2022HORIZON: High-Resolution Semantically Controlled Panorama Synthesiscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Ultra High-Resolution Image Inpainting with Patch-Based Content Consistency Adapter
- 2024TD-Paint: Faster Diffusion Inpainting Through Time Aware Pixel Conditioning
- 2025GuidPaint: Class-Guided Image Inpainting with Diffusion Models
- 2025PSDiffusion: Harmonized Multi-Layer Image Generation via Layout and Appearance Alignment
- 2024RAD: Region-Aware Diffusion Models for Image Inpainting
- 2024Be-Your-Outpainter: Mastering Video Outpainting through Input-Specific Adaptation
- 2023HD-Painter: High-Resolution and Prompt-Faithful Text-Guided Image Inpainting with Diffusion Models
- 2024Salient Object-Aware Background Generation using Text-Guided Diffusion Models