Ultra High-Resolution Image Inpainting with Patch-Based Content Consistency Adapter
Not on the map. Why?
Abstract (arXiv)
In this work, we present Patch-Adapter, an effective framework for high-resolution text-guided image inpainting. Unlike existing methods limited to lower resolutions, our approach achieves 4K+ resolution while maintaining precise content consistency and prompt alignment, two critical challenges in image inpainting that intensify with increasing resolution and texture complexity. Patch-Adapter leverages a two-stage adapter architecture to scale the diffusion model's resolution from 1K to 4K+ without requiring structural overhauls: (1) Dual Context Adapter learns coherence between masked and unmasked regions at reduced resolutions to establish global structural consistency; and (2) Reference Patch Adapter implements a patch-level attention mechanism for full-resolution inpainting, preserving local detail fidelity through adaptive feature fusion. This dual-stage architecture uniquely addresses the scalability gap in high-resolution inpainting by decoupling global semantics from localized refinement. Experiments demonstrate that Patch-Adapter not only resolves artifacts common in large-scale inpainting but also achieves state-of-the-art performance on the OpenImages and Photo-Concept-Bucket datasets, outperforming existing methods in both perceptual quality and text-prompt adherence.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 40 of its 47 references that are in the map. First posted on arXiv 15 Oct 2025.
Builds on
40 of 47 references.
References · 40
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
28 more
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,254
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2022Zero-Shot Image Restoration Using Denoising Diffusion Null-Space Modelcited by 583
- 2018Generative Image Inpainting with Contextual Attentioncited by 580
- 2022Blended Latent Diffusioncited by 432
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 278
- 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpaintingcited by 233
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
- 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 220
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
- 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 169
- 2019Pluralistic Image Completioncited by 162
- 2020Contextual Residual Aggregation for Ultra High-Resolution Image Inpaintingcited by 124
- 2021Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAEcited by 106
- 2016High-Resolution Image Inpainting using Multi-Scale Neural Patch Synthesiscited by 90
- 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
- 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
- 2020High-Resolution Image Inpainting with Iterative Confidence Feedback and Guided Upsamplingcited by 79
- 2023HD-Painter: High-Resolution and Prompt-Faithful Text-Guided Image Inpainting with Diffusion Modelscited by 67
- 2023Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Modelcited by 60
- 2022CM-GAN: Image Inpainting with Cascaded Modulation GAN and Object-Aware Trainingcited by 49
- 2024Deep Learning-based Image and Video Inpainting: A Surveycited by 44
- 2023DreamInpainter: Text-Guided Subject-Driven Image Inpainting with Diffusion Modelscited by 31
- 2023Magicremover: Tuning-free Text-guided Image inpainting with Diffusion Modelscited by 16
- 2020Generator Pyramid for High-Resolution Image Inpaintingcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026High-Resolution Artwork Outpainting with Global Blueprint Guidance and Layout Control
- 2026Aligned Stable Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistency
- 2025FreeInpaint: Tuning-free Prompt Alignment and Visual Rationality Enhancement in Image Inpainting
- 2024Modification Takes Courage: Seamless Image Stitching via Reference-Driven Inpainting
- 2025MTADiffusion: Mask Text Alignment Diffusion Model for Object Inpainting
- 2025Towards Seamless Borders: A Method for Mitigating Inconsistencies in Image Inpainting and Outpainting
- 2026Fill2SR: Repurposing Inpainting Diffusion Transformers for Real-World Super-Resolution
- 2024Reconstructing the Image Stitching Pipeline: Integrating Fusion and Rectangling into a Unified Inpainting Model