mlsanityData to 14 Oct 2026

TurboFill: Adapting Few-step Text-to-image Model for Fast Image Inpainting

arXiv 2504.00996 ↗First posted 1 Apr 2025cs.CVcited by 15

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

This paper introduces TurboFill, a fast image inpainting model that enhances a few-step text-to-image diffusion model with an inpainting adapter for high-quality and efficient inpainting. While standard diffusion models generate high-quality results, they incur high computational costs. We overcome this by training an inpainting adapter on a few-step distilled text-to-image model, DMD2, using a novel 3-step adversarial training scheme to ensure realistic, structurally consistent, and visually harmonious inpainted regions. To evaluate TurboFill, we propose two benchmarks: DilationBench, which tests performance across mask sizes, and HumanBench, based on human feedback for complex prompts. Experiments show that TurboFill outperforms both multi-step BrushNet and few-step inpainting methods, setting a new benchmark for high-performance inpainting tasks. Our project page: https://liangbinxie.github.io/projects/TurboFill/

Key facts. Cited by 15 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 31 of its 37 references that are in the map. First posted on arXiv 1 Apr 2025.

Builds on

31 of 37 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024Improving Text-guided Object Inpainting with Semantic Pre-inpainting12 Sep
  2. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusion11 Mar
  3. 2023HD-Painter: High-Resolution and Prompt-Faithful Text-Guided Image Inpainting with Diffusion Models21 Dec

Other references · 28

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  9. 2018Group Normalizationcited by 1,524
  10. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
  11. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  12. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
16 more
  1. 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
  2. 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 846
  3. 2023Adversarial Diffusion Distillationcited by 759
  4. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  5. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  6. 2018Generative Image Inpainting with Contextual Attentioncited by 580
  7. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  8. 2022Blended Latent Diffusioncited by 432
  9. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 410
  10. 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 266
  11. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
  12. 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 156
  13. 2019Learning Pyramid-Context Encoder Network for High-Quality Image Inpaintingcited by 94
  14. 2019Image inpainting: A reviewcited by 89
  15. 2021Aggregated Contextual Transformations for High-Resolution Image Inpaintingcited by 89
  16. 2023LeftRefill: Filling Right Canvas based on Left Reference through Generalized Text-to-Image Diffusion Modelcited by 25

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 12.

15 papers.

Sort:

By area:

  1. 2025MoGAN: Improving Motion Quality in Video Diffusion via Few-Step Motion Adversarial Post-Trainingcited by 8
  2. 2025SONIC: Spectral Optimization of Noise for Inpainting with Consistencycited by 4
  3. 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
  4. 2026GMO-E2DIT: Grounded Multi-Operation Editing for E-Commerce Imagescited by 3
  5. 2026InverFill: One-Step Inversion for Enhanced Few-Step Diffusion Inpaintingcited by 2
  6. 2025Refaccade: Editing Object with Given Reference Texturecited by 1
  7. 2026DORS: Dynamic Attention Routing for Diffusion-based Object Removal in Dense Scenescited by 1
  8. 2026MoGen: A Unified Collaborative Framework for Controllable Multi-Object Image Generationcited by 0
  9. 2026Aligned Stable Inpainting: Mitigating Unwanted Object Insertion and Preserving Color Consistencycited by 0
  10. 2026In-the-Wild Camouflage Attack on Vehicle Detectors through Controllable Image Editingcited by 0
  11. 2026You Only Erase Once: Erasing Anything without Bringing Unexpected Contentcited by 0
  12. 2026SwiftPie: Lightning-fast Subject-driven Image Personalization via One step Diffusioncited by 0
3 more
  1. 2026AsyncPatch Diffusion: spatially-flexible image generationcited by 0
  2. 2026When Diffusion Models Forget Who You Are: Identity Preservation in Face Inpainting under Large Occlusionscited by 0
  3. 2026ScaleVid: Geometry-Aware Video Object Scaling with Mesh-Free Inferencecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024PainterNet: Adaptive Image Inpainting with Actual-Token Attention and Diverse Mask Control
  2. 2024I Dream My Painting: Connecting MLLMs and Diffusion Models via Prompt Generation for Text-Guided Multi-Mask Inpainting
  3. 2025MTADiffusion: Mask Text Alignment Diffusion Model for Object Inpainting
  4. 2023Magicremover: Tuning-free Text-guided Image inpainting with Diffusion Models
  5. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Model
  6. 2025GuidPaint: Class-Guided Image Inpainting with Diffusion Models
  7. 2023Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Model
  8. 2023DiffGANPaint: Fast Inpainting Using Denoising Diffusion GANs