mlsanityData to 7 Oct 2026

SwiftPie: Lightning-fast Subject-driven Image Personalization via One step Diffusion

arXiv 2605.01510 ↗First posted 2 May 2026cs.CVcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Diffusion models have achieved remarkable success in high-quality image synthesis, sparking interest in image-guided generation tasks such as subject-driven image personalization. Despite their impressive personalization results, existing methods typically rely on computationally intensive fine-tuning, iterative optimization, or multi-step denoising processes, which significantly hinder their deployment and interactive capability in real-time applications. In this work, we present SwiftPie, the first one-step diffusion image personalization tool that enables lightning-fast generation of personalized images. SwiftPie introduces a novel dual-branch identity injection mechanism that effectively integrates subject identity into a one-step diffusion model. In addition, we incorporate a mask-guided rescaling strategy to further enhance subject contextualization within a single diffusion step. Extensive experiments demonstrate that SwiftPie not only delivers superior image personalization speed but also achieves comparable performance with multi-step approaches in both identity fidelity and prompt alignment. This work opens new opportunities for real-time, high-quality personalized image generation, paving the way for interactive visual synthesis.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 46 of its 56 references that are in the map. First posted on arXiv 2 May 2026.

Builds on

46 of 56 references.

Closest ancestors · 11

Same direction, newest first

  1. 2025CSD-VAR: Content-Style Decomposition in Visual Autoregressive Models18 Jul
  2. 2025APT: Adaptive Personalized Training for Diffusion Models with Limited Data3 Jul
  3. 2024SwiftEdit: Lightning Fast Text-Guided Image Editing via One-Step Diffusion5 Dec
  4. 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models1 Aug
  5. 2023SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillation8 Dec
  6. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  7. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  8. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  9. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
  10. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  11. 2021Blended Diffusion for Text-driven Editing of Natural Images29 Nov

Other references · 35

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  9. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  12. 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
23 more
  1. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
  2. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  3. 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
  4. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
  5. 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
  6. 2022On Distillation of Guided Diffusion Modelscited by 721
  7. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
  8. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
  9. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
  10. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
  11. 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
  12. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
  13. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
  14. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
  15. 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
  16. 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentationcited by 112
  17. 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generationcited by 75
  18. 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
  19. 2024SwiftBrush v2: Make Your One-step Diffusion Model Better Than Its Teachercited by 45
  20. 2024RealCustom++: Representing Images as Real Textual Word for Real-Time Customizationcited by 16
  21. 2025TurboFill: Adapting Few-step Text-to-image Model for Fast Image Inpaintingcited by 15
  22. 2024FlexEdit: Flexible and Controllable Diffusion-based Object-centric Image Editingcited by 12
  23. 2024DreamCache: Finetuning-Free Lightweight Personalized Image Generation via Feature Cachingcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Personalize Anything for Free with Diffusion Transformer
  2. 2026CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets
  3. 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds
  4. 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention
  5. 2023Generate Anything Anywhere in Any Scene
  6. 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuning
  7. 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalization
  8. 2024MM-Diff: High-Fidelity Image Personalization via Multi-Modal Condition Integration