SwiftPie: Lightning-fast Subject-driven Image Personalization via One step Diffusion
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Diffusion models have achieved remarkable success in high-quality image synthesis, sparking interest in image-guided generation tasks such as subject-driven image personalization. Despite their impressive personalization results, existing methods typically rely on computationally intensive fine-tuning, iterative optimization, or multi-step denoising processes, which significantly hinder their deployment and interactive capability in real-time applications. In this work, we present SwiftPie, the first one-step diffusion image personalization tool that enables lightning-fast generation of personalized images. SwiftPie introduces a novel dual-branch identity injection mechanism that effectively integrates subject identity into a one-step diffusion model. In addition, we incorporate a mask-guided rescaling strategy to further enhance subject contextualization within a single diffusion step. Extensive experiments demonstrate that SwiftPie not only delivers superior image personalization speed but also achieves comparable performance with multi-step approaches in both identity fidelity and prompt alignment. This work opens new opportunities for real-time, high-quality personalized image generation, paving the way for interactive visual synthesis.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 46 of its 56 references that are in the map. First posted on arXiv 2 May 2026.
Builds on
46 of 56 references.
Closest ancestors · 11
Same direction, newest first
- 2025CSD-VAR: Content-Style Decomposition in Visual Autoregressive Models18 Jul
- 2025APT: Adaptive Personalized Training for Diffusion Models with Limited Data3 Jul
- 2024SwiftEdit: Lightning Fast Text-Guided Image Editing via One-Step Diffusion5 Dec
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models1 Aug
- 2023SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillation8 Dec
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
- 2021Blended Diffusion for Text-driven Editing of Natural Images29 Nov
Other references · 35
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,419
23 more
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,207
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2022Plug-and-Play Diffusion Features for Text-Driven Image-to-Image Translationcited by 897
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 792
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2022On Distillation of Guided Diffusion Modelscited by 721
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 648
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 414
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 387
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
- 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
- 2023Dataset Diffusion: Diffusion-based Synthetic Dataset Generation for Pixel-Level Semantic Segmentationcited by 112
- 2023DisenBooth: Identity-Preserving Disentangled Tuning for Subject-Driven Text-to-Image Generationcited by 75
- 2025OpenS2V-Nexus: A Detailed Benchmark and Million-Scale Dataset for Subject-to-Video Generationcited by 73
- 2024SwiftBrush v2: Make Your One-step Diffusion Model Better Than Its Teachercited by 45
- 2024RealCustom++: Representing Images as Real Textual Word for Real-Time Customizationcited by 16
- 2025TurboFill: Adapting Few-step Text-to-image Model for Fast Image Inpaintingcited by 15
- 2024FlexEdit: Flexible and Controllable Diffusion-based Object-centric Image Editingcited by 12
- 2024DreamCache: Finetuning-Free Lightweight Personalized Image Generation via Feature Cachingcited by 6
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Personalize Anything for Free with Diffusion Transformer
- 2026CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets
- 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attention
- 2023Generate Anything Anywhere in Any Scene
- 2023SVDiff: Compact Parameter Space for Diffusion Fine-Tuning
- 2023PortraitBooth: A Versatile Portrait Model for Fast Identity-preserved Personalization
- 2024MM-Diff: High-Fidelity Image Personalization via Multi-Modal Condition Integration