FastFace: Tuning Identity Preservation in Distilled Diffusion via Guidance and Attention
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
In latest years plethora of identity-preserving adapters for a personalized generation with diffusion models have been released. Their main disadvantage is that they are dominantly trained jointly with base diffusion models, which suffer from slow multi-step inference. This work aims to tackle the challenge of training-free adaptation of pretrained ID-adapters to diffusion models accelerated via distillation - through careful re-design of classifier-free guidance for few-step stylistic generation and attention manipulation mechanisms in decoupled blocks to improve identity similarity and fidelity, we propose universal FastFace framework. Additionally, we develop a disentangled public evaluation protocol for id-preserving adapters.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 36 of its 40 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
36 of 40 references.
Closest ancestors · 11
Same direction, newest first
- 2025InfiniteYou: Flexible Photo Recrafting While Preserving Your Identity20 Mar
- 2024CtrLoRA: An Extensible and Efficient Framework for Controllable Image Generation12 Oct
- 2024Guide-and-Rescale: Self-Guidance Mechanism for Effective Tuning-Free Real Image Editing2 Sep
- 2024Invertible Consistency Distillation for Text-Guided Image Editing in Around 7 Steps20 Jun
- 2024One-Step Image Translation with Text-to-Image Models18 Mar
- 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds15 Jan
- 2023CCM: Adding Conditional Controls to Text-to-Image Consistency Models12 Dec
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug
Other references · 25
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2023Consistency Modelscited by 1,778
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2023Latent Consistency Models: Synthesizing High-Resolution Images with Few-Step Inferencecited by 826
13 more
- 2023Adversarial Diffusion Distillationcited by 741
- 2023MasaCtrl: Tuning-Free Mutual Self-Attention Control for Consistent Image Synthesis and Editingcited by 722
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 324
- 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
- 2023Common Diffusion Noise Schedules and Sample Steps are Flawedcited by 308
- 2023Diffusion Self-Guidance for Controllable Image Generationcited by 305
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 276
- 2024SDXL-Lightning: Progressive Adversarial Diffusion Distillationcited by 258
- 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 153
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 143
- 2024PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Modelscited by 139
- 2024Ctrl-Adapter: An Efficient and Versatile Framework for Adapting Diverse Controls to Any Diffusion Modelcited by 64
- 2024Analysis of Classifier-Free Guidance Weight Schedulerscited by 64
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AdaptDiff: Adaptive Guidance in Diffusion Models for Diverse and Identity-Consistent Face Synthesis (Student Abstract)
- 2024Infinite-ID: Identity-preserved Personalization via ID-semantics Decoupling Paradigm
- 2025High-Fidelity Diffusion Face Swapping with ID-Constrained Facial Conditioning
- 2026Diff-ID: Identity Consistent Facial Image Generation and Morphing via Diffusion Models
- 2023When StyleGAN Meets Stable Diffusion: a mathscrW_+ Adapter for Personalized Image Generation
- 2026PIU: Proximity-guided Identity Unlearning in ID-Conditioned Diffusion Models
- 2024ID3: Identity-Preserving-yet-Diversified Diffusion Models for Synthetic Face Recognition
- 2024Beyond Inserting: Learning Identity Embedding for Semantic-Fidelity Personalized Diffusion Generation