mlsanityData to 14 Oct 2026

Flux Already Knows -- Activating Subject-Driven Image Generation without Training

arXiv 2504.11478 ↗First posted 12 Apr 2025cs.CV cs.AIcited by 11

Not on the map. Why?

Abstract (arXiv)

We propose a simple yet effective zero-shot framework for subject-driven image generation using a vanilla Flux model. By framing the task as grid-based image completion and simply replicating the subject image(s) in a mosaic layout, we activate strong identity-preserving capabilities without any additional data, training, or inference-time fine-tuning. This "free lunch" approach is further strengthened by a novel cascade attention design and meta prompting technique, boosting fidelity and versatility. Experimental results show that our method outperforms baselines across multiple key metrics in benchmarks and human preference studies, with trade-offs in certain aspects. Additionally, it supports diverse edits, including logo insertion, virtual try-on, and subject replacement or insertion. These results demonstrate that a pre-trained foundational text-to-image model can enable high-quality, resource-efficient subject-driven generation, opening new possibilities for lightweight customization in downstream applications.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 58 of its 71 references that are in the map. First posted on arXiv 12 Apr 2025.

Builds on

58 of 71 references.

References · 58

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2022Flow Matching for Generative Modelingcited by 5,702
  10. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
38 more
  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  2. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  3. 2014Sequence to Sequence Learning with Neural Networkscited by 2,986
  4. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  5. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
  6. 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
  7. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  8. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
  9. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  10. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
  11. 2022Blended Latent Diffusioncited by 432
  12. 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
  13. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 412
  14. 2023InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuningcited by 345
  15. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
  16. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  17. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 278
  18. 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 242
  19. 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
  20. 2022Re-Imagen: Retrieval-Augmented Text-to-Image Generatorcited by 210
  21. 2022Optimizing Prompts for Text-to-Image Generationcited by 207
  22. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 202
  23. 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 193
  24. 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
  25. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equationscited by 165
  26. 2024In-Context LoRA for Diffusion Transformerscited by 158
  27. 2023Cones: Concept Neurons in Diffusion Models for Customized Generationcited by 150
  28. 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
  29. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 143
  30. 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
  31. 2023Taming Encoder for Zero Fine-tuning Image Customization with Text-to-Image Diffusion Modelscited by 117
  32. 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
  33. 2021Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAEcited by 106
  34. 2023Kosmos-G: Generating Images in Context with Multimodal Large Language Modelscited by 105
  35. 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
  36. 2021GAN-Control: Explicitly Controllable GANscited by 91
  37. 2021PD-GAN: Probabilistic Diverse GAN for Image Inpaintingcited by 80
  38. 2024IMPRINT: Generative Object Compositing by Learning Identity-Preserving Representationcited by 64

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 9; 2026: 2.

11 papers.