ConceptWeaver: Weaving Disentangled Concepts with Flow
Not on the map. Why?
Abstract (arXiv)
Pre-trained flow-based models excel at synthesizing complex scenes yet lack a direct mechanism for disentangling and customizing their underlying concepts from one-shot real-world sources. To demystify this process, we first introduce a novel differential probing technique to isolate and analyze the influence of individual concept tokens on the velocity field over time. This investigation yields a critical insight: the generative process is not monolithic but unfolds in three distinct stages. An initial Blueprint Stage establishes low-frequency structure, followed by a pivotal Instantiation Stage where content concepts emerge with peak intensity and become naturally disentangled, creating an optimal window for manipulation. A final concept-insensitive refinement stage then synthesizes fine-grained details. Guided by this discovery, we propose ConceptWeaver, a framework for one-shot concept disentanglement. ConceptWeaver learns concept-specific semantic offsets from a single reference image using a stage-aware optimization strategy that aligns with the three-stage framework. These learned offsets are then deployed during inference via our novel ConceptWeaver Guidance (CWG) mechanism, which strategically injects them at the appropriate generative stage. Extensive experiments validate that ConceptWeaver enables high-fidelity, compositional synthesis and editing, demonstrating that understanding and leveraging the intrinsic, staged nature of flow models is key to unlocking precise, multi-granularity content manipulation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 53 of its 54 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
53 of 54 references.
References · 53
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2024GPT-4o System Cardcited by 4,588
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
38 more
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,979
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2024Movie Gen: A Cast of Media Foundation Modelscited by 644
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2024Discrete Flow Matchingcited by 317
- 2024Flow Matching Guide and Codecited by 301
- 2023Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Modelscited by 261
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
- 2024FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Modelscited by 217
- 2023Key-Locked Rank One Editing for Text-to-Image Personalizationcited by 194
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motioncited by 188
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
- 2024DreamBench++: A Human-Aligned Benchmark for Personalized Image Generationcited by 131
- 2025Phantom: Subject-consistent video generation via cross-modal alignmentcited by 129
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
- 2024MotionClone: Training-Free Motion Cloning for Controllable Video Generationcited by 105
- 2023Orthogonal Adaptation for Modular Customization of Diffusion Modelscited by 70
- 2025Multi-subject Open-set Personalization in Video Generationcited by 66
- 2023Concept Decomposition for Visual Exploration and Inspirationcited by 61
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 56
- 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Spacecited by 52
- 2025CFG-Zero*: Improved Classifier-Free Guidance for Flow Matching Modelscited by 52
- 2024Resolving Multi-Condition Confusion for Finetuning-Free Personalized Image Generationcited by 43
- 2025Stochastic Self-Guidance for Training-Free Enhancement of Diffusion Modelscited by 36
- 2025Omni-Effects: Unified and Spatially-Controllable Visual Effects Generationcited by 27
- 2025FlowDirector: Training-Free Flow Steering for Precise Text-to-Video Editingcited by 26
- 2025FlexiAct: Towards Flexible Action Control in Heterogeneous Scenarioscited by 25
- 2025DNAEdit: Direct Noise Alignment for Text-Guided Rectified Flow Editingcited by 24
- 2025Taming Preference Mode Collapse via Directional Decoupling Alignment in Diffusion Reinforcement Learningcited by 18
- 2024ConceptExpress: Harnessing Diffusion Models for Single-image Unsupervised Concept Extractioncited by 16
- 2024How Diffusion Models Learn to Factorize and Composecited by 13
- 2025Mod-Adapter: Tuning-Free and Versatile Multi-concept Personalization via Modulation Adaptercited by 13
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.