DreamO: A Unified Framework for Image Customization
Not on the map. Why?
Cited by 22 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Recently, extensive research on image customization (e.g., identity, subject, style, background, etc.) demonstrates strong customization capabilities in large-scale generative models. However, most approaches are designed for specific tasks, restricting their generalizability to combine different types of condition. Developing a unified framework for image customization remains an open challenge. In this paper, we present DreamO, an image customization framework designed to support a wide range of tasks while facilitating seamless integration of multiple conditions. Specifically, DreamO utilizes a diffusion transformer (DiT) framework to uniformly process input of different types. During training, we construct a large-scale training dataset that includes various customization tasks, and we introduce a feature routing constraint to facilitate the precise querying of relevant information from reference images. Additionally, we design a placeholder strategy that associates specific placeholders with conditions at particular positions, enabling control over the placement of conditions in the generated results. Moreover, we employ a progressive training strategy consisting of three stages: an initial stage focused on simple tasks with limited data to establish baseline consistency, a full-scale training stage to comprehensively enhance the customization capabilities, and a final quality alignment stage to correct quality biases introduced by low-quality data. Extensive experiments demonstrate that the proposed DreamO can effectively perform various image customization tasks with high quality and flexibly integrate different types of control conditions.
Key facts. Cited by 83 papers in the map (data through 14 Oct 2026). Builds on 61 of its 67 references that are in the map. First posted on arXiv 23 Apr 2025.
Builds on
61 of 67 references.
References · 61
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2024GPT-4o System Cardcited by 4,588
38 more
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2021Masked-attention Mask Transformer for Universal Image Segmentationcited by 2,351
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2024Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phonecited by 1,917
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
- 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 442
- 2024InstantID: Zero-shot Identity-Preserving Generation in Secondscited by 436
- 2024OmniGen: Unified Image Generationcited by 394
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
- 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 340
- 2023PhotoMaker: Customizing Realistic Human Photos via Stacked ID Embeddingcited by 328
- 2020CurricularFace: Adaptive Curriculum Learning Loss for Deep Face Recognitioncited by 321
- 2023FastComposer: Tuning-Free Multi-Subject Image Generation with Localized Attentioncited by 313
- 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 304
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 200
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 195
- 2023Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuningcited by 191
- 2024InstantStyle: Free Lunch towards Style-Preserving in Text-to-Image Generationcited by 170
- 2024In-Context LoRA for Diffusion Transformerscited by 158
- 2024PuLID: Pure and Lightning ID Customization via Contrastive Alignmentcited by 144
- 2024MS-Diffusion: Multi-subject Zero-shot Image Personalization with Layout Guidancecited by 144
- 2024Improving Diffusion Models for Authentic Virtual Try-on in the Wildcited by 109
- 2024Measuring Style Similarity in Diffusion Modelscited by 109
- 2024UniReal: Universal Image Generation and Editing via Learning Real-world Dynamicscited by 102
- 2024IMAGDressing-v1: Customizable Virtual Dressingcited by 100
- 2024CSGO: Content-Style Composition in Text-to-Image Generationcited by 78
- 2024DEADiff: An Efficient Stylization Diffusion Model with Disentangled Representationscited by 68
50 most cited of 61 All 61 (JSON)
Built on by
Citing papers per year: 2025: 44; 2026: 39.
83 papers.
Sort:
By area:
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 56
- 2025DreamOmni2: Multimodal Instruction-based Editing and Generationcited by 38
- 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Designcited by 36
- 2025Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generationcited by 28
- 2025USO: Unified Style and Subject-Driven Generation via Disentangled and Reward Learningcited by 27
- 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learningcited by 25
- 2025UMO: Scaling Multi-Identity Consistency for Image Customization via Matching Rewardcited by 19
- 2025FullDiT2: Efficient In-Context Conditioning for Video Diffusion Transformerscited by 18
- 2025ContextGen: Contextual Layout Anchoring for Identity-Consistent Multi-Instance Generationcited by 18
- 2025MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Modelscited by 17
- 2025Phantom-Data : Towards a General Subject-Consistent Video Generation Datasetcited by 17
38 more
- 2025WithAnyone: Towards Controllable and ID Consistent Image Generationcited by 17
- 2025DreamPoster: A Unified Framework for Image-Conditioned Generative Poster Designcited by 16
- 2025MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizercited by 15
- 2025MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and Disentanglementcited by 14
- 2026Lance: Unified Multimodal Modeling by Multi-Task Synergycited by 12
- 2025IC-Custom: Diverse Image Customization via In-Context Learningcited by 10
- 2025EditIDv2: Editable ID Customization with Data-Lubricated ID Feature Integration for Text-to-Image Generationcited by 8
- 2025LAMIC: Layout-Aware Multi-Image Composition via Scalability of Multimodal Diffusion Transformercited by 7
- 2025ID-Crafter: VLM-Grounded Online RL for Compositional Multi-Subject Video Generationcited by 6
- 2026TAG-MoE: Task-Aware Gating for Unified Generative Mixture-of-Expertscited by 6
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfercited by 6
- 2025FreeLoRA: Enabling Training-Free LoRA Fusion for Autoregressive Multi-Subject Personalizationcited by 5
- 2025SIGMA-GEN: Structure and Identity Guided Multi-subject Assembly for Image Generationcited by 5
- 2025OmniRefiner: Reinforcement-Guided Local Diffusion Refinementcited by 5
- 2025The Consistency Critic: Correcting Inconsistencies in Generated Images via Reference-Guided Attentive Alignmentcited by 5
- 2025Canvas-to-Image: Compositional Image Generation with Multimodal Controlscited by 5
- 2026TeleStyle: Content-Preserving Style Transfer in Images and Videoscited by 5
- 2025PositionIC: Unified Position and Identity Consistency for Image Customizationcited by 4
- 2025MultiCrafter: High-Fidelity Multi-Subject Generation via Disentangled Attention and Identity-Aware Preference Alignmentcited by 4
- 2025OpenSubject: Leveraging Video-Derived Identity and Diversity Priors for Subject-driven Image Generation and Manipulationcited by 4
- 2026QwenStyle: Content-Preserving Style Transfer with Qwen-Image-Editcited by 4
- 2026Beyond Pixels: Visual Metaphor Transfer via Schema-Driven Agentic Reasoningcited by 4
- 2026Garments2Look: A Multi-Reference Dataset for High-Fidelity Outfit-Level Virtual Try-On with Clothing and Accessoriescited by 4
- 2025FocusDPO: Dynamic Preference Optimization for Multi-Subject Personalized Image Generation via Adaptive Focuscited by 3
- 2025Resolving the Identity Crisis in Text-to-Image Generationcited by 3
- 2025CanvasComposer: Personalized Group Photo Generation via a Multi-Reference Canvascited by 3
- 2025UniFit: Towards Universal Virtual Try-on with MLLM-Guided Semantic Alignmentcited by 3
- 2025DVI: Disentangling Semantic and Visual Identity for Training-Free Personalized Generationcited by 3
- 2026FlexID: Training-Free Flexible Identity Injection via Intent-Aware Modulation for Text-to-Image Generationcited by 3
- 2026Inject Where It Matters: Training-Free Spatially-Adaptive Identity Preservation for Text-to-Image Personalizationcited by 3
- 2026DSH-Bench: A Difficulty- and Scenario-Aware Benchmark with Hierarchical Subject Taxonomy for Subject-Driven Text-to-Image Generationcited by 3
- 2026CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillationcited by 3
- 2025Character Mixing for Video Generationcited by 2
- 2025Ar2Can: An Architect and an Artist Leveraging a Canvas for Multi-Human Generationcited by 2
- 2025DreamOmni3: Scribble-based Editing and Generationcited by 2
- 2026A2-Edit: Precise Reference-Guided Image Editing of Arbitrary Objects and Ambiguous Maskscited by 2
- 2026UniCustom: Unified Visual Conditioning for Multi-Reference Image Generationcited by 2
- 2026Images in Sentences: Scaling Interleaved Instructions for Unified Visual Generationcited by 2
50 most cited of 83 All 83 (JSON)
- 2026ScribbleEdit: A Benchmark for Scribble-Only Image Editing7 Oct 2026
- 2026WithEveryone: Unified Planning and Identity Grounding for Group Image Generation20 Aug 2026
- 2026CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets14 Aug 2026
- 2026CopyCat: Improving Fine-Grained Subject Consistency in Subject-to-Image Models within Seconds1 Aug 2026
- 2026MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editing30 Jul 2026
- 2026ICDepth: Taming Video Diffusion Models for Video Depth Estimation via In-Context Conditioning2 Jul 2026
- 2026LCG: Long-Context Consistent Image Generation with Sparse Relational Attention24 Jun 2026
- 2026CogCanvas: A Benchmark for Evaluating Multi-Subject Reference-Based Image Generation14 Jun 2026
- 2026UniVerse: A Unified Modulation Framework for Segmentation-Free,Disentangled Multi-Concept Personalization29 May 2026
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generation25 May 2026
- 2026CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillation25 May 2026
- 2026Lance: Unified Multimodal Modeling by Multi-Task Synergy18 May 2026
38 more
- 2026The Silent Brush: Evaluating Artistic Style Leakage in AI Art Generation17 May 2026
- 2026Images in Sentences: Scaling Interleaved Instructions for Unified Visual Generation12 May 2026
- 2026UniCustom: Unified Visual Conditioning for Multi-Reference Image Generation12 May 2026
- 2026Fashion130K: An E-commerce Fashion Dataset for Outfit Generation with Unified Multi-modal Condition11 May 2026
- 2026DreamShot: Personalized Storyboard Synthesis with Video Diffusion Prior19 Apr 2026
- 2026ASTRA: Enhancing Multi-Subject Generation with Retrieval-Augmented Pose Guidance and Disentangled Position Embedding15 Apr 2026
- 2026Training-Free Image Editing with Visual Context Integration and Concept Alignment6 Apr 2026
- 2026OmniDiT: Extending Diffusion Transformer to Omni-VTON Framework20 Mar 2026
- 2026Mixture of Style Experts for Diverse Image Stylization17 Mar 2026
- 2026AnyPhoto: Multi-Person Identity Preserving Image Generation with ID Adaptive Modulation on Location Canvas16 Mar 2026
- 2026Garments2Look: A Multi-Reference Dataset for High-Fidelity Outfit-Level Virtual Try-On with Clothing and Accessories14 Mar 2026
- 2026VTEdit-Bench: A Comprehensive Benchmark for Multi-Reference Image Editing Models in Virtual Try-On12 Mar 2026
- 2026PROMO: Promptable Outfitting for Efficient High-Fidelity Virtual Try-On12 Mar 2026
- 2026A2-Edit: Precise Reference-Guided Image Editing of Arbitrary Objects and Ambiguous Masks11 Mar 2026
- 2026BridgeDiff: Bridging Human Observations and Flat-Garment Synthesis for Virtual Try-Off10 Mar 2026
- 2026DSH-Bench: A Difficulty- and Scenario-Aware Benchmark with Hierarchical Subject Taxonomy for Subject-Driven Text-to-Image Generation9 Mar 2026
- 2026PureCC: Pure Learning for Text-to-Image Concept Customization8 Mar 2026
- 2026Inject Where It Matters: Training-Free Spatially-Adaptive Identity Preservation for Text-to-Image Personalization15 Feb 2026
- 2026FlexID: Training-Free Flexible Identity Injection via Intent-Aware Modulation for Text-to-Image Generation7 Feb 2026
- 2026Hierarchical Concept-to-Appearance Guidance for Multi-Subject Image Generation3 Feb 2026
- 2026Beyond Pixels: Visual Metaphor Transfer via Schema-Driven Agentic Reasoning1 Feb 2026
- 2026PerfGuard: A Performance-Aware Agent for Visual Content Generation30 Jan 2026
- 2026TeleStyle: Content-Preserving Style Transfer in Images and Videos28 Jan 2026
- 2026OmniTransfer: All-in-one Framework for Spatio-temporal Video Transfer20 Jan 2026
- 2026TAG-MoE: Task-Aware Gating for Unified Generative Mixture-of-Experts12 Jan 2026
- 2026Towards Generalized Multi-Image Editing for Unified Multimodal Models9 Jan 2026
- 2026QwenStyle: Content-Preserving Style Transfer with Qwen-Image-Edit8 Jan 2026
- 2025DreamOmni3: Scribble-based Editing and Generation27 Dec 2025
- 2025InstructMoLE: Instruction-Guided Mixture of Low-rank Experts for Multi-Conditional Image Generation25 Dec 2025
- 2025ACD: Direct Conditional Control for Video Diffusion Models via Attention Supervision24 Dec 2025
- 2025DVI: Disentangling Semantic and Visual Identity for Training-Free Personalized Generation22 Dec 2025
- 2025Dynamic Image Prompt Adapter for Scalable Zero-shot Personalized Text-to-Image Generation10 Dec 2025
- 2025OpenSubject: Leveraging Video-Derived Identity and Diversity Priors for Subject-driven Image Generation and Manipulation9 Dec 2025
- 2025Not All Birds Look The Same: Identity-Preserving Generation For Birds4 Dec 2025
- 2025DreamingComics: A Story Visualization Pipeline via Subject and Layout Customized Generation using Video Models1 Dec 2025
- 2025Ar2Can: An Architect and an Artist Leveraging a Canvas for Multi-Human Generation27 Nov 2025
- 2025Canvas-to-Image: Compositional Image Generation with Multimodal Controls26 Nov 2025
- 2025The Consistency Critic: Correcting Inconsistencies in Generated Images via Reference-Guided Attentive Alignment25 Nov 2025
50 newest of 83 All 83 (JSON)
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulationcited by 56
- 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Designcited by 36
- 2025FullDiT2: Efficient In-Context Conditioning for Video Diffusion Transformerscited by 18
- 2025ContextGen: Contextual Layout Anchoring for Identity-Consistent Multi-Instance Generationcited by 18
- 2025LAMIC: Layout-Aware Multi-Image Composition via Scalability of Multimodal Diffusion Transformercited by 7
- 2026TAG-MoE: Task-Aware Gating for Unified Generative Mixture-of-Expertscited by 6
- 2025OmniRefiner: Reinforcement-Guided Local Diffusion Refinementcited by 5
- 2025Canvas-to-Image: Compositional Image Generation with Multimodal Controlscited by 5
- 2026TeleStyle: Content-Preserving Style Transfer in Images and Videoscited by 5
- 2026QwenStyle: Content-Preserving Style Transfer with Qwen-Image-Editcited by 4
- 2026CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillationcited by 3
- 2025Adversarial Concept Distillation for One-Step Diffusion Personalizationcited by 1
12 most cited of 21 All 21 (JSON)
- 2026ICDepth: Taming Video Diffusion Models for Video Depth Estimation via In-Context Conditioning2 Jul 2026
- 2026CogCanvas: A Benchmark for Evaluating Multi-Subject Reference-Based Image Generation14 Jun 2026
- 2026CollectionLoRA: Collecting 50 Effects in 1 LoRA via Multi-Teacher On-Policy Distillation25 May 2026
- 2026The Silent Brush: Evaluating Artistic Style Leakage in AI Art Generation17 May 2026
- 2026DreamShot: Personalized Storyboard Synthesis with Video Diffusion Prior19 Apr 2026
- 2026OmniDiT: Extending Diffusion Transformer to Omni-VTON Framework20 Mar 2026
- 2026PROMO: Promptable Outfitting for Efficient High-Fidelity Virtual Try-On12 Mar 2026
- 2026Hierarchical Concept-to-Appearance Guidance for Multi-Subject Image Generation3 Feb 2026
- 2026TeleStyle: Content-Preserving Style Transfer in Images and Videos28 Jan 2026
- 2026TAG-MoE: Task-Aware Gating for Unified Generative Mixture-of-Experts12 Jan 2026
- 2026QwenStyle: Content-Preserving Style Transfer with Qwen-Image-Edit8 Jan 2026
- 2025InstructMoLE: Instruction-Guided Mixture of Low-rank Experts for Multi-Conditional Image Generation25 Dec 2025
12 newest of 21 All 21 (JSON)
- 2026Squeezing Capacity from Multimodal Large Language Models for Subject-driven Generation25 May 2026
- 2026Images in Sentences: Scaling Interleaved Instructions for Unified Visual Generation12 May 2026
- 2025MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizer19 Sep 2025
- 2026Mixture of Style Experts for Diverse Image Stylizationcited by 1
- 2026Mixture of Style Experts for Diverse Image Stylization17 Mar 2026
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2025DreamOmni2: Multimodal Instruction-based Editing and Generationcited by 38
- 2025Stand-In: A Lightweight and Plug-and-Play Identity Control for Video Generationcited by 28
- 2025USO: Unified Style and Subject-Driven Generation via Disentangled and Reward Learningcited by 27
- 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learningcited by 25
- 2025UMO: Scaling Multi-Identity Consistency for Image Customization via Matching Rewardcited by 19
- 2025MMIG-Bench: Towards Comprehensive and Explainable Evaluation of Multi-Modal Image Generation Modelscited by 17
- 2025Phantom-Data : Towards a General Subject-Consistent Video Generation Datasetcited by 17
- 2025WithAnyone: Towards Controllable and ID Consistent Image Generationcited by 17
- 2025DreamPoster: A Unified Framework for Image-Conditioned Generative Poster Designcited by 16
- 2025MOSAIC: Multi-Subject Personalized Generation via Correspondence-Aware Alignment and Disentanglementcited by 14
- 2026Lance: Unified Multimodal Modeling by Multi-Task Synergycited by 12
12 most cited of 53 All 53 (JSON)
- 2026ScribbleEdit: A Benchmark for Scribble-Only Image Editing7 Oct 2026
- 2026WithEveryone: Unified Planning and Identity Grounding for Group Image Generation20 Aug 2026
- 2026CRAFT: Constrained Reward via Attention Fine-Tuning for Subject Personalization without Composed Targets14 Aug 2026
- 2026CopyCat: Improving Fine-Grained Subject Consistency in Subject-to-Image Models within Seconds1 Aug 2026
- 2026MPIE-Bench: Benchmarking Anatomically Plausible Multi-Person Interaction Editing30 Jul 2026
- 2026LCG: Long-Context Consistent Image Generation with Sparse Relational Attention24 Jun 2026
- 2026UniVerse: A Unified Modulation Framework for Segmentation-Free,Disentangled Multi-Concept Personalization29 May 2026
- 2026Lance: Unified Multimodal Modeling by Multi-Task Synergy18 May 2026
- 2026UniCustom: Unified Visual Conditioning for Multi-Reference Image Generation12 May 2026
- 2026Fashion130K: An E-commerce Fashion Dataset for Outfit Generation with Unified Multi-modal Condition11 May 2026
- 2026Training-Free Image Editing with Visual Context Integration and Concept Alignment6 Apr 2026
- 2026AnyPhoto: Multi-Person Identity Preserving Image Generation with ID Adaptive Modulation on Location Canvas16 Mar 2026
12 newest of 53 All 53 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2023CustomNet: Zero-shot Object Customization with Variable-Viewpoints in Text-to-Image Diffusion Models
- 2025DreamMakeup: Face Makeup Customization using Latent Diffusion Models
- 2025T-LoRA: Single Image Diffusion Model Customization Without Overfitting
- 2026MS-CustomNet: Controllable Multi-Subject Customization with Hierarchical Relational Semantics
- 2024MagicFace: Training-free Universal-Style Human Image Customized Synthesis
- 2023DreamInpainter: Text-Guided Subject-Driven Image Inpainting with Diffusion Models
- 2023DreamVideo: Composing Your Dream Videos with Customized Subject and Motion
- 2024LoRA-Composer: Leveraging Low-Rank Adaptation for Multi-Concept Customization in Training-Free Diffusion Models