mlsanityData to 7 Oct 2026

UniCombine: Unified Multi-Conditional Combination with Diffusion Transformer

arXiv 2503.09277 ↗First posted 12 Mar 2025cs.CV cs.AIcited by 25

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

With the rapid development of diffusion models in image generation, the demand for more powerful and flexible controllable frameworks is increasing. Although existing methods can guide generation beyond text prompts, the challenge of effectively combining multiple conditional inputs while maintaining consistency with all of them remains unsolved. To address this, we introduce UniCombine, a DiT-based multi-conditional controllable generative framework capable of handling any combination of conditions, including but not limited to text prompts, spatial maps, and subject images. Specifically, we introduce a novel Conditional MMDiT Attention mechanism and incorporate a trainable LoRA module to build both the training-free and training-based versions. Additionally, we propose a new pipeline to construct SubjectSpatial200K, the first dataset designed for multi-conditional generative tasks covering both the subject-driven and spatially-aligned conditions. Extensive experimental results on multi-conditional generation demonstrate the outstanding universality and powerful capability of our approach with state-of-the-art performance.

Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 50 of its 61 references that are in the map. First posted on arXiv 12 Mar 2025.

Builds on

50 of 61 references.

Closest ancestors · 18

Same direction, newest first

  1. 2024Semantic Image Inversion and Editing using Rectified Stochastic Differential Equations14 Oct
  2. 2024CSGO: Content-Style Composition in Text-to-Image Generation29 Aug
  3. 2024Ctrl-X: Controlling Structure and Appearance for Text-To-Image Generation Without Guidance11 Jun
  4. 2024Tuning-Free Image Customization with Image and Text Guidance19 Mar
  5. 2024InstanceDiffusion: Instance-level Control for Image Generation5 Feb
  6. 2024InstantID: Zero-shot Identity-Preserving Generation in Seconds15 Jan
  7. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  8. 2023Zero-shot spatial layout conditioning for text-to-image diffusion models23 Jun
  9. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Models25 May
  10. 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild18 May
  11. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
6 more
  1. 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
  2. 2022Imagen Editor and EditBench: Advancing and Evaluating Text-Guided Image Inpainting13 Dec
  3. 2022Multi-Concept Customization of Text-to-Image Diffusion8 Dec
  4. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Models23 Nov
  5. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Models17 Nov
  6. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation25 Aug

Other references · 32

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,893
  7. 2022Scalable Diffusion Models with Transformerscited by 5,931
  8. 2022Generative Adversarial Networkscited by 5,603
  9. 2022Flow Matching for Generative Modelingcited by 5,426
  10. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  11. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  12. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
20 more
  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  2. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  3. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,231
  4. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  5. 2023BLIP-Diffusion: Pre-trained Subject Representation for Controllable Text-to-Image Generation and Editingcited by 438
  6. 2023AnyDoor: Zero-shot Object-level Image Customizationcited by 411
  7. 2024OminiControl: Minimal and Universal Control for Diffusion Transformercited by 334
  8. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
  9. 2023StyleDrop: Text-to-Image Generation in Any Stylecited by 197
  10. 2023A Task is Worth One Word: Learning with Task Prompts for High-Quality Versatile Image Inpaintingcited by 168
  11. 2024CatVTON: Concatenation Is All You Need for Virtual Try-On with Diffusion Modelscited by 99
  12. 2024FitDiT: Advancing the Authentic Garment Details for High-fidelity Virtual Try-oncited by 39
  13. 2022ObjectStitch: Generative Object Compositingcited by 36
  14. 2024InstantFamily: Masked Attention for Zero-shot Multi-ID Image Generationcited by 30
  15. 2024StyleBooth: Image Style Editing with Multimodal Instructioncited by 28
  16. 2024ObjectMate: A Recurrence Prior for Object Insertion and Subject-Driven Generationcited by 16
  17. 2023Stroke-based Neural Painting and Stylization with Dynamically Predicted Painting Regioncited by 14
  18. 2022FRIH: Fine-grained Region-aware Image Harmonizationcited by 9
  19. 2024MureObjectStitch: Multi-reference Image Compositioncited by 4
  20. 2024Mamba-YOLO-World: Marrying YOLO-World with Mamba for Open-Vocabulary Detectioncited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 15; 2026: 10.

25 papers.

Sort:

By area:

  1. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 89
  2. 2025CreatiDesign: A Unified Multi-Conditional Diffusion Transformer for Creative Graphic Designcited by 36
  3. 2025Does FLUX Already Know How to Perform Physically Plausible Image Composition?cited by 30
  4. 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learningcited by 24
  5. 2025DivControl: Knowledge Diversion for Controllable Image Generationcited by 7
  6. 2025JCo-MVTON: Jointly Controllable Multi-Modal Diffusion Transformer for Mask-Free Virtual Try-oncited by 7
  7. 2025Context-Aware Autoregressive Models for Multi-Conditional Image Generationcited by 5
  8. 2025SIGMA-GEN: Structure and Identity Guided Multi-subject Assembly for Image Generationcited by 5
  9. 2025The Consistency Critic: Correcting Inconsistencies in Generated Images via Reference-Guided Attentive Alignmentcited by 5
  10. 2025Inverse Virtual Try-On: Generating Multi-Category Product-Style Images from Clothed Individualscited by 4
  11. 2025PositionIC: Unified Position and Identity Consistency for Image Customizationcited by 4
  12. 2025Universal Few-Shot Spatial Control for Diffusion Modelscited by 2
13 more
  1. 2025Task-Oriented Data Synthesis and Control-Rectify Sampling for Remote Sensing Semantic Segmentationcited by 2
  2. 2026RefAny3D: 3D Asset-Referenced Diffusion Models for Image Generationcited by 2
  3. 2026ChArtist: Generating Pictorial Charts with Unified Spatial and Subject Controlcited by 1
  4. 2025Condition Weaving Meets Expert Modulation: Towards Universal and Controllable Image Generationcited by 0
  5. 2025TokenAR: Multiple Subject Generation via Autoregressive Token-level enhancementcited by 0
  6. 2026Rethinking Multi-Condition DiTs: Eliminating Redundant Attention via Position-Alignment and Keyword-Scopingcited by 0
  7. 2026Reflection Generation for Composite Image Using Diffusion Modelcited by 0
  8. 2026FLUX3D: High-Fidelity 3D Gaussian Generation with Diffusion-Aligned Sparse Representationcited by 0
  9. 2026Instruction-based Image Editing: A Survey on Data, Models, Evaluation, and Applicationscited by 0
  10. 2026ControlRef: Efficient Layout-Guided Multi-Instance Generation via Anchored 4D-RoPEcited by 0
  11. 2026presto: Efficient, Training-free, and Open-world Object Placement via Imaginary Searchcited by 0
  12. 2026RAGDiffusion++: From Macro-Retrieval to Micro-Fidelity Alignment for Garment Generationcited by 0
  13. 2026Principal-timestep Restricted Init via Sparse Matrix-decomposition in Flow-matchingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024UNIMO-G: Unified Image Generation through Multimodal Conditional Diffusion
  2. 2023CoDi: Conditional Diffusion Distillation for Higher-Fidelity and Faster Image Generation
  3. 2023Steered Diffusion: A Generalized Framework for Plug-and-Play Conditional Image Synthesis
  4. 2024UNIC-Adapter: Unified Image-instruction Adapter with Multi-modal Transformer for Image Generation
  5. 2024A Simple Approach to Unifying Diffusion-based Conditional Generation
  6. 2023Unified Multi-Modal Latent Diffusion for Joint Subject and Text Conditional Image Generation
  7. 2024Controllable Generation with Text-to-Image Diffusion Models: A Survey
  8. 2025OminiControl2: Efficient Conditioning for Diffusion Transformers