mlsanityData to 7 Oct 2026

SIGMA: Selective-Interleaved Generation with Multi-Attribute Tokens

arXiv 2602.07564 ↗First posted 7 Feb 2026cs.CVcited by 2

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Recent unified models such as Bagel demonstrate that paired image-edit data can effectively align multiple visual tasks within a single diffusion transformer. However, these models remain limited to single-condition inputs and lack the flexibility needed to synthesize results from multiple heterogeneous sources. We present SIGMA (Selective-Interleaved Generation with Multi-Attribute Tokens), a unified post-training framework that enables interleaved multi-condition generation within diffusion transformers. SIGMA introduces selective multi-attribute tokens, including style, content, subject, and identity tokens, which allow the model to interpret and compose multiple visual conditions in an interleaved text-image sequence. Through post-training on the Bagel unified backbone with 700K interleaved examples, SIGMA supports compositional editing, selective attribute transfer, and fine-grained multimodal alignment. Extensive experiments show that SIGMA improves controllability, cross-condition consistency, and visual quality across diverse editing and generation tasks, with substantial gains over Bagel on compositional tasks.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 59 of its 67 references that are in the map. First posted on arXiv 7 Feb 2026.

Builds on

59 of 67 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025OmniPSD: Layered PSD Generation with Diffusion Transformer10 Dec
  2. 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulation26 Jun
  3. 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Rendering30 May
  4. 2025Enhancing Text-to-Image Diffusion Transformer via Split-Text Conditioning25 May
  5. 2025MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generation3 Feb
  6. 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformer3 Feb
  7. 2024DiT4Edit: Diffusion Transformer for Image Editing5 Nov
  8. 2024OmniGen: Unified Image Generation17 Sep
  9. 2024CSGO: Content-Style Composition in Text-to-Image Generation29 Aug
  10. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  11. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
2 more
  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May
  2. 2022Hierarchical Text-Conditional Image Generation with CLIP Latents13 Apr

Other references · 45

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  5. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  6. 2022Scalable Diffusion Models with Transformerscited by 5,931
  7. 2022Generative Adversarial Networkscited by 5,603
  8. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  9. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  10. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  11. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
  12. 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
33 more
  1. 2020Object-Centric Learning with Slot Attentioncited by 865
  2. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  3. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
  4. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  5. 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
  6. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  7. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
  8. 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
  9. 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
  10. 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
  11. 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
  12. 2020On the Binding Problem in Artificial Neural Networkscited by 230
  13. 2020SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decompositioncited by 190
  14. 2023One Transformer Fits All Distributions in Multi-Modal Diffusion at Scalecited by 185
  15. 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
  16. 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 146
  17. 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
  18. 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
  19. 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
  20. 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
  21. 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
  22. 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 62
  23. 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
  24. 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 37
  25. 2024InstantSwap: Fast Customized Concept Swapping across Sharp Shape Differencescited by 34
  26. 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learningcited by 24
  27. 2025DiffDecompose: Layer-Wise Decomposition of Alpha-Composited Images via Diffusion Transformerscited by 20
  28. 2025WordCon: Word-level Typography Control in Scene Text Renderingcited by 16
  29. 2025Personalized Vision via Visual In-Context Learningcited by 14
  30. 2025WeGen: A Unified Model for Interactive Multimodal Generation as We Chatcited by 7
  31. 2025IC-Effect: Precise and Efficient Video Effects Editing via In-Context Learningcited by 4
  32. 2025Loom: Diffusion-Transformer for Interleaved Generationcited by 3
  33. 2025Markovian Scale Prediction: A New Era of Visual Autoregressive Generationcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editor
  2. 2025EditAR: Unified Conditional Generation with Autoregressive Models
  3. 2023Textual and Visual Prompt Fusion for Image Editing via Step-Wise Alignment
  4. 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
  5. 2025Towards Transformer-Based Aligned Generation with Self-Coherence Guidance
  6. 2026Language-Free Generative Editing from One Visual Example
  7. 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methods
  8. 2025MIGE: Mutually Enhanced Multimodal Instruction-Based Image Generation and Editing