SIGMA: Selective-Interleaved Generation with Multi-Attribute Tokens
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Recent unified models such as Bagel demonstrate that paired image-edit data can effectively align multiple visual tasks within a single diffusion transformer. However, these models remain limited to single-condition inputs and lack the flexibility needed to synthesize results from multiple heterogeneous sources. We present SIGMA (Selective-Interleaved Generation with Multi-Attribute Tokens), a unified post-training framework that enables interleaved multi-condition generation within diffusion transformers. SIGMA introduces selective multi-attribute tokens, including style, content, subject, and identity tokens, which allow the model to interpret and compose multiple visual conditions in an interleaved text-image sequence. Through post-training on the Bagel unified backbone with 700K interleaved examples, SIGMA supports compositional editing, selective attribute transfer, and fine-grained multimodal alignment. Extensive experiments show that SIGMA improves controllability, cross-condition consistency, and visual quality across diverse editing and generation tasks, with substantial gains over Bagel on compositional tasks.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 59 of its 67 references that are in the map. First posted on arXiv 7 Feb 2026.
Builds on
59 of 67 references.
Closest ancestors · 14
Same direction, newest first
- 2025OmniPSD: Layered PSD Generation with Diffusion Transformer10 Dec
- 2025XVerse: Consistent Multi-Subject Control of Identity and Semantic Attributes via DiT Modulation26 Jun
- 2025EasyText: Controllable Diffusion Transformer for Multilingual Text Rendering30 May
- 2025Enhancing Text-to-Image Diffusion Transformer via Split-Text Conditioning25 May
- 2025MakeAnything: Harnessing Diffusion Transformers for Multi-Domain Procedural Sequence Generation3 Feb
- 2025LayerTracer: Cognitive-Aligned Layered SVG Synthesis via Diffusion Transformer3 Feb
- 2024DiT4Edit: Diffusion Transformer for Image Editing5 Nov
- 2024OmniGen: Unified Image Generation17 Sep
- 2024CSGO: Content-Style Composition in Text-to-Image Generation29 Aug
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Models16 Feb
- 2023Adding Conditional Control to Text-to-Image Diffusion Models10 Feb
2 more
Other references · 45
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Generative Adversarial Networkscited by 5,603
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
33 more
- 2020Object-Centric Learning with Slot Attentioncited by 865
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 854
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2023Muse: Text-To-Image Generation via Masked Generative Transformerscited by 640
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 447
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
- 2023Follow Your Pose: Pose-Guided Text-to-Video Generation using Pose-Free Videoscited by 312
- 2018Diverse Image-to-Image Translation via Disentangled Representationscited by 296
- 2023OmniControl: Control Any Joint at Any Time for Human Motion Generationcited by 233
- 2020On the Binding Problem in Artificial Neural Networkscited by 230
- 2020SPACE: Unsupervised Object-Oriented Scene Representation via Spatial Attention and Decompositioncited by 190
- 2023One Transformer Fits All Distributions in Multi-Modal Diffusion at Scalecited by 185
- 2024Follow-Your-Emoji: Fine-Controllable and Expressive Freestyle Portrait Animationcited by 172
- 2022SlotFormer: Unsupervised Visual Dynamics Simulation with Object-Centric Modelscited by 146
- 2023SSR-Encoder: Encoding Selective Subject Representation for Subject-Driven Generationcited by 142
- 2025EasyControl: Adding Efficient and Flexible Control for Diffusion Transformercited by 118
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
- 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
- 2025Follow-Your-Motion: Video Motion Transfer via Efficient Spatial-Temporal Decoupled Finetuningcited by 81
- 2025Any2AnyTryon: Leveraging Adaptive Position Embeddings for Versatile Virtual Clothing Taskscited by 62
- 2024FonTS: Text Rendering with Typography and Style Controlscited by 40
- 2024ProcessPainter: Learn Painting Process from Sequence Datacited by 37
- 2024InstantSwap: Fast Customized Concept Swapping across Sharp Shape Differencescited by 34
- 2025X2Edit: Revisiting Arbitrary-Instruction Image Editing through Self-Constructed Data and Task-Aware Representation Learningcited by 24
- 2025DiffDecompose: Layer-Wise Decomposition of Alpha-Composited Images via Diffusion Transformerscited by 20
- 2025WordCon: Word-level Typography Control in Scene Text Renderingcited by 16
- 2025Personalized Vision via Visual In-Context Learningcited by 14
- 2025WeGen: A Unified Model for Interactive Multimodal Generation as We Chatcited by 7
- 2025IC-Effect: Precise and Efficient Video Effects Editing via In-Context Learningcited by 4
- 2025Loom: Diffusion-Transformer for Interleaved Generationcited by 3
- 2025Markovian Scale Prediction: A New Era of Visual Autoregressive Generationcited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2023PAIR-Diffusion: A Comprehensive Multimodal Object-Level Image Editor
- 2025EditAR: Unified Conditional Generation with Autoregressive Models
- 2023Textual and Visual Prompt Fusion for Image Editing via Step-Wise Alignment
- 2026Editing on the Generative Manifold: A Theoretical and Empirical Study of General Diffusion-Based Image Editing Trade-offs
- 2025Towards Transformer-Based Aligned Generation with Self-Coherence Guidance
- 2026Language-Free Generative Editing from One Visual Example
- 2023EditVal: Benchmarking Diffusion Based Text-Guided Image Editing Methods
- 2025MIGE: Mutually Enhanced Multimodal Instruction-Based Image Generation and Editing