mlsanityData to 14 Oct 2026

HiDream-O1-Image: A Natively Unified Image Generative Foundation Model with Pixel-level Unified Transformer

arXiv 2605.11061 ↗First posted 11 May 2026cs.CV cs.MMcited by 32

Not on the map. Why?

Abstract (arXiv)

The evolution of visual generative models has long been constrained by fragmented architectures relying on disjoint text encoders and external VAEs. In this report, we present HiDream-O1-Image, a natively unified generative foundation model via pixel-space Diffusion Transformer, that pioneers a paradigm shift from modular architectures to an end-to-end in-context visual generation engine. By mapping raw image pixels, text tokens, and task-specific conditions into a single shared token space, HiDream-O1-Image achieves a structural unification of multimodal inputs within an Unified Transformer (UiT) architecture. This native encoding paradigm eliminates the need for separate VAEs or disjoint pre-trained text encoders, allowing the model to treat diverse generation and editing tasks as a consistent in-context reasoning process. Extensive experiments show that HiDream-O1-Image excels across various generation tasks, including text-to-image generation, instruction-based editing, and subject-driven personalization. Notably, with only 8B parameters, HiDream-O1-Image (8B) achieves performance parity with or even surpasses established state-of-the-art models with significantly larger parameters (e.g., 27B Qwen-Image). Crucially, to validate the immense scalability of this paradigm, we successfully scale the architecture up to over 200B parameters. Experimental results demonstrate that this massive-scale version HiDream-O1-Image-Pro (200B+) unlocks unprecedented generative capabilities and superior performance, establishing new state-of-the-art benchmarks. Ultimately, HiDream-O1-Image highlights the immense potential of natively unified architectures and charts a highly scalable path toward next-generation multimodal AI.

Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 52 of its 66 references that are in the map. First posted on arXiv 11 May 2026.

Builds on

52 of 66 references.

References · 52

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2022Scalable Diffusion Models with Transformerscited by 6,054
  7. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  8. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  9. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  10. 2025Qwen3-VL Technical Reportcited by 2,793
  11. 2020GLU Variants Improve Transformercited by 1,804
  12. 2019Root Mean Square Layer Normalizationcited by 1,480
38 more
  1. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  2. 2025Qwen-Image Technical Reportcited by 1,044
  3. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
  4. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
  5. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  6. 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
  7. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  8. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  9. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
  10. 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
  11. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  12. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  13. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
  14. 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 424
  15. 2024OmniGen: Unified Image Generationcited by 394
  16. 2024The Faiss librarycited by 376
  17. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  18. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  19. 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
  20. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
  21. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
  22. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
  23. 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
  24. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
  25. 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
  26. 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 176
  27. 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
  28. 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 163
  29. 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
  30. 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
  31. 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 132
  32. 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 112
  33. 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
  34. 2024SD-DiT: Unleashing the Power of Self-supervised Discrimination in Diffusion Transformercited by 49
  35. 2025DreamOmni2: Multimodal Instruction-based Editing and Generationcited by 38
  36. 20243DIS: Depth-Driven Decoupled Instance Synthesis for Text-to-Image Generationcited by 37
  37. 2024Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinementcited by 37
  38. 2025Visual Autoregressive Modeling for Instruction-Guided Image Editingcited by 22

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 32.

32 papers.

Sort:

By area:

  1. 2026Toward Native Multimodal Modeling: A Roadmapcited by 7
  2. 2026SenseNova-U1.5: Towards Native Unified Visual Intelligencecited by 7
  3. 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budgetcited by 6
  4. 2026An Empirical Study of Training Pixel-Space Text-to-Image Diffusion Modelscited by 6
  5. 2026Compressing Image Style Training into a Single Model Forwardcited by 2
  6. 2026Exploring the Performance Frontier of Compact Unified Image Generation Modelscited by 2
  7. 2026GenFirst: Generation Before Reconstruction for Stable End-to-End Latent Generative Modelingcited by 2
  8. 2026WeGenBench: A Multidimensional Diagnostic Benchmark towards Text-to-Image Model Optimizationcited by 1
  9. 2026Pixel-Space Diffusion Transformerscited by 1
  10. 2026The Second LoViF 2026 Challenge on Real-World All-in-One Image Restoration: Methods and Resultscited by 1
  11. 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generationcited by 1
  12. 2026Test-Time Curriculum for Open-Set AIGC Detectioncited by 0
20 more
  1. 2026Energy-Guided Flow Matchingcited by 0
  2. 2026MaskFlow: Precise, Consistent and Seamless Regional Image Editingcited by 0
  3. 2026WithEveryone: Unified Planning and Identity Grounding for Group Image Generationcited by 0
  4. 2026ReART: Reference-Guided Retrieval and Refinement for Emotion-Aware Art Generationcited by 0
  5. 2026Scalable Question-Centric Text-to-Image Evaluation: Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routingcited by 0
  6. 2026Multi2AV-Safety: Benchmarking Safety in Multimodal-to-Audio-Video Generationcited by 0
  7. 2026RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animationcited by 0
  8. 2026EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoderscited by 0
  9. 2026Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEvalcited by 0
  10. 2026MindTopo: Can Foundation Models Reason in Topological Space?cited by 0
  11. 2026Beyond Natural Images: Rethinking AI-Generated Image Detection in Documentscited by 0
  12. 2026Moonworks Lunara: Modeling Artistic Intelligencecited by 0
  13. 2026CollageAttack: Exploiting Cross-Modal Alignment Flaws in T2I Models through Spatial Text Compositioncited by 0
  14. 2026CAST: Causal Advantage-Structured Training with Spatially Grounded Compositional Rewards for Diffusion Modelscited by 0
  15. 2026Do Generative Priors Align with Human Naturalness Perception?cited by 0
  16. 2026From Prompting to Composing: A Spatial Canvas Interface for Poster Generationcited by 0
  17. 2026Reasoning-Informed Visual Editingcited by 0
  18. 2026InfoVis: Unified Slide Image Generation and Editingcited by 0
  19. 2026Scaling Unified Multimodal Models to Long-Horizon Interleaved Generationcited by 0
  20. 2026Efficient Scene-Text Refinement via Pixel-Space Grouped Image Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026VINO: A Unified Visual Generator with Interleaved OmniModal Context
  2. 2025Query-Kontext: An Unified Multimodal Model for Image Generation and Editing
  3. 2025UniModel: A Visual-Only Framework for Unified Multimodal Understanding and Generation
  4. 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Model
  5. 2025UniFusion: Vision-Language Model as Unified Encoder in Image Generation
  6. 2026Mage-Flow: An Efficient Native-Resolution Foundation Model for Image Generation and Editing
  7. 2026Wan-Image: Pushing the Boundaries of Generative Visual Intelligence
  8. 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild