HiDream-O1-Image: A Natively Unified Image Generative Foundation Model with Pixel-level Unified Transformer
Not on the map. Why?
Abstract (arXiv)
The evolution of visual generative models has long been constrained by fragmented architectures relying on disjoint text encoders and external VAEs. In this report, we present HiDream-O1-Image, a natively unified generative foundation model via pixel-space Diffusion Transformer, that pioneers a paradigm shift from modular architectures to an end-to-end in-context visual generation engine. By mapping raw image pixels, text tokens, and task-specific conditions into a single shared token space, HiDream-O1-Image achieves a structural unification of multimodal inputs within an Unified Transformer (UiT) architecture. This native encoding paradigm eliminates the need for separate VAEs or disjoint pre-trained text encoders, allowing the model to treat diverse generation and editing tasks as a consistent in-context reasoning process. Extensive experiments show that HiDream-O1-Image excels across various generation tasks, including text-to-image generation, instruction-based editing, and subject-driven personalization. Notably, with only 8B parameters, HiDream-O1-Image (8B) achieves performance parity with or even surpasses established state-of-the-art models with significantly larger parameters (e.g., 27B Qwen-Image). Crucially, to validate the immense scalability of this paradigm, we successfully scale the architecture up to over 200B parameters. Experimental results demonstrate that this massive-scale version HiDream-O1-Image-Pro (200B+) unlocks unprecedented generative capabilities and superior performance, establishing new state-of-the-art benchmarks. Ultimately, HiDream-O1-Image highlights the immense potential of natively unified architectures and charts a highly scalable path toward next-generation multimodal AI.
Key facts. Cited by 32 papers in the map (data through 14 Oct 2026). Builds on 52 of its 66 references that are in the map. First posted on arXiv 11 May 2026.
Builds on
52 of 66 references.
References · 52
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2020GLU Variants Improve Transformercited by 1,804
- 2019Root Mean Square Layer Normalizationcited by 1,480
38 more
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2025Qwen-Image Technical Reportcited by 1,044
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2023PixArt-α: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesiscited by 864
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2024Improved Distribution Matching Distillation for Fast Image Synthesiscited by 684
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 429
- 2022Diffusion Art or Digital Forgery? Investigating Data Replication in Diffusion Modelscited by 424
- 2024OmniGen: Unified Image Generationcited by 394
- 2024The Faiss librarycited by 376
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 277
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 249
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 231
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
- 2025HPSv3: Towards Wide-Spectrum Human Preference Scorecited by 211
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformercited by 204
- 2023VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluationcited by 201
- 2022A Self-Supervised Descriptor for Image Copy Detectioncited by 176
- 2023AnyText: Multilingual Visual Text Generation And Editingcited by 170
- 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 163
- 2025HiDream-I1: A High-Efficient Image Generative Foundation Model with Sparse Diffusion Transformercited by 141
- 2023TextDiffuser-2: Unleashing the Power of Language Models for Text Renderingcited by 140
- 2024Lumina-Next: Making Lumina-T2X Stronger and Faster with Next-DiTcited by 132
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 112
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
- 2024SD-DiT: Unleashing the Power of Self-supervised Discrimination in Diffusion Transformercited by 49
- 2025DreamOmni2: Multimodal Instruction-based Editing and Generationcited by 38
- 20243DIS: Depth-Driven Decoupled Instance Synthesis for Text-to-Image Generationcited by 37
- 2024Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinementcited by 37
- 2025Visual Autoregressive Modeling for Instruction-Guided Image Editingcited by 22
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2026: 32.
32 papers.
Sort:
By area:
- 2026Toward Native Multimodal Modeling: A Roadmapcited by 7
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligencecited by 7
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budgetcited by 6
- 2026An Empirical Study of Training Pixel-Space Text-to-Image Diffusion Modelscited by 6
- 2026Compressing Image Style Training into a Single Model Forwardcited by 2
- 2026Exploring the Performance Frontier of Compact Unified Image Generation Modelscited by 2
- 2026GenFirst: Generation Before Reconstruction for Stable End-to-End Latent Generative Modelingcited by 2
- 2026WeGenBench: A Multidimensional Diagnostic Benchmark towards Text-to-Image Model Optimizationcited by 1
- 2026Pixel-Space Diffusion Transformerscited by 1
- 2026The Second LoViF 2026 Challenge on Real-World All-in-One Image Restoration: Methods and Resultscited by 1
- 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generationcited by 1
- 2026Test-Time Curriculum for Open-Set AIGC Detectioncited by 0
20 more
- 2026Energy-Guided Flow Matchingcited by 0
- 2026MaskFlow: Precise, Consistent and Seamless Regional Image Editingcited by 0
- 2026WithEveryone: Unified Planning and Identity Grounding for Group Image Generationcited by 0
- 2026ReART: Reference-Guided Retrieval and Refinement for Emotion-Aware Art Generationcited by 0
- 2026Scalable Question-Centric Text-to-Image Evaluation: Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routingcited by 0
- 2026Multi2AV-Safety: Benchmarking Safety in Multimodal-to-Audio-Video Generationcited by 0
- 2026RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animationcited by 0
- 2026EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoderscited by 0
- 2026Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEvalcited by 0
- 2026MindTopo: Can Foundation Models Reason in Topological Space?cited by 0
- 2026Beyond Natural Images: Rethinking AI-Generated Image Detection in Documentscited by 0
- 2026Moonworks Lunara: Modeling Artistic Intelligencecited by 0
- 2026CollageAttack: Exploiting Cross-Modal Alignment Flaws in T2I Models through Spatial Text Compositioncited by 0
- 2026CAST: Causal Advantage-Structured Training with Spatially Grounded Compositional Rewards for Diffusion Modelscited by 0
- 2026Do Generative Priors Align with Human Naturalness Perception?cited by 0
- 2026From Prompting to Composing: A Spatial Canvas Interface for Poster Generationcited by 0
- 2026Reasoning-Informed Visual Editingcited by 0
- 2026InfoVis: Unified Slide Image Generation and Editingcited by 0
- 2026Scaling Unified Multimodal Models to Long-Horizon Interleaved Generationcited by 0
- 2026Efficient Scene-Text Refinement via Pixel-Space Grouped Image Generationcited by 0
- 2026Efficient Scene-Text Refinement via Pixel-Space Grouped Image Generation13 Oct 2026
- 2026Scaling Unified Multimodal Models to Long-Horizon Interleaved Generation12 Oct 2026
- 2026InfoVis: Unified Slide Image Generation and Editing12 Oct 2026
- 2026Reasoning-Informed Visual Editing8 Oct 2026
- 2026From Prompting to Composing: A Spatial Canvas Interface for Poster Generation8 Oct 2026
- 2026Do Generative Priors Align with Human Naturalness Perception?7 Oct 2026
- 2026CAST: Causal Advantage-Structured Training with Spatially Grounded Compositional Rewards for Diffusion Models30 Sep 2026
- 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation29 Sep 2026
- 2026CollageAttack: Exploiting Cross-Modal Alignment Flaws in T2I Models through Spatial Text Composition29 Sep 2026
- 2026Beyond Natural Images: Rethinking AI-Generated Image Detection in Documents13 Sep 2026
- 2026Moonworks Lunara: Modeling Artistic Intelligence11 Sep 2026
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligence10 Sep 2026
20 more
- 2026MindTopo: Can Foundation Models Reason in Topological Space?10 Sep 2026
- 2026Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEval10 Sep 2026
- 2026EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders3 Sep 2026
- 2026GenFirst: Generation Before Reconstruction for Stable End-to-End Latent Generative Modeling29 Aug 2026
- 2026RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animation28 Aug 2026
- 2026Multi2AV-Safety: Benchmarking Safety in Multimodal-to-Audio-Video Generation27 Aug 2026
- 2026Scalable Question-Centric Text-to-Image Evaluation: Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routing25 Aug 2026
- 2026ReART: Reference-Guided Retrieval and Refinement for Emotion-Aware Art Generation23 Aug 2026
- 2026WithEveryone: Unified Planning and Identity Grounding for Group Image Generation20 Aug 2026
- 2026Exploring the Performance Frontier of Compact Unified Image Generation Models20 Aug 2026
- 2026An Empirical Study of Training Pixel-Space Text-to-Image Diffusion Models17 Aug 2026
- 2026MaskFlow: Precise, Consistent and Seamless Regional Image Editing7 Aug 2026
- 2026Energy-Guided Flow Matching6 Aug 2026
- 2026Test-Time Curriculum for Open-Set AIGC Detection1 Aug 2026
- 2026The Second LoViF 2026 Challenge on Real-World All-in-One Image Restoration: Methods and Results23 Jul 2026
- 2026Pixel-Space Diffusion Transformers20 Jul 2026
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budget14 Jul 2026
- 2026WeGenBench: A Multidimensional Diagnostic Benchmark towards Text-to-Image Model Optimization18 Jun 2026
- 2026Compressing Image Style Training into a Single Model Forward11 Jun 2026
- 2026Toward Native Multimodal Modeling: A Roadmap25 May 2026
- 2026An Empirical Study of Training Pixel-Space Text-to-Image Diffusion Modelscited by 6
- 2026Pixel-Space Diffusion Transformerscited by 1
- 2026Energy-Guided Flow Matchingcited by 0
- 2026EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoderscited by 0
- 2026CAST: Causal Advantage-Structured Training with Spatially Grounded Compositional Rewards for Diffusion Modelscited by 0
- 2026CAST: Causal Advantage-Structured Training with Spatially Grounded Compositional Rewards for Diffusion Models30 Sep 2026
- 2026EraseSAE: Surgical Concept Erasure in Text-to-Video Diffusion Models via Sparse Autoencoders3 Sep 2026
- 2026An Empirical Study of Training Pixel-Space Text-to-Image Diffusion Models17 Aug 2026
- 2026Energy-Guided Flow Matching6 Aug 2026
- 2026Pixel-Space Diffusion Transformers20 Jul 2026
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligence10 Sep 2026
- 2026MindTopo: Can Foundation Models Reason in Topological Space?10 Sep 2026
- 2026Toward Native Multimodal Modeling: A Roadmapcited by 7
- 2026Toward Native Multimodal Modeling: A Roadmap25 May 2026
- 2026Compressing Image Style Training into a Single Model Forwardcited by 2
- 2026Exploring the Performance Frontier of Compact Unified Image Generation Modelscited by 2
- 2026GenFirst: Generation Before Reconstruction for Stable End-to-End Latent Generative Modelingcited by 2
- 2026WeGenBench: A Multidimensional Diagnostic Benchmark towards Text-to-Image Model Optimizationcited by 1
- 2026The Second LoViF 2026 Challenge on Real-World All-in-One Image Restoration: Methods and Resultscited by 1
- 2026Test-Time Curriculum for Open-Set AIGC Detectioncited by 0
- 2026MaskFlow: Precise, Consistent and Seamless Regional Image Editingcited by 0
- 2026WithEveryone: Unified Planning and Identity Grounding for Group Image Generationcited by 0
- 2026ReART: Reference-Guided Retrieval and Refinement for Emotion-Aware Art Generationcited by 0
- 2026Scalable Question-Centric Text-to-Image Evaluation: Reliable Ranking, Fine-Grained Diagnosis, and Cost-Aware Routingcited by 0
- 2026Multi2AV-Safety: Benchmarking Safety in Multimodal-to-Audio-Video Generationcited by 0
- 2026RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animationcited by 0
12 most cited of 21 All 21 (JSON)
- 2026Efficient Scene-Text Refinement via Pixel-Space Grouped Image Generation13 Oct 2026
- 2026Scaling Unified Multimodal Models to Long-Horizon Interleaved Generation12 Oct 2026
- 2026InfoVis: Unified Slide Image Generation and Editing12 Oct 2026
- 2026Reasoning-Informed Visual Editing8 Oct 2026
- 2026From Prompting to Composing: A Spatial Canvas Interface for Poster Generation8 Oct 2026
- 2026Do Generative Priors Align with Human Naturalness Perception?7 Oct 2026
- 2026Beyond Natural Images: Rethinking AI-Generated Image Detection in Documents13 Sep 2026
- 2026Moonworks Lunara: Modeling Artistic Intelligence11 Sep 2026
- 2026Beyond Visual Quality: Evaluating Physical Consistency under Ego-Motion with EgoGenEval10 Sep 2026
- 2026GenFirst: Generation Before Reconstruction for Stable End-to-End Latent Generative Modeling29 Aug 2026
- 2026RASA: Disentangled Spatial-Motional Priors for Cross-Identity Character Animation28 Aug 2026
- 2026Multi2AV-Safety: Benchmarking Safety in Multimodal-to-Audio-Video Generation27 Aug 2026
12 newest of 21 All 21 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026VINO: A Unified Visual Generator with Interleaved OmniModal Context
- 2025Query-Kontext: An Unified Multimodal Model for Image Generation and Editing
- 2025UniModel: A Visual-Only Framework for Unified Multimodal Understanding and Generation
- 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Model
- 2025UniFusion: Vision-Language Model as Unified Encoder in Image Generation
- 2026Mage-Flow: An Efficient Native-Resolution Foundation Model for Image Generation and Editing
- 2026Wan-Image: Pushing the Boundaries of Generative Visual Intelligence
- 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wild