BLIP3o-NEXT: Next Frontier of Native Image Generation
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
We present BLIP3o-NEXT, a fully open-source foundation model in the BLIP3 series that advances the next frontier of native image generation. BLIP3o-NEXT unifies text-to-image generation and image editing within a single architecture, demonstrating strong image generation and image editing capabilities. In developing the state-of-the-art native image generation model, we identify four key insights: (1) Most architectural choices yield comparable performance; an architecture can be deemed effective provided it scales efficiently and supports fast inference; (2) The successful application of reinforcement learning can further push the frontier of native image generation; (3) Image editing still remains a challenging task, yet instruction following and the consistency between generated and reference images can be significantly enhanced through post-training and data engine; (4) Data quality and scale continue to be decisive factors that determine the upper bound of model performance. Building upon these insights, BLIP3o-NEXT leverages an Autoregressive + Diffusion architecture in which an autoregressive model first generates discrete image tokens conditioned on multimodal inputs, whose hidden states are then used as conditioning signals for a diffusion model to generate high-fidelity images. This architecture integrates the reasoning strength and instruction following of autoregressive models with the fine-detail rendering ability of diffusion models, achieving a new level of coherence and realism. Extensive evaluations of various text-to-image and image-editing benchmarks show that BLIP3o-NEXT achieves superior performance over existing models.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 45 of its 49 references that are in the map. First posted on arXiv 17 Oct 2025.
Builds on
45 of 49 references.
Closest ancestors · 7
Same direction, newest first
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Dataset14 May
- 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer29 Apr
- 2024OmniGen: Unified Image Generation17 Sep
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment8 Mar
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment17 Oct
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov
Other references · 38
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen3 Technical Reportcited by 8,195
- 2023Segment Anythingcited by 8,158
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
- 2025Qwen-Image Technical Reportcited by 973
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
26 more
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2023Generative Multimodal Models are In-Context Learnerscited by 446
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025Transfer between Modalities with MetaQueriescited by 231
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 209
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
- 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 203
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2025Unified Reward Model for Multimodal Understanding and Generationcited by 194
- 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 168
- 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 153
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
- 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
- 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editingcited by 59
- 2025Vision as a Dialect: Unifying Visual Understanding and Generation via Text-Aligned Representationscited by 44
- 2025UniLiP: Adapting CLIP for Unified Multimodal Understanding, Generation and Editingcited by 43
- 2025UniGen: Enhanced Training & Test-Time Strategies for Unified Multimodal Understanding and Generationcited by 32
- 2025MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizercited by 15
- 2025RayFlow: Instance-Aware Diffusion Acceleration via Adaptive Flow Trajectoriescited by 12
Built on by
Citing papers per year: 2025: 13; 2026: 37.
50 papers.
Sort:
By area:
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigationcited by 23
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 23
- 2026UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous Drivingcited by 20
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoningcited by 20
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 19
- 2026TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Renderingcited by 14
- 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generationcited by 13
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigationcited by 12
- 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Modelscited by 11
- 2026RationalRewards: Reasoning Rewards Scale Visual Generation Both Training and Test Timecited by 11
- 2025WiseEdit: Benchmarking Cognition- and Creativity-Informed Image Editingcited by 10
- 2025SuperFlow: Training Flow Matching Models with RL on the Flycited by 10
38 more
- 2025UniGen-1.5: Enhancing Image Generation and Editing through Reward Unification in Reinforcement Learningcited by 8
- 2025Robotic VLA Benefits from Joint Learning with Motion Image Diffusioncited by 7
- 2026Elastic Diffusion Transformercited by 7
- 2026GEM: Generative Supervision Helps Embodied Intelligencecited by 6
- 2025FysicsWorld: A Unified Full-Modality Benchmark for Any-to-Any Understanding, Generation, and Reasoningcited by 5
- 2025Co-GRPO: Co-Optimized Group Relative Policy Optimization for Masked Diffusion Modelcited by 5
- 2026Self-Improving World Modelling with Latent Actionscited by 5
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modelingcited by 5
- 2026RewardHarness: Self-Evolving Agentic Post-Trainingcited by 5
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budgetcited by 5
- 2025Beyond Words and Pixels: A Benchmark for Implicit World Knowledge Reasoning in Generative Modelscited by 4
- 2025Are Image-to-Video Models Good Zero-Shot Image Editors?cited by 4
- 2026AIBench: Evaluating Visual-Logical Consistency in Academic Illustration Generationcited by 4
- 2025ShowTable: Unlocking Creative Table Visualization with Collaborative Reflection and Refinementcited by 3
- 2026Bridging Information Asymmetry: A Hierarchical Framework for Deterministic Blind Face Restorationcited by 3
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editingcited by 3
- 2026Baton: Explicit Semantic Blueprints for Joint Video-Audio Generationcited by 3
- 2026Generative Visual Chain-of-Thought for Image Editingcited by 2
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Maskingcited by 2
- 2026Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representationcited by 2
- 2025Diversifying Long Prompt Image Generation through Structured Prompt Embedding Space Samplingcited by 1
- 2025ParaUni: Enhance Generation in Unified Multimodal Model with Reinforcement-driven Hierarchical Parallel Information Interactioncited by 1
- 2026Kelix Technical Reportcited by 1
- 2026Advances in GRPO for Generation Models: A Surveycited by 1
- 2026Know3D: Prompting 3D Generation with Knowledge from Vision-Language Modelscited by 1
- 2026Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Modelscited by 1
- 2026HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasingcited by 1
- 2026Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and Recipescited by 1
- 2026TextRefine: Improving Textual Fidelity, Spatial Placement, and Glyph Rendering for Text Editing in Product Posterscited by 1
- 2026UniCom: Unified Multimodal Modeling via Compressed Continuous Semantic Representationscited by 0
- 2026Towards Training-Free Scene Text Editingcited by 0
- 2026UniGeo: Unifying Geometric Guidance for Camera-Controllable Image Editing via Video Modelscited by 0
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generationcited by 0
- 2026Imagine Before You Draw: Visual Prompt Engineering for Image Generationcited by 0
- 2026Bridging Video Understanding and Generation in a Unified Frameworkcited by 0
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editingcited by 0
- 2026Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generationcited by 0
- 2026Planning and Rendering in Concert: DeepFusion of Autoregressive Layouts and Diffusion for Visual Text Generationcited by 0
- 2026Planning and Rendering in Concert: DeepFusion of Autoregressive Layouts and Diffusion for Visual Text Generation19 Sep 2026
- 2026TextRefine: Improving Textual Fidelity, Spatial Placement, and Glyph Rendering for Text Editing in Product Posters20 Aug 2026
- 2026Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generation14 Aug 2026
- 2026Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and Recipes5 Aug 2026
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing3 Aug 2026
- 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budget14 Jul 2026
- 2026Bridging Video Understanding and Generation in a Unified Framework30 Jun 2026
- 2026Imagine Before You Draw: Visual Prompt Engineering for Image Generation3 Jun 2026
- 2026GEM: Generative Supervision Helps Embodied Intelligence27 May 2026
- 2026Baton: Explicit Semantic Blueprints for Joint Video-Audio Generation24 May 2026
- 2026HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasing23 May 2026
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generation19 May 2026
38 more
- 2026RewardHarness: Self-Evolving Agentic Post-Training9 May 2026
- 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modeling30 Apr 2026
- 2026Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Models28 Apr 2026
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editing27 Apr 2026
- 2026Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representation20 Apr 2026
- 2026UniGeo: Unifying Geometric Guidance for Camera-Controllable Image Editing via Video Models19 Apr 2026
- 2026RationalRewards: Reasoning Rewards Scale Visual Generation Both Training and Test Time13 Apr 2026
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Masking1 Apr 2026
- 2026AIBench: Evaluating Visual-Logical Consistency in Academic Illustration Generation30 Mar 2026
- 2026Towards Training-Free Scene Text Editing25 Mar 2026
- 2026Know3D: Prompting 3D Generation with Knowledge from Vision-Language Models24 Mar 2026
- 2026UniCom: Unified Multimodal Modeling via Compressed Continuous Semantic Representations11 Mar 2026
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing10 Mar 2026
- 2026Generative Visual Chain-of-Thought for Image Editing2 Mar 2026
- 2026TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Rendering24 Feb 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
- 2026Elastic Diffusion Transformer15 Feb 2026
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigation12 Feb 2026
- 2026Kelix Technical Report10 Feb 2026
- 2026Self-Improving World Modelling with Latent Actions5 Feb 2026
- 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Models2 Feb 2026
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generation29 Jan 2026
- 2026Bridging Information Asymmetry: A Hierarchical Framework for Deterministic Blind Face Restoration27 Jan 2026
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning26 Jan 2026
- 2026UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous Driving7 Jan 2026
- 2025Co-GRPO: Co-Optimized Group Relative Policy Optimization for Masked Diffusion Model25 Dec 2025
- 2025Robotic VLA Benefits from Joint Learning with Motion Image Diffusion19 Dec 2025
- 2025SuperFlow: Training Flow Matching Models with RL on the Fly17 Dec 2025
- 2025ShowTable: Unlocking Creative Table Visualization with Collaborative Reflection and Refinement15 Dec 2025
- 2025FysicsWorld: A Unified Full-Modality Benchmark for Any-to-Any Understanding, Generation, and Reasoning14 Dec 2025
- 2025ParaUni: Enhance Generation in Unified Multimodal Model with Reinforcement-driven Hierarchical Parallel Information Interaction5 Dec 2025
- 2025WiseEdit: Benchmarking Cognition- and Creativity-Informed Image Editing29 Nov 2025
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigation26 Nov 2025
- 2025Diversifying Long Prompt Image Generation through Structured Prompt Embedding Space Sampling25 Nov 2025
- 2025Are Image-to-Video Models Good Zero-Shot Image Editors?24 Nov 2025
- 2025Beyond Words and Pixels: A Benchmark for Implicit World Knowledge Reasoning in Generative Models23 Nov 2025
- 2025UniGen-1.5: Enhancing Image Generation and Editing through Reward Unification in Reinforcement Learning18 Nov 2025
- 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generation3 Nov 2025
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 23
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoningcited by 20
- 2025FysicsWorld: A Unified Full-Modality Benchmark for Any-to-Any Understanding, Generation, and Reasoningcited by 5
- 2025Co-GRPO: Co-Optimized Group Relative Policy Optimization for Masked Diffusion Modelcited by 5
- 2025Are Image-to-Video Models Good Zero-Shot Image Editors?cited by 4
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editingcited by 3
- 2026Generative Visual Chain-of-Thought for Image Editingcited by 2
- 2026Advances in GRPO for Generation Models: A Surveycited by 1
- 2026HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasingcited by 1
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generationcited by 0
- 2026HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasing23 May 2026
- 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generation19 May 2026
- 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editing27 Apr 2026
- 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing10 Mar 2026
- 2026Generative Visual Chain-of-Thought for Image Editing2 Mar 2026
- 2026Advances in GRPO for Generation Models: A Survey21 Feb 2026
- 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoning26 Jan 2026
- 2025Co-GRPO: Co-Optimized Group Relative Policy Optimization for Masked Diffusion Model25 Dec 2025
- 2025FysicsWorld: A Unified Full-Modality Benchmark for Any-to-Any Understanding, Generation, and Reasoning14 Dec 2025
- 2025Are Image-to-Video Models Good Zero-Shot Image Editors?24 Nov 2025
- 2026Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generation14 Aug 2026
- 2026Baton: Explicit Semantic Blueprints for Joint Video-Audio Generation24 May 2026
- 2026Elastic Diffusion Transformer15 Feb 2026
- 2025SuperFlow: Training Flow Matching Models with RL on the Fly17 Dec 2025
- 2025UniGen-1.5: Enhancing Image Generation and Editing through Reward Unification in Reinforcement Learningcited by 8
- 2026GEM: Generative Supervision Helps Embodied Intelligencecited by 6
- 2025ParaUni: Enhance Generation in Unified Multimodal Model with Reinforcement-driven Hierarchical Parallel Information Interactioncited by 1
- 2026Know3D: Prompting 3D Generation with Knowledge from Vision-Language Modelscited by 1
- 2026GEM: Generative Supervision Helps Embodied Intelligence27 May 2026
- 2026Know3D: Prompting 3D Generation with Knowledge from Vision-Language Models24 Mar 2026
- 2025ParaUni: Enhance Generation in Unified Multimodal Model with Reinforcement-driven Hierarchical Parallel Information Interaction5 Dec 2025
- 2025UniGen-1.5: Enhancing Image Generation and Editing through Reward Unification in Reinforcement Learning18 Nov 2025
- 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigationcited by 23
- 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 19
- 2026TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Renderingcited by 14
- 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generationcited by 13
- 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigationcited by 12
- 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Modelscited by 11
- 2025WiseEdit: Benchmarking Cognition- and Creativity-Informed Image Editingcited by 10
- 2025Beyond Words and Pixels: A Benchmark for Implicit World Knowledge Reasoning in Generative Modelscited by 4
- 2026AIBench: Evaluating Visual-Logical Consistency in Academic Illustration Generationcited by 4
- 2025ShowTable: Unlocking Creative Table Visualization with Collaborative Reflection and Refinementcited by 3
- 2026Bridging Information Asymmetry: A Hierarchical Framework for Deterministic Blind Face Restorationcited by 3
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Maskingcited by 2
12 most cited of 25 All 25 (JSON)
- 2026Planning and Rendering in Concert: DeepFusion of Autoregressive Layouts and Diffusion for Visual Text Generation19 Sep 2026
- 2026TextRefine: Improving Textual Fidelity, Spatial Placement, and Glyph Rendering for Text Editing in Product Posters20 Aug 2026
- 2026Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and Recipes5 Aug 2026
- 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editing3 Aug 2026
- 2026Bridging Video Understanding and Generation in a Unified Framework30 Jun 2026
- 2026Imagine Before You Draw: Visual Prompt Engineering for Image Generation3 Jun 2026
- 2026Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Models28 Apr 2026
- 2026Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representation20 Apr 2026
- 2026UniGeo: Unifying Geometric Guidance for Camera-Controllable Image Editing via Video Models19 Apr 2026
- 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Masking1 Apr 2026
- 2026AIBench: Evaluating Visual-Logical Consistency in Academic Illustration Generation30 Mar 2026
- 2026Towards Training-Free Scene Text Editing25 Mar 2026
12 newest of 25 All 25 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026DreamLite: A Lightweight On-Device Unified Model for Image Generation and Editing
- 2025VARGPT-v1.1: Improve Visual Autoregressive Large Unified Model via Iterative Instruction Tuning and Reinforcement Learning
- 2025EditAR: Unified Conditional Generation with Autoregressive Models
- 2026VIBE: Visual Instruction Based Editor
- 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generation
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
- 2025NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scale
- 2025The Promise of RL for Autoregressive Image Editing