mlsanityData to 7 Oct 2026

BLIP3o-NEXT: Next Frontier of Native Image Generation

arXiv 2510.15857 ↗First posted 17 Oct 2025cs.CVcited by 50

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

We present BLIP3o-NEXT, a fully open-source foundation model in the BLIP3 series that advances the next frontier of native image generation. BLIP3o-NEXT unifies text-to-image generation and image editing within a single architecture, demonstrating strong image generation and image editing capabilities. In developing the state-of-the-art native image generation model, we identify four key insights: (1) Most architectural choices yield comparable performance; an architecture can be deemed effective provided it scales efficiently and supports fast inference; (2) The successful application of reinforcement learning can further push the frontier of native image generation; (3) Image editing still remains a challenging task, yet instruction following and the consistency between generated and reference images can be significantly enhanced through post-training and data engine; (4) Data quality and scale continue to be decisive factors that determine the upper bound of model performance. Building upon these insights, BLIP3o-NEXT leverages an Autoregressive + Diffusion architecture in which an autoregressive model first generates discrete image tokens conditioned on multimodal inputs, whose hidden states are then used as conditioning signals for a diffusion model to generate high-fidelity images. This architecture integrates the reasoning strength and instruction following of autoregressive models with the fine-detail rendering ability of diffusion models, achieving a new level of coherence and realism. Extensive evaluations of various text-to-image and image-editing benchmarks show that BLIP3o-NEXT achieves superior performance over existing models.

Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 45 of its 49 references that are in the map. First posted on arXiv 17 Oct 2025.

Builds on

45 of 49 references.

Closest ancestors · 7

Same direction, newest first

  1. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Space17 Jun
  2. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Dataset14 May
  3. 2025In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer29 Apr
  4. 2024OmniGen: Unified Image Generation17 Sep
  5. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment8 Mar
  6. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment17 Oct
  7. 2022InstructPix2Pix: Learning to Follow Image Editing Instructions17 Nov

Other references · 38

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2025Qwen3 Technical Reportcited by 8,195
  3. 2023Segment Anythingcited by 8,158
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
  7. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
  8. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,010
  9. 2025Qwen-Image Technical Reportcited by 973
  10. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  11. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  12. 2023MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editingcited by 615
26 more
  1. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  2. 2023Generative Multimodal Models are In-Context Learnerscited by 446
  3. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
  4. 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
  5. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  6. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 284
  7. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
  8. 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
  9. 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
  10. 2025Transfer between Modalities with MetaQueriescited by 231
  11. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  12. 2024Deep Compression Autoencoder for Efficient High-Resolution Diffusion Modelscited by 209
  13. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 205
  14. 2023JourneyDB: A Benchmark for Generative Image Understandingcited by 203
  15. 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
  16. 2025Unified Reward Model for Multimodal Understanding and Generationcited by 194
  17. 2025MixGRPO: Unlocking Flow-based GRPO Efficiency with Mixed ODE-SDEcited by 168
  18. 2024Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesiscited by 153
  19. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 142
  20. 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
  21. 2025EditReward: A Human-Aligned Reward Model for Instruction-Guided Image Editingcited by 59
  22. 2025Vision as a Dialect: Unifying Visual Understanding and Generation via Text-Aligned Representationscited by 44
  23. 2025UniLiP: Adapting CLIP for Unified Multimodal Understanding, Generation and Editingcited by 43
  24. 2025UniGen: Enhanced Training & Test-Time Strategies for Unified Multimodal Understanding and Generationcited by 32
  25. 2025MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizercited by 15
  26. 2025RayFlow: Instance-Aware Diffusion Acceleration via Adaptive Flow Trajectoriescited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 13; 2026: 37.

50 papers.

Sort:

By area:

  1. 2026ABot-N0: Technical Report on the VLA Foundation Model for Versatile Embodied Navigationcited by 23
  2. 2026InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editingcited by 23
  3. 2026UniDrive-WM: Unified Understanding, Planning and Generation World Model for Autonomous Drivingcited by 20
  4. 2026GenAgent: Scaling Text-to-Image Generation via Agentic Multimodal Reasoningcited by 20
  5. 2026Generation Enhances Understanding in Unified Multimodal Models via Multi-Representation Generationcited by 19
  6. 2026TextPecker: Rewarding Structural Anomaly Quantification for Enhancing Visual Text Renderingcited by 14
  7. 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generationcited by 13
  8. 2025SocialNav: Training Human-Inspired Foundation Model for Socially-Aware Embodied Navigationcited by 12
  9. 2026Quantifying the Gap between Understanding and Generation within Unified Multimodal Modelscited by 11
  10. 2026RationalRewards: Reasoning Rewards Scale Visual Generation Both Training and Test Timecited by 11
  11. 2025WiseEdit: Benchmarking Cognition- and Creativity-Informed Image Editingcited by 10
  12. 2025SuperFlow: Training Flow Matching Models with RL on the Flycited by 10
38 more
  1. 2025UniGen-1.5: Enhancing Image Generation and Editing through Reward Unification in Reinforcement Learningcited by 8
  2. 2025Robotic VLA Benefits from Joint Learning with Motion Image Diffusioncited by 7
  3. 2026Elastic Diffusion Transformercited by 7
  4. 2026GEM: Generative Supervision Helps Embodied Intelligencecited by 6
  5. 2025FysicsWorld: A Unified Full-Modality Benchmark for Any-to-Any Understanding, Generation, and Reasoningcited by 5
  6. 2025Co-GRPO: Co-Optimized Group Relative Policy Optimization for Masked Diffusion Modelcited by 5
  7. 2026Self-Improving World Modelling with Latent Actionscited by 5
  8. 2026Visual Generation in the New Era: An Evolution from Atomic Mapping to Agentic World Modelingcited by 5
  9. 2026RewardHarness: Self-Evolving Agentic Post-Trainingcited by 5
  10. 2026Boogu-Image-0.1: Boosting Open Agentic Multimodal Generation via Understanding under a Minimal Budgetcited by 5
  11. 2025Beyond Words and Pixels: A Benchmark for Implicit World Knowledge Reasoning in Generative Modelscited by 4
  12. 2025Are Image-to-Video Models Good Zero-Shot Image Editors?cited by 4
  13. 2026AIBench: Evaluating Visual-Logical Consistency in Academic Illustration Generationcited by 4
  14. 2025ShowTable: Unlocking Creative Table Visualization with Collaborative Reflection and Refinementcited by 3
  15. 2026Bridging Information Asymmetry: A Hierarchical Framework for Deterministic Blind Face Restorationcited by 3
  16. 2026Meta-CoT: Enhancing Granularity and Generalization in Image Editingcited by 3
  17. 2026Baton: Explicit Semantic Blueprints for Joint Video-Audio Generationcited by 3
  18. 2026Generative Visual Chain-of-Thought for Image Editingcited by 2
  19. 2026TRACE: High-Fidelity 3D Scene Editing via Tangible Reconstruction and Geometry-Aligned Contextual Video Maskingcited by 2
  20. 2026Extending One-Step Image Generation from Class Labels to Text via Discriminative Text Representationcited by 2
  21. 2025Diversifying Long Prompt Image Generation through Structured Prompt Embedding Space Samplingcited by 1
  22. 2025ParaUni: Enhance Generation in Unified Multimodal Model with Reinforcement-driven Hierarchical Parallel Information Interactioncited by 1
  23. 2026Kelix Technical Reportcited by 1
  24. 2026Advances in GRPO for Generation Models: A Surveycited by 1
  25. 2026Know3D: Prompting 3D Generation with Knowledge from Vision-Language Modelscited by 1
  26. 2026Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Modelscited by 1
  27. 2026HoloFair: Unified T2I Fairness Evaluation and Fair-GRPO Debiasingcited by 1
  28. 2026Towards Physics of Multimodal Pretraining: Knowledge Flow, Modality Synergy, Early Unification, and Recipescited by 1
  29. 2026TextRefine: Improving Textual Fidelity, Spatial Placement, and Glyph Rendering for Text Editing in Product Posterscited by 1
  30. 2026UniCom: Unified Multimodal Modeling via Compressed Continuous Semantic Representationscited by 0
  31. 2026Towards Training-Free Scene Text Editingcited by 0
  32. 2026UniGeo: Unifying Geometric Guidance for Camera-Controllable Image Editing via Video Modelscited by 0
  33. 2026Benchmarking and Evolving Reason-Reflect-Rectify for Reflective Visual Generationcited by 0
  34. 2026Imagine Before You Draw: Visual Prompt Engineering for Image Generationcited by 0
  35. 2026Bridging Video Understanding and Generation in a Unified Frameworkcited by 0
  36. 2026Hunyuan3D-Buffalo 1.0: A Unified Multimodal Model for Scalable 3D Generation, Understanding, and Editingcited by 0
  37. 2026Beyond Text Conditioning: A Systematic Study of MLLM-DiT Fusion for Video Generationcited by 0
  38. 2026Planning and Rendering in Concert: DeepFusion of Autoregressive Layouts and Diffusion for Visual Text Generationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026DreamLite: A Lightweight On-Device Unified Model for Image Generation and Editing
  2. 2025VARGPT-v1.1: Improve Visual Autoregressive Large Unified Model via Iterative Instruction Tuning and Reinforcement Learning
  3. 2025EditAR: Unified Conditional Generation with Autoregressive Models
  4. 2026VIBE: Visual Instruction Based Editor
  5. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generation
  6. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Models
  7. 2025NextStep-1: Toward Autoregressive Image Generation with Continuous Tokens at Scale
  8. 2025The Promise of RL for Autoregressive Image Editing