DeepGen 1.0: A Lightweight Unified Multimodal Model for Advancing Image Generation and Editing
Not on the map. Why?
Abstract (arXiv)
Current unified multimodal models for image generation and editing typically rely on massive parameter scales (e.g., >10B), entailing prohibitive training costs and deployment footprints. In this work, we present DeepGen 1.0, a lightweight 5B unified model that achieves comprehensive capabilities competitive with or surpassing much larger counterparts. To overcome the limitations of compact models in semantic understanding and fine-grained control, we introduce Stacked Channel Bridging (SCB), a deep alignment framework that extracts hierarchical features from multiple VLM layers and fuses them with learnable 'think tokens' to provide the generative backbone with structured, reasoning-rich guidance. We further design a data-centric training strategy spanning three progressive stages: (1) Alignment Pre-training on large-scale image-text pairs and editing triplets to synchronize VLM and DiT representations, (2) Joint Supervised Fine-tuning on a high-quality mixture of generation, editing, and reasoning tasks to foster omni-capabilities, and (3) Reinforcement Learning with MR-GRPO, which leverages a mixture of reward functions and supervision signals, resulting in substantial gains in generation quality and alignment with human preferences, while maintaining stable training progress and avoiding visual artifacts. Despite being trained on only ~50M samples, DeepGen 1.0 achieves leading performance across diverse benchmarks, surpassing the 80B HunyuanImage by 28% on WISE and the 27B Qwen-Image-Edit by 37% on UniREditBench. By open-sourcing our training code, weights, and datasets, we provide an efficient, high-performance alternative to democratize unified multimodal research.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 62 of its 71 references that are in the map. First posted on arXiv 12 Feb 2026.
Builds on
62 of 71 references.
References · 62
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,209
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 946
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
38 more
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 388
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2025Transfer between Modalities with MetaQueriescited by 231
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2021RedCaps: web-curated image-text data created by the people, for the peoplecited by 175
- 2026GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimizationcited by 175
- 2024JanusFlow: Harmonizing Autoregression and Rectified Flow for Unified Multimodal Understanding and Generationcited by 162
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2025PaddleOCR 3.0 Technical Reportcited by 136
- 2024LMFusion: Adapting Pretrained Language Models for Multimodal Generationcited by 120
- 2025X-Omni: Reinforcement Learning Makes Discrete Autoregressive Image Generative Models Great Againcited by 105
- 2025Envisioning Beyond the Pixels: Benchmarking Reasoning-Informed Visual Editingcited by 97
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 95
- 2025ShareGPT-4o-Image: Aligning Multimodal Models with GPT-4o-Level Image Generationcited by 94
- 2025LongCat-Image Technical Reportcited by 92
- 2025Pref-GRPO: Pairwise Preference Reward-based GRPO for Stable Text-to-Image Reinforcement Learningcited by 88
- 2025Unified Multimodal Chain-of-Thought Reward Model through Reinforcement Fine-Tuningcited by 86
- 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 83
- 2025KRIS-Bench: Benchmarking Next-Level Intelligent Image Editing Modelscited by 69
- 2025GPT-IMAGE-EDIT-1.5M: A Million-Scale, GPT-Generated Image Datasetcited by 68
- 2025UniWorld-V1: High-Resolution Semantic Encoders for Unified Visual Understanding and Generationcited by 64
- 2025Pico-Banana-400K: A Large-Scale Dataset for Text-Guided Image Editingcited by 58
- 2025Coefficients-Preserving Sampling for Reinforcement Learning with Flow Matchingcited by 55
- 2025OpenUni: A Simple Baseline for Unified Multimodal Understanding and Generationcited by 45
- 2025Skywork UniPic 2.0: Building Kontext Model with Online RL for Unified Multimodal Modelcited by 38
- 2025FLUX-Reason-6M & PRISM-Bench: A Million-Scale Text-to-Image Reasoning Dataset and Comprehensive Benchmarkcited by 37
- 2025NoHumansRequired: Autonomous High-Quality Image Editing Triplet Miningcited by 33
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2026: 14.
14 papers.
Sort:
By area:
- 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillationcited by 15
- 2026CoCo: Code as CoT for Text-to-Image Preview and Rare Concept Generationcited by 6
- 2026Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modelingcited by 6
- 2026DreamLite: A Lightweight On-Device Unified Model for Image Generation and Editingcited by 4
- 2026GenMask: Adapting DiT for Segmentation via Direct Mask Generationcited by 3
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-trainingcited by 2
- 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editingcited by 2
- 2026Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoningcited by 2
- 2026H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Modelscited by 2
- 2026LatentUMM: Dual Latent Alignment for Unified Multimodal Modelscited by 1
- 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesiscited by 1
- 2026Beyond Text Prompts: Visual-to-Visual Generation as A Unified Paradigmcited by 0
- 2026TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generation17 Aug 2026
- 2026H2R-Bench: Benchmarking Human-to-Robot Manipulation Video Generation in World Models13 Aug 2026
- 2026ExpertVerse: A General-Purpose Benchmark for Expert-Level Reasoning in Knowledge-Intensive Visual Synthesis21 Jul 2026
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing2 Jul 2026
- 2026Reason, Then Re-reason: Cross-view Revisiting Improves Spatial Reasoning10 Jun 2026
- 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillation20 May 2026
- 2026LatentUMM: Dual Latent Alignment for Unified Multimodal Models18 May 2026
- 2026Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modeling13 May 2026
- 2026Beyond Text Prompts: Visual-to-Visual Generation as A Unified Paradigm12 May 2026
- 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editing28 Apr 2026
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training12 Apr 2026
- 2026DreamLite: A Lightweight On-Device Unified Model for Image Generation and Editing30 Mar 2026
2 more
- 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillationcited by 15
- 2026GenMask: Adapting DiT for Segmentation via Direct Mask Generationcited by 3
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-trainingcited by 2
- 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editingcited by 2
- 2026Beyond Text Prompts: Visual-to-Visual Generation as A Unified Paradigmcited by 0
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editingcited by 0
- 2026TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generationcited by 0
- 2026TRACE-Bench: Decomposing and Diagnosing Multi-Reference Image Generation17 Aug 2026
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing2 Jul 2026
- 2026GenEvolve: Self-Evolving Image Generation Agents via Tool-Orchestrated Visual Experience Distillation20 May 2026
- 2026Beyond Text Prompts: Visual-to-Visual Generation as A Unified Paradigm12 May 2026
- 2026DDA-Thinker: Decoupled Dual-Atomic Reinforcement Learning for Reasoning-Driven Image Editing28 Apr 2026
- 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-training12 Apr 2026
- 2026GenMask: Adapting DiT for Segmentation via Direct Mask Generation25 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Uni-Edit: Intelligent Editing Is A General Task For Unified Model Tuning
- 2025Query-Kontext: An Unified Multimodal Model for Image Generation and Editing
- 2026DuoGen: Towards General Purpose Interleaved Multimodal Generation
- 2024SILMM: Self-Improving Large Multimodal Models for Compositional Text-to-Image Generation
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing
- 2026FiRe: Fine-grained Multimodal Reasoning for Enhanced Image Generation
- 2025OmniMamba: Efficient and Unified Multimodal Understanding and Generation via State Space Models
- 2024TIE: Revolutionizing Text-based Image Editing for Complex-Prompt Following and High-Fidelity Editing