InternVL-U: Democratizing Unified Multimodal Models for Understanding, Reasoning, Generation and Editing
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Unified multimodal models (UMMs) that integrate understanding, reasoning, generation, and editing face inherent trade-offs between maintaining strong semantic comprehension and acquiring powerful generation capabilities. In this report, we present InternVL-U, a lightweight 4B-parameter UMM that democratizes these capabilities within a unified framework. Guided by the principles of unified contextual modeling and modality-specific modular design with decoupled visual representations, InternVL-U integrates a state-of-the-art Multimodal Large Language Model (MLLM) with a specialized MMDiT-based visual generation head. To further bridge the gap between aesthetic generation and high-level intelligence, we construct a comprehensive data synthesis pipeline targeting high-semantic-density tasks, such as text rendering and scientific reasoning, under a reasoning-centric paradigm that leverages Chain-of-Thought (CoT) to better align abstract user intent with fine-grained visual generation details. Extensive experiments demonstrate that InternVL-U achieves a superior performance - efficiency balance. Despite using only 4B parameters, it consistently outperforms unified baseline models with over 3x larger scales such as BAGEL (14B) on various generation and editing tasks, while retaining strong multimodal understanding and reasoning capabilities.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 108 of its 164 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
108 of 164 references.
Closest ancestors · 8
Same direction, newest first
- 2025NaViL: Rethinking Scaling Properties of Native Multimodal Large Language Models under Data Constraints9 Oct
- 2025FLUX-Reason-6M & PRISM-Bench: A Million-Scale Text-to-Image Reasoning Dataset and Comprehensive Benchmark11 Sep
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiency25 Aug
- 2025Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoning12 Jun
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling6 Dec
- 2024CMM-Math: A Chinese Multimodal Math Dataset To Evaluate and Enhance the Mathematics Reasoning of Large Multimodal Models4 Sep
- 2024MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Engine11 Jul
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
Other references · 100
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2023GPT-4 Technical Reportcited by 18,132
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
38 more
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,385
- 2023PaLM 2 Technical Reportcited by 1,154
- 2025Qwen-Image Technical Reportcited by 973
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehensioncited by 929
- 2024Chameleon: Mixed-Modal Early-Fusion Foundation Modelscited by 904
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023VideoChat: Chat-Centric Video Understandingcited by 851
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 455
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
- 2024OmniGen: Unified Image Generationcited by 388
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 363
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 331
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2024Flow Matching Guide and Codecited by 291
- 2024Open-Sora Plan: Open-Source Large Video Generation Modelcited by 286
- 2024UltraEdit: Instruction-based Fine-Grained Image Editing at Scalecited by 266
- 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 266
- 2025Z-Image: An Efficient Image Generation Foundation Model with Single-Stream Diffusion Transformercited by 247
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 241
- 2024AnyEdit: Mastering Unified High-Quality Image Editing for Any Ideacited by 235
- 2025Seedream 4.0: Toward Next-generation Multimodal Image Generationcited by 233
- 2025Transfer between Modalities with MetaQueriescited by 231
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2025InternVideo2.5: Empowering Video MLLMs with Long and Rich Context Modelingcited by 203
- 2025WISE: A World Knowledge-Informed Semantic Evaluation for Text-to-Image Generationcited by 196
- 2024HQ-Edit: A High-Quality Dataset for Instruction-based Image Editingcited by 191
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
- 2025Seedream 3.0 Technical Reportcited by 146
- 2024OmniEdit: Building Image Editing Generalist Models Through Specialist Supervisioncited by 145
50 most cited of 100 All 100 (JSON)
Built on by
Citing papers per year: 2026: 23.
23 papers.
Sort:
By area:
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 30
- 2026SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecturecited by 27
- 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generationcited by 17
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 12
- 2026Lance: Unified Multimodal Modeling by Multi-Task Synergycited by 11
- 2026Aurora: Unified Video Editing with a Tool-Using Agentcited by 7
- 2026Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modelingcited by 6
- 2026ScaleEdit-12M: Scaling Open-Source Image Editing Data Generation via Multi-Agent Frameworkcited by 5
- 2026G2TR: Generation-Guided Visual Token Reduction for Separate-Encoder Unified Multimodal Modelscited by 3
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligencecited by 3
- 2026Latent Action Control for Reasoning-Guided Unified Image Generationcited by 1
- 2026Plan Before Search: Search Agents Need Plancited by 1
11 more
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editingcited by 0
- 2026Cross-Branch Conflict as a Shield: Safeguarding Facial Identities in Unified Multimodal Image Editingcited by 0
- 2026STBridge: Shared-Target Alignment for Bridging Understanding and Generation in UMMscited by 0
- 2026Test-Time Curriculum for Open-Set AIGC Detectioncited by 0
- 2026UniSpace: Unified Visual Representation and Scalable Multimodal Modelingcited by 0
- 2026Unlocking the Potential of Image Editing via Concept Scaling and Dense Supervisioncited by 0
- 2026GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplaycited by 0
- 2026InGuard: Towards Generalized Inner Guardrail for Safe Text-to-Image Generationcited by 0
- 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generationcited by 0
- 2026Looped Diffusion Transformercited by 0
- 2026Reasoning-Informed Visual Editingcited by 0
- 2026Reasoning-Informed Visual Editing8 Oct 2026
- 2026Looped Diffusion Transformer30 Sep 2026
- 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation29 Sep 2026
- 2026InGuard: Towards Generalized Inner Guardrail for Safe Text-to-Image Generation23 Sep 2026
- 2026GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplay21 Sep 2026
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligence10 Sep 2026
- 2026Unlocking the Potential of Image Editing via Concept Scaling and Dense Supervision17 Aug 2026
- 2026UniSpace: Unified Visual Representation and Scalable Multimodal Modeling9 Aug 2026
- 2026Test-Time Curriculum for Open-Set AIGC Detection1 Aug 2026
- 2026STBridge: Shared-Target Alignment for Bridging Understanding and Generation in UMMs19 Jul 2026
- 2026Cross-Branch Conflict as a Shield: Safeguarding Facial Identities in Unified Multimodal Image Editing18 Jul 2026
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing2 Jul 2026
11 more
- 2026Plan Before Search: Search Agents Need Plan27 May 2026
- 2026Aurora: Unified Video Editing with a Tool-Using Agent18 May 2026
- 2026Lance: Unified Multimodal Modeling by Multi-Task Synergy18 May 2026
- 2026Latent Action Control for Reasoning-Guided Unified Image Generation16 May 2026
- 2026Edit-Compass & EditReward-Compass: A Unified Benchmark for Image Editing and Reward Modeling13 May 2026
- 2026SenseNova-U1: Unifying Multimodal Understanding and Generation with NEO-unify Architecture12 May 2026
- 2026G2TR: Generation-Guided Visual Token Reduction for Separate-Encoder Unified Multimodal Models12 May 2026
- 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generation27 Apr 2026
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model22 Apr 2026
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokens29 Mar 2026
- 2026ScaleEdit-12M: Scaling Open-Source Image Editing Data Generation via Multi-Agent Framework21 Mar 2026
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 12
- 2026Aurora: Unified Video Editing with a Tool-Using Agentcited by 7
- 2026Unlocking the Potential of Image Editing via Concept Scaling and Dense Supervisioncited by 0
- 2026Looped Diffusion Transformercited by 0
- 2026Looped Diffusion Transformer30 Sep 2026
- 2026Unlocking the Potential of Image Editing via Concept Scaling and Dense Supervision17 Aug 2026
- 2026Aurora: Unified Video Editing with a Tool-Using Agent18 May 2026
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model22 Apr 2026
- 2026Plan Before Search: Search Agents Need Plancited by 1
- 2026Plan Before Search: Search Agents Need Plan27 May 2026
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokenscited by 30
- 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generationcited by 17
- 2026Lance: Unified Multimodal Modeling by Multi-Task Synergycited by 11
- 2026ScaleEdit-12M: Scaling Open-Source Image Editing Data Generation via Multi-Agent Frameworkcited by 5
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligencecited by 3
- 2026Latent Action Control for Reasoning-Guided Unified Image Generationcited by 1
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editingcited by 0
- 2026Cross-Branch Conflict as a Shield: Safeguarding Facial Identities in Unified Multimodal Image Editingcited by 0
- 2026STBridge: Shared-Target Alignment for Bridging Understanding and Generation in UMMscited by 0
- 2026Test-Time Curriculum for Open-Set AIGC Detectioncited by 0
- 2026UniSpace: Unified Visual Representation and Scalable Multimodal Modelingcited by 0
- 2026GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplaycited by 0
12 most cited of 13 All 13 (JSON)
- 2026Reasoning-Informed Visual Editing8 Oct 2026
- 2026GameHorizon Suite: Multi-Horizon Data and Evaluation in Gameplay21 Sep 2026
- 2026SenseNova-U1.5: Towards Native Unified Visual Intelligence10 Sep 2026
- 2026UniSpace: Unified Visual Representation and Scalable Multimodal Modeling9 Aug 2026
- 2026Test-Time Curriculum for Open-Set AIGC Detection1 Aug 2026
- 2026STBridge: Shared-Target Alignment for Bridging Understanding and Generation in UMMs19 Jul 2026
- 2026Cross-Branch Conflict as a Shield: Safeguarding Facial Identities in Unified Multimodal Image Editing18 Jul 2026
- 2026DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing2 Jul 2026
- 2026Lance: Unified Multimodal Modeling by Multi-Task Synergy18 May 2026
- 2026Latent Action Control for Reasoning-Guided Unified Image Generation16 May 2026
- 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generation27 Apr 2026
- 2026LongCat-Next: Lexicalizing Modalities as Discrete Tokens29 Mar 2026
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Can Unified Generation and Understanding Models Maintain Semantic Equivalence Across Different Output Modalities?
- 2025Uni-MMMU: A Massive Multi-discipline Multimodal Unified Benchmark
- 2025MME-Unify: A Comprehensive Benchmark for Unified Multimodal Understanding and Generation Models
- 2026Omni-R1: Towards the Unified Generative Paradigm for Multimodal Reasoning
- 2025ROVER: Benchmarking Reciprocal Cross-Modal Reasoning for Omnimodal Generation
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editing
- 2026UniReason 1.0: A Unified Reasoning Framework for World Knowledge Aligned Image Generation and Editing
- 2026When Does Visual Generation Help Visual Understanding in Unified Multimodal Models?