MindGPT-4ov: An Enhanced MLLM via a Multi-Stage Post-Training Paradigm
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
We present MindGPT-4ov, a multimodal large language model (MLLM) that introduces a general post-training paradigm spanning data production, model training, and efficient deployment. It achieves state-of-the-art performance across multiple benchmarks at low cost, effectively enhancing the foundational capabilities of MLLMs and the generalization ability. Focusing on data construction, supervised fine-tuning strategies, and multimodal reinforcement learning methods, this work proposes three key innovations: (1) An information density-based data generation scheme, integrated with a dual-dimensional tree-structured label system, enabling automated generation of high-quality cross-domain data. (2) A collaborative curriculum supervised fine-tuning approach that balances the injection of domain-specific knowledge with the preservation of general capabilities. (3) A hybrid reinforcement learning paradigm that enhances reasoning ability while simultaneously addressing multi-objective optimization such as diversity exploration, maintenance of multimodal perception, and response conciseness. Moreover, we implement a series of infrastructure optimizations, such as 5D parallel training, operator optimization, and inference quantization to enhance training and inference efficiency while reducing the cost of domain adaptation. Experimental results demonstrate that the MindGPT-4ov model outperforms state-of-the-art models on benchmarks such as MMBench, MMStar, MathVision, and MathVista. In addition, MindGPT-4ov also demonstrates superior user experience in vertical domain tasks, enabling a seamless transition from academic research to industrial deployment. MindGPT-4ov provides a general post-training paradigm applicable to a wide range of MLLMs. The model weights, datasets, and code for the Qwen3-VL-based variants will be recently open-sourced to support the community's development of MLLMs.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 71 of its 78 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
71 of 78 references.
Closest ancestors · 3
Same direction, newest first
- 2025PhysVLM: Enabling Visual Language Models to Understand Robotic Physical Reachability11 Mar
- 2024SpatialBot: Precise Spatial Understanding with Vision Language Models19 Jun
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
Other references · 68
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Segment Anythingcited by 8,158
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024GPT-4o System Cardcited by 4,467
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
38 more
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2016A Diagram Is Worth A Dozen Imagescited by 793
- 2025Group Sequence Policy Optimizationcited by 788
- 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 621
- 2024DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Servingcited by 595
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 516
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
- 2021InfographicVQAcited by 430
- 2025Seed1.5-VL Technical Reportcited by 367
- 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266
- 2025FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Servingcited by 248
- 2024A Survey on Mixture of Experts in Large Language Modelscited by 233
- 2022MegaBlocks: Efficient Sparse Training with Mixture-of-Expertscited by 204
- 2023Teaching CLIP to Count to Tencited by 194
- 2023SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefillscited by 187
- 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 178
50 most cited of 68 All 68 (JSON)
Built on by
Citing papers per year: 2025: 1; 2026: 8.
9 papers.
- 2025MindWatcher: Toward Smarter Multimodal Tool-Integrated Reasoningcited by 6
- 2026Evolving from Tool User to Creator via Training-Free Experience Reuse in Multimodal Reasoningcited by 6
- 2026StreamingClaw Technical Reportcited by 4
- 2026Self-Consistent Latent Reasoning: Long Latent Sequence Reasoning for Vision-Language Modelcited by 3
- 2026Evaluating the Search Agent in a Parallel Worldcited by 1
- 2026EXPLORE-Bench: Egocentric Scene Prediction with Long-Horizon Reasoningcited by 1
- 2026Design-MLLM: A Reinforcement Alignment Framework for Verifiable and Aesthetic Interior Designcited by 0
- 2026CGC: Compositional Grounded Contrast for Fine-Grained Multi-Image Understandingcited by 0
- 2026ME-VLM: A Unified VLM for Embodied Cognition and Agent Coordinationcited by 0
- 2026ME-VLM: A Unified VLM for Embodied Cognition and Agent Coordination21 Sep 2026
- 2026Self-Consistent Latent Reasoning: Long Latent Sequence Reasoning for Vision-Language Model12 May 2026
- 2026CGC: Compositional Grounded Contrast for Fine-Grained Multi-Image Understanding24 Apr 2026
- 2026StreamingClaw Technical Report23 Mar 2026
- 2026EXPLORE-Bench: Egocentric Scene Prediction with Long-Horizon Reasoning10 Mar 2026
- 2026Evaluating the Search Agent in a Parallel World5 Mar 2026
- 2026Design-MLLM: A Reinforcement Alignment Framework for Verifiable and Aesthetic Interior Design4 Mar 2026
- 2026Evolving from Tool User to Creator via Training-Free Experience Reuse in Multimodal Reasoning2 Feb 2026
- 2025MindWatcher: Toward Smarter Multimodal Tool-Integrated Reasoning29 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Models
- 2025Observe-R1: Unlocking Reasoning Abilities of MLLMs with Dynamic Progressive Reinforcement Learning
- 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models
- 2025OThink-MR1: Stimulating multimodal generalized reasoning capabilities via dynamic reinforcement learning
- 2025Infi-MMR: Curriculum-based Unlocking Multimodal Reasoning via Phased Reinforcement Learning in Multimodal Small Language Models
- 2025R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learning
- 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
- 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning