mlsanityData to 7 Oct 2026

MindGPT-4ov: An Enhanced MLLM via a Multi-Stage Post-Training Paradigm

arXiv 2512.02895 ↗First posted 2 Dec 2025cs.CVcited by 9

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

We present MindGPT-4ov, a multimodal large language model (MLLM) that introduces a general post-training paradigm spanning data production, model training, and efficient deployment. It achieves state-of-the-art performance across multiple benchmarks at low cost, effectively enhancing the foundational capabilities of MLLMs and the generalization ability. Focusing on data construction, supervised fine-tuning strategies, and multimodal reinforcement learning methods, this work proposes three key innovations: (1) An information density-based data generation scheme, integrated with a dual-dimensional tree-structured label system, enabling automated generation of high-quality cross-domain data. (2) A collaborative curriculum supervised fine-tuning approach that balances the injection of domain-specific knowledge with the preservation of general capabilities. (3) A hybrid reinforcement learning paradigm that enhances reasoning ability while simultaneously addressing multi-objective optimization such as diversity exploration, maintenance of multimodal perception, and response conciseness. Moreover, we implement a series of infrastructure optimizations, such as 5D parallel training, operator optimization, and inference quantization to enhance training and inference efficiency while reducing the cost of domain adaptation. Experimental results demonstrate that the MindGPT-4ov model outperforms state-of-the-art models on benchmarks such as MMBench, MMStar, MathVision, and MathVista. In addition, MindGPT-4ov also demonstrates superior user experience in vertical domain tasks, enabling a seamless transition from academic research to industrial deployment. MindGPT-4ov provides a general post-training paradigm applicable to a wide range of MLLMs. The model weights, datasets, and code for the Qwen3-VL-based variants will be recently open-sourced to support the community's development of MLLMs.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 71 of its 78 references that are in the map. First posted on arXiv 2 Dec 2025.

Builds on

71 of 78 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025PhysVLM: Enabling Visual Language Models to Understand Robotic Physical Reachability11 Mar
  2. 2024SpatialBot: Precise Spatial Understanding with Vision Language Models19 Jun
  3. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan

Other references · 68

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  2. 2023Segment Anythingcited by 8,158
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  5. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
  6. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  7. 2025Qwen2.5-VL Technical Reportcited by 5,418
  8. 2024GPT-4o System Cardcited by 4,467
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  10. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  11. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  12. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
38 more
  1. 2025Qwen3-VL Technical Reportcited by 2,534
  2. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  3. 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,157
  4. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  5. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  6. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  7. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
  8. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
  9. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  10. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,544
  11. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  12. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  13. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,288
  14. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  15. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
  16. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
  17. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  18. 2016A Diagram Is Worth A Dozen Imagescited by 793
  19. 2025Group Sequence Policy Optimizationcited by 788
  20. 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 621
  21. 2024DistServe: Disaggregating Prefill and Decoding for Goodput-optimized Large Language Model Servingcited by 595
  22. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
  23. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  24. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 516
  25. 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
  26. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 482
  27. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
  28. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  29. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
  30. 2021InfographicVQAcited by 430
  31. 2025Seed1.5-VL Technical Reportcited by 367
  32. 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 266
  33. 2025FlashInfer: Efficient and Customizable Attention Engine for LLM Inference Servingcited by 248
  34. 2024A Survey on Mixture of Experts in Large Language Modelscited by 233
  35. 2022MegaBlocks: Efficient Sparse Training with Mixture-of-Expertscited by 204
  36. 2023Teaching CLIP to Count to Tencited by 194
  37. 2023SARATHI: Efficient LLM Inference by Piggybacking Decodes with Chunked Prefillscited by 187
  38. 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 178

50 most cited of 68 All 68 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 8.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Reinforcement Fine-Tuning Powers Reasoning Capability of Multimodal Large Language Models
  2. 2025Observe-R1: Unlocking Reasoning Abilities of MLLMs with Dynamic Progressive Reinforcement Learning
  3. 2025Reinforced MLLM: A Survey on RL-Based Reasoning in Multimodal Large Language Models
  4. 2025OThink-MR1: Stimulating multimodal generalized reasoning capabilities via dynamic reinforcement learning
  5. 2025Infi-MMR: Curriculum-based Unlocking Multimodal Reasoning via Phased Reinforcement Learning in Multimodal Small Language Models
  6. 2025R-4B: Incentivizing General-Purpose Auto-Thinking Capability in MLLMs via Bi-Mode Annealing and Reinforce Learning
  7. 2025Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start
  8. 2025Advancing Multimodal Reasoning: From Optimized Cold Start to Staged Reinforcement Learning