mlsanityData to 14 Oct 2026

Innovator-VL: A Multimodal Large Language Model for Scientific Discovery

arXiv 2601.19325 ↗First posted 27 Jan 2026cs.CV cs.AIcited by 8

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

Abstract (arXiv)

We present Innovator-VL, a scientific multimodal large language model designed to advance understanding and reasoning across diverse scientific domains while maintaining excellent performance on general vision tasks. Contrary to the trend of relying on massive domain-specific pretraining and opaque pipelines, our work demonstrates that principled training design and transparent methodology can yield strong scientific intelligence with substantially reduced data requirements. (i) First, we provide a fully transparent, end-to-end reproducible training pipeline, covering data collection, cleaning, preprocessing, supervised fine-tuning, reinforcement learning, and evaluation, along with detailed optimization recipes. This facilitates systematic extension by the community. (ii) Second, Innovator-VL exhibits remarkable data efficiency, achieving competitive performance on various scientific tasks using fewer than five million curated samples without large-scale pretraining. These results highlight that effective reasoning can be achieved through principled data selection rather than indiscriminate scaling. (iii) Third, Innovator-VL demonstrates strong generalization, achieving competitive performance on general vision, multimodal reasoning, and scientific benchmarks. This indicates that scientific alignment can be integrated into a unified model without compromising general-purpose capabilities. Our practices suggest that efficient, reproducible, and high-performing scientific multimodal models can be built even without large-scale data, providing a practical foundation for future research.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 63 of its 81 references that are in the map. First posted on arXiv 27 Jan 2026.

Builds on

63 of 81 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Qwen3-VL Technical Report26 Nov
  2. 2025Bee: A High-Quality Corpus and Full-Stack Suite to Unlock Advanced Fully Open MLLMs15 Oct
  3. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Training28 Sep
  4. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution18 Sep
  5. 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?23 Aug
  6. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phone3 Aug
  7. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models17 Jul
  8. 2024SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehension25 Apr
  9. 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehension30 Jul
  10. 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul

Other references · 53

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2025Qwen2.5-VL Technical Reportcited by 5,587
  3. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  4. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  5. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  7. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
  8. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
  9. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  10. 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
  11. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  12. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
38 more
  1. 2025Group Sequence Policy Optimizationcited by 835
  2. 2024DeepSeek-V3 Technical Reportcited by 811
  3. 2016A Diagram Is Worth A Dozen Imagescited by 804
  4. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
  5. 2025Kimi K2: Open Agentic Intelligencecited by 567
  6. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
  7. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
  8. 2021InfographicVQAcited by 437
  9. 2025Kimi-VL Technical Reportcited by 388
  10. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 323
  11. 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 297
  12. 2023Demystifying CLIP Datacited by 270
  13. 2025AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoningcited by 250
  14. 2025Stop Looking for Important Tokens in Multimodal Language Models: Duplication Matters Morecited by 155
  15. 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 128
  16. 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 121
  17. 2025MiMo-VL Technical Reportcited by 115
  18. 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Modelscited by 93
  19. 2025Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem?cited by 76
  20. 2022Fengshenbang 1.0: Being the Foundation of Chinese Cognitive Intelligencecited by 70
  21. 2024MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?cited by 66
  22. 2025Intern-S1: A Scientific Multimodal Foundation Modelcited by 53
  23. 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?cited by 51
  24. 2024Filter, Correlate, Compress: Training-Free Token Reduction for MLLM Accelerationcited by 39
  25. 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipecited by 37
  26. 2025Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoningcited by 34
  27. 2025Global Compression Commander: Plug-and-Play Inference Acceleration for High-Resolution Large Vision-Language Modelscited by 32
  28. 2025MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Researchcited by 32
  29. 2025Shifting AI Efficiency From Model-Centric to Data-Centric Compressioncited by 29
  30. 2025Efficient Multi-modal Large Language Models via Progressive Consistency Distillationcited by 22
  31. 2025AudioMarathon: A Comprehensive Benchmark for Long-Context Audio Understanding and Efficiency in Audio LLMscited by 22
  32. 2025AI for Service: Proactive Assistance with AI Glassescited by 20
  33. 2025Are We Using the Right Benchmark: An Evaluation Framework for Visual Token Compression Methodscited by 17
  34. 2025Prune2Drive: A Plug-and-Play Framework for Accelerating Vision-Language Models in Autonomous Drivingcited by 16
  35. 2024FuXi-2.0: Advancing machine learning weather forecasting model for practical applicationscited by 11
  36. 2025MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMscited by 10
  37. 2025SUPERChem: A Multimodal Reasoning Benchmark in Chemistrycited by 9
  38. 2025D2Pruner: Debiased Importance and Structural Diversity for MLLM Token Pruningcited by 7

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 8.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026DeepInnovator: Triggering the Innovative Capabilities of LLMs
  2. 2026SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation
  3. 2025MAC: A Live Benchmark for Multimodal Large Language Models in Scientific Understanding
  4. 2024ChatSR: Multimodal Large Language Models for Scientific Formula Discovery
  5. 2023SCITUNE: Aligning Large Language Models with Human-Curated Scientific Multimodal Instructions
  6. 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning
  7. 2024SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models
  8. 2026Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scale