Innovator-VL: A Multimodal Large Language Model for Scientific Discovery
On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning
Abstract (arXiv)
We present Innovator-VL, a scientific multimodal large language model designed to advance understanding and reasoning across diverse scientific domains while maintaining excellent performance on general vision tasks. Contrary to the trend of relying on massive domain-specific pretraining and opaque pipelines, our work demonstrates that principled training design and transparent methodology can yield strong scientific intelligence with substantially reduced data requirements. (i) First, we provide a fully transparent, end-to-end reproducible training pipeline, covering data collection, cleaning, preprocessing, supervised fine-tuning, reinforcement learning, and evaluation, along with detailed optimization recipes. This facilitates systematic extension by the community. (ii) Second, Innovator-VL exhibits remarkable data efficiency, achieving competitive performance on various scientific tasks using fewer than five million curated samples without large-scale pretraining. These results highlight that effective reasoning can be achieved through principled data selection rather than indiscriminate scaling. (iii) Third, Innovator-VL demonstrates strong generalization, achieving competitive performance on general vision, multimodal reasoning, and scientific benchmarks. This indicates that scientific alignment can be integrated into a unified model without compromising general-purpose capabilities. Our practices suggest that efficient, reproducible, and high-performing scientific multimodal models can be built even without large-scale data, providing a practical foundation for future research.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 63 of its 81 references that are in the map. First posted on arXiv 27 Jan 2026.
Builds on
63 of 81 references.
Closest ancestors · 10
Same direction, newest first
- 2025Qwen3-VL Technical Report26 Nov
- 2025Bee: A High-Quality Corpus and Full-Stack Suite to Unlock Advanced Fully Open MLLMs15 Oct
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Training28 Sep
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution18 Sep
- 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?23 Aug
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phone3 Aug
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Models17 Jul
- 2024SEED-Bench-2-Plus: Benchmarking Multimodal Large Language Models with Text-Rich Visual Comprehension25 Apr
- 2023SEED-Bench: Benchmarking Multimodal LLMs with Generative Comprehension30 Jul
- 2023MMBench: Is Your Multi-modal Model an All-around Player?12 Jul
Other references · 53
- 2025Qwen3 Technical Reportcited by 8,820
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
- 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,614
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,479
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
38 more
- 2025Group Sequence Policy Optimizationcited by 835
- 2024DeepSeek-V3 Technical Reportcited by 811
- 2016A Diagram Is Worth A Dozen Imagescited by 804
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2025Kimi K2: Open Agentic Intelligencecited by 567
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 526
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2021InfographicVQAcited by 437
- 2025Kimi-VL Technical Reportcited by 388
- 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 323
- 2023MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedbackcited by 297
- 2023Demystifying CLIP Datacited by 270
- 2025AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoningcited by 250
- 2025Stop Looking for Important Tokens in Multimodal Language Models: Duplication Matters Morecited by 155
- 2024LlaSMol: Advancing Large Language Models for Chemistry with a Large-Scale, Comprehensive, High-Quality Instruction Tuning Datasetcited by 128
- 2023Artificial Intelligence for Science in Quantum, Atomistic, and Continuum Systemscited by 121
- 2025MiMo-VL Technical Reportcited by 115
- 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Modelscited by 93
- 2025Token Pruning in Multimodal Large Language Models: Are We Solving the Right Problem?cited by 76
- 2022Fengshenbang 1.0: Being the Foundation of Chinese Cognitive Intelligencecited by 70
- 2024MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?cited by 66
- 2025Intern-S1: A Scientific Multimodal Foundation Modelcited by 53
- 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?cited by 51
- 2024Filter, Correlate, Compress: Training-Free Token Reduction for MLLM Accelerationcited by 39
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipecited by 37
- 2025Scientists' First Exam: Probing Cognitive Abilities of MLLM via Perception, Understanding, and Reasoningcited by 34
- 2025Global Compression Commander: Plug-and-Play Inference Acceleration for High-Resolution Large Vision-Language Modelscited by 32
- 2025MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Researchcited by 32
- 2025Shifting AI Efficiency From Model-Centric to Data-Centric Compressioncited by 29
- 2025Efficient Multi-modal Large Language Models via Progressive Consistency Distillationcited by 22
- 2025AudioMarathon: A Comprehensive Benchmark for Long-Context Audio Understanding and Efficiency in Audio LLMscited by 22
- 2025AI for Service: Proactive Assistance with AI Glassescited by 20
- 2025Are We Using the Right Benchmark: An Evaluation Framework for Visual Token Compression Methodscited by 17
- 2025Prune2Drive: A Plug-and-Play Framework for Accelerating Vision-Language Models in Autonomous Drivingcited by 16
- 2024FuXi-2.0: Advancing machine learning weather forecasting model for practical applicationscited by 11
- 2025MSEarth: A Multimodal Benchmark for Earth Science Phenomenon Discovery with MLLMscited by 10
- 2025SUPERChem: A Multimodal Reasoning Benchmark in Chemistrycited by 9
- 2025D2Pruner: Debiased Importance and Structural Diversity for MLLM Token Pruningcited by 7
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computingcited by 6
- 2026EvoStreaming: Your Offline Video Model Is a Natively Streaming Assistantcited by 5
- 2026S1-NexusAgent: a Self-Evolving Agent Framework for Multidisciplinary Scientific Researchcited by 4
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialoguecited by 2
- 2026From Answers to States: Verifiable Process-Level Evaluation of Chemical Reasoning in Large Language Modelscited by 2
- 2026OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoningcited by 0
- 2026Interpolated Policy Distillation: A Controllable Continuum Between Off-Policy and On-Policy Distillationcited by 0
- 2026Trinity: Self-Evolving Vision-Language Models with a Self-Verifiercited by 0
- 2026Trinity: Self-Evolving Vision-Language Models with a Self-Verifier3 Oct 2026
- 2026Interpolated Policy Distillation: A Controllable Continuum Between Off-Policy and On-Policy Distillation29 Sep 2026
- 2026OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoning29 Jun 2026
- 2026OmniOPSD: Rationale-Privileged On-Policy Self-Distillation for Affective Computing14 Jun 2026
- 2026From Answers to States: Verifiable Process-Level Evaluation of Chemical Reasoning in Large Language Models2 Jun 2026
- 2026LMM-Track4D: Eliciting 4D Dynamic Reasoning in LMMs via Trajectory-Grounded Dialogue19 May 2026
- 2026EvoStreaming: Your Offline Video Model Is a Natively Streaming Assistant11 May 2026
- 2026S1-NexusAgent: a Self-Evolving Agent Framework for Multidisciplinary Scientific Research2 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026DeepInnovator: Triggering the Innovative Capabilities of LLMs
- 2026SciVQR: A Multidisciplinary Multimodal Benchmark for Advanced Scientific Reasoning Evaluation
- 2025MAC: A Live Benchmark for Multimodal Large Language Models in Scientific Understanding
- 2024ChatSR: Multimodal Large Language Models for Scientific Formula Discovery
- 2023SCITUNE: Aligning Large Language Models with Human-Curated Scientific Multimodal Instructions
- 2025Position: Multimodal Large Language Models Can Significantly Advance Scientific Reasoning
- 2024SciKnowEval: Evaluating Multi-level Scientific Knowledge of Large Language Models
- 2026Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scale