STEP3-VL-10B Technical Report
Not on the map. Why?
Abstract (arXiv)
We present STEP3-VL-10B, a lightweight open-source foundation model designed to redefine the trade-off between compact efficiency and frontier-level multimodal intelligence. STEP3-VL-10B is realized through two strategic shifts: first, a unified, fully unfrozen pre-training strategy on 1.2T multimodal tokens that integrates a language-aligned Perception Encoder with a Qwen3-8B decoder to establish intrinsic vision-language synergy; and second, a scaled post-training pipeline featuring over 1k iterations of reinforcement learning. Crucially, we implement Parallel Coordinated Reasoning (PaCoRe) to scale test-time compute, allocating resources to scalable perceptual reasoning that explores and synthesizes diverse visual hypotheses. Consequently, despite its compact 10B footprint, STEP3-VL-10B rivals or surpasses models 10×-20× larger (e.g., GLM-4.6V-106B, Qwen3-VL-235B) and top-tier proprietary flagships like Gemini 2.5 Pro and Seed-1.5-VL. Delivering best-in-class performance, it records 92.2% on MMBench and 80.11% on MMMU, while excelling in complex reasoning with 94.43% on AIME2025 and 75.95% on MathVision. We release the full model suite to provide the community with a powerful, efficient, and reproducible baseline.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 91 of its 125 references that are in the map. First posted on arXiv 14 Jan 2026.
Builds on
91 of 125 references.
References · 91
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
38 more
- 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
- 2016A Diagram Is Worth A Dozen Imagescited by 793
- 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
- 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 553
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 516
- 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 507
- 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 484
- 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 467
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
- 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Modelscited by 463
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
- 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 450
- 2021OCR-free Document Understanding Transformercited by 400
- 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 385
- 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 370
- 2025Seed1.5-VL Technical Reportcited by 367
- 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 315
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 281
- 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
- 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Usecited by 246
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 229
- 2024WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wildcited by 211
- 2023Teaching CLIP to Count to Tencited by 194
- 2024MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGIcited by 192
- 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
- 2025MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMscited by 171
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 169
50 most cited of 91 All 91 (JSON)
Built on by
Citing papers per year: 2026: 28.
28 papers.
Sort:
By area:
- 2026DeepSeek-OCR 2: Visual Causal Flowcited by 68
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decodingcited by 20
- 2026MM-DeepResearch: A Simple and Effective Multimodal Agentic Search Baselinecited by 18
- 2026FireRed-OCR Technical Reportcited by 12
- 2026WebVR: Benchmarking Multimodal LLMs for WebPage Recreation from Videos via Human-Aligned Visual Rubricscited by 8
- 2026Unlimited OCR Workscited by 8
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editingcited by 6
- 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligencecited by 6
- 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnosticscited by 5
- 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughtscited by 3
- 2026Seeing as Experts Do: A Knowledge-Augmented Agent for Open-Set Fine-Grained Visual Understandingcited by 2
- 2026Buy versus Build an LLM: A Decision Framework for Governmentscited by 1
16 more
- 2026EXPLORE-Bench: Egocentric Scene Prediction with Long-Horizon Reasoningcited by 1
- 2026HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluationcited by 1
- 2026EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Modelscited by 1
- 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensemblescited by 1
- 2026PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perceptioncited by 1
- 2026Actor as Its Own Critic: Unifying Region Understanding and Localization via CycleGRPOcited by 1
- 2026R-Align: Enhancing Generative Reward Models through Rationale-Centric Meta-Judgingcited by 0
- 2026Visual Para-Thinker: Divide-and-Conquer Reasoning for Visual Comprehensioncited by 0
- 2026Perception or Prejudice: Can MLLMs Go Beyond First Impressions of Personality?cited by 0
- 2026iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learningcited by 0
- 2026PorTEXTO: A European Portuguese Benchmark for Visual Text Extractioncited by 0
- 2026OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoningcited by 0
- 2026MentalThink: Shaping Thoughts in Mental SVG Worldcited by 0
- 2026HoloCount: A Holistic Visual Counting Benchmark for MLLMscited by 0
- 2026MMJailBench: A Factorized Benchmark for Disentangling Multimodal Jailbreak Vulnerabilitiescited by 0
- 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsingcited by 0
- 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsing17 Sep 2026
- 2026MMJailBench: A Factorized Benchmark for Disentangling Multimodal Jailbreak Vulnerabilities26 Aug 2026
- 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligence14 Jul 2026
- 2026Actor as Its Own Critic: Unifying Region Understanding and Localization via CycleGRPO13 Jul 2026
- 2026HoloCount: A Holistic Visual Counting Benchmark for MLLMs7 Jul 2026
- 2026MentalThink: Shaping Thoughts in Mental SVG World3 Jul 2026
- 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts30 Jun 2026
- 2026OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoning29 Jun 2026
- 2026PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perception26 Jun 2026
- 2026Unlimited OCR Works22 Jun 2026
- 2026PorTEXTO: A European Portuguese Benchmark for Visual Text Extraction17 Jun 2026
- 2026iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning29 May 2026
16 more
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensembles21 May 2026
- 2026Perception or Prejudice: Can MLLMs Go Beyond First Impressions of Personality?21 May 2026
- 2026EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Models16 May 2026
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editing15 May 2026
- 2026WebVR: Benchmarking Multimodal LLMs for WebPage Recreation from Videos via Human-Aligned Visual Rubrics11 Mar 2026
- 2026HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluation11 Mar 2026
- 2026EXPLORE-Bench: Egocentric Scene Prediction with Long-Horizon Reasoning10 Mar 2026
- 2026Seeing as Experts Do: A Knowledge-Augmented Agent for Open-Set Fine-Grained Visual Understanding4 Mar 2026
- 2026FireRed-OCR Technical Report2 Mar 2026
- 2026MM-DeepResearch: A Simple and Effective Multimodal Agentic Search Baseline1 Mar 2026
- 2026Buy versus Build an LLM: A Decision Framework for Governments13 Feb 2026
- 2026Visual Para-Thinker: Divide-and-Conquer Reasoning for Visual Comprehension10 Feb 2026
- 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnostics6 Feb 2026
- 2026R-Align: Enhancing Generative Reward Models through Rationale-Centric Meta-Judging6 Feb 2026
- 2026DeepSeek-OCR 2: Visual Causal Flow28 Jan 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decodingcited by 20
- 2026WebVR: Benchmarking Multimodal LLMs for WebPage Recreation from Videos via Human-Aligned Visual Rubricscited by 8
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editingcited by 6
- 2026Seeing as Experts Do: A Knowledge-Augmented Agent for Open-Set Fine-Grained Visual Understandingcited by 2
- 2026HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluationcited by 1
- 2026EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Modelscited by 1
- 2026Actor as Its Own Critic: Unifying Region Understanding and Localization via CycleGRPOcited by 1
- 2026Perception or Prejudice: Can MLLMs Go Beyond First Impressions of Personality?cited by 0
- 2026Actor as Its Own Critic: Unifying Region Understanding and Localization via CycleGRPO13 Jul 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026Perception or Prejudice: Can MLLMs Go Beyond First Impressions of Personality?21 May 2026
- 2026EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Models16 May 2026
- 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editing15 May 2026
- 2026WebVR: Benchmarking Multimodal LLMs for WebPage Recreation from Videos via Human-Aligned Visual Rubrics11 Mar 2026
- 2026HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluation11 Mar 2026
- 2026Seeing as Experts Do: A Knowledge-Augmented Agent for Open-Set Fine-Grained Visual Understanding4 Mar 2026
- 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughtscited by 3
- 2026EXPLORE-Bench: Egocentric Scene Prediction with Long-Horizon Reasoningcited by 1
- 2026Visual Para-Thinker: Divide-and-Conquer Reasoning for Visual Comprehensioncited by 0
- 2026iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learningcited by 0
- 2026OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoningcited by 0
- 2026MentalThink: Shaping Thoughts in Mental SVG Worldcited by 0
- 2026HoloCount: A Holistic Visual Counting Benchmark for MLLMscited by 0
- 2026HoloCount: A Holistic Visual Counting Benchmark for MLLMs7 Jul 2026
- 2026MentalThink: Shaping Thoughts in Mental SVG World3 Jul 2026
- 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughts30 Jun 2026
- 2026OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoning29 Jun 2026
- 2026iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learning29 May 2026
- 2026EXPLORE-Bench: Egocentric Scene Prediction with Long-Horizon Reasoning10 Mar 2026
- 2026Visual Para-Thinker: Divide-and-Conquer Reasoning for Visual Comprehension10 Feb 2026
- 2026Unlimited OCR Workscited by 8
- 2026Unlimited OCR Works22 Jun 2026
- 2026DeepSeek-OCR 2: Visual Causal Flowcited by 68
- 2026FireRed-OCR Technical Reportcited by 12
- 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligencecited by 6
- 2026Buy versus Build an LLM: A Decision Framework for Governmentscited by 1
- 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensemblescited by 1
- 2026PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perceptioncited by 1
- 2026PorTEXTO: A European Portuguese Benchmark for Visual Text Extractioncited by 0
- 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsingcited by 0
- 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsing17 Sep 2026
- 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligence14 Jul 2026
- 2026PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perception26 Jun 2026
- 2026PorTEXTO: A European Portuguese Benchmark for Visual Text Extraction17 Jun 2026
- 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensembles21 May 2026
- 2026FireRed-OCR Technical Report2 Mar 2026
- 2026Buy versus Build an LLM: A Decision Framework for Governments13 Feb 2026
- 2026DeepSeek-OCR 2: Visual Causal Flow28 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2025Unveiling Chain of Step Reasoning for Vision-Language Models with Fine-grained Rewards
- 2026Balanced Thinking: Improving Chain of Thought Training in Vision Language Models
- 2025One RL to See Them All: Visual Triple Unified Reinforcement Learning
- 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoning
- 2025Simple o3: Towards Interleaved Vision-Language Reasoning
- 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Models
- 2025Scaling Agentic Reinforcement Learning for Tool-Integrated Reasoning in VLMs
- 2026Difference Feedback: Generating Multimodal Process-Level Supervision for VLM Reinforcement Learning