mlsanityData to 7 Oct 2026

STEP3-VL-10B Technical Report

arXiv 2601.09668 ↗First posted 14 Jan 2026cs.CVcited by 28

Not on the map. Why?

Abstract (arXiv)

We present STEP3-VL-10B, a lightweight open-source foundation model designed to redefine the trade-off between compact efficiency and frontier-level multimodal intelligence. STEP3-VL-10B is realized through two strategic shifts: first, a unified, fully unfrozen pre-training strategy on 1.2T multimodal tokens that integrates a language-aligned Perception Encoder with a Qwen3-8B decoder to establish intrinsic vision-language synergy; and second, a scaled post-training pipeline featuring over 1k iterations of reinforcement learning. Crucially, we implement Parallel Coordinated Reasoning (PaCoRe) to scale test-time compute, allocating resources to scalable perceptual reasoning that explores and synthesizes diverse visual hypotheses. Consequently, despite its compact 10B footprint, STEP3-VL-10B rivals or surpasses models 10×-20× larger (e.g., GLM-4.6V-106B, Qwen3-VL-235B) and top-tier proprietary flagships like Gemini 2.5 Pro and Seed-1.5-VL. Delivering best-in-class performance, it records 92.2% on MMBench and 80.11% on MMMU, while excelling in complex reasoning with 94.43% on AIME2025 and 75.95% on MathVision. We release the full model suite to provide the community with a powerful, efficient, and reproducible baseline.

Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Builds on 91 of its 125 references that are in the map. First posted on arXiv 14 Jan 2026.

Builds on

91 of 125 references.

References · 91

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  3. 2017Proximal Policy Optimization Algorithmscited by 14,441
  4. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  5. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  6. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  7. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
  8. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,845
  9. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  10. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
  11. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  12. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
38 more
  1. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  2. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
  3. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
  4. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  5. 2023Instruction-Following Evaluation for Large Language Modelscited by 1,143
  6. 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 948
  7. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
  8. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  9. 2016A Diagram Is Worth A Dozen Imagescited by 793
  10. 2024Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMscited by 719
  11. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
  12. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 572
  13. 2018From Recognition to Cognition: Visual Commonsense Reasoningcited by 553
  14. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
  15. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 516
  16. 2024FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisioncited by 507
  17. 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 484
  18. 2020PathVQA: 30000+ Questions for Medical Visual Question Answeringcited by 467
  19. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 466
  20. 2025The Entropy Mechanism of Reinforcement Learning for Reasoning Language Modelscited by 463
  21. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  22. 2025Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Modelcited by 450
  23. 2021OCR-free Document Understanding Transformercited by 400
  24. 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 385
  25. 2024OS-ATLAS: A Foundation Action Model for Generalist GUI Agentscited by 370
  26. 2025Seed1.5-VL Technical Reportcited by 367
  27. 2025Perception Encoder: The best visual embeddings are not at the output of the networkcited by 315
  28. 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?cited by 281
  29. 2024MinerU: An Open-Source Solution for Precise Document Content Extractioncited by 255
  30. 2025ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Usecited by 246
  31. 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 233
  32. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 229
  33. 2024WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wildcited by 211
  34. 2023Teaching CLIP to Count to Tencited by 194
  35. 2024MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGIcited by 192
  36. 2024General OCR Theory: Towards OCR-2.0 via a Unified End-to-end Modelcited by 174
  37. 2025MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMscited by 171
  38. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 169

50 most cited of 91 All 91 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 28.

28 papers.

Sort:

By area:

  1. 2026DeepSeek-OCR 2: Visual Causal Flowcited by 68
  2. 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decodingcited by 20
  3. 2026MM-DeepResearch: A Simple and Effective Multimodal Agentic Search Baselinecited by 18
  4. 2026FireRed-OCR Technical Reportcited by 12
  5. 2026WebVR: Benchmarking Multimodal LLMs for WebPage Recreation from Videos via Human-Aligned Visual Rubricscited by 8
  6. 2026Unlimited OCR Workscited by 8
  7. 2026VCG-Bench: Towards A Unified Visual-Centric Benchmark for Structured Generation and Editingcited by 6
  8. 2026Self in Space: Benchmarking Self-Awareness and Spatial Cognition in UAV Embodied Intelligencecited by 6
  9. 2026VenusBench-Mobile: A Challenging and User-Centric Benchmark for Mobile GUI Agents with Capability Diagnosticscited by 5
  10. 2026CoLT: Teaching Multi-Modal Models to Think with Chain of Latent Thoughtscited by 3
  11. 2026Seeing as Experts Do: A Knowledge-Augmented Agent for Open-Set Fine-Grained Visual Understandingcited by 2
  12. 2026Buy versus Build an LLM: A Decision Framework for Governmentscited by 1
16 more
  1. 2026EXPLORE-Bench: Egocentric Scene Prediction with Long-Horizon Reasoningcited by 1
  2. 2026HanMoVLM: Large Vision-Language Models for Professional Artistic Painting Evaluationcited by 1
  3. 2026EPIC-Bench: A Perception-Centric Benchmark for Fine-Grained Embodied Visual Grounding in Vision-Language Modelscited by 1
  4. 2026Maestro: Reinforcement Learning to Orchestrate Hierarchical Model-Skill Ensemblescited by 1
  5. 2026PerceptionRubrics: Calibrating Multimodal Evaluation to Human Perceptioncited by 1
  6. 2026Actor as Its Own Critic: Unifying Region Understanding and Localization via CycleGRPOcited by 1
  7. 2026R-Align: Enhancing Generative Reward Models through Rationale-Centric Meta-Judgingcited by 0
  8. 2026Visual Para-Thinker: Divide-and-Conquer Reasoning for Visual Comprehensioncited by 0
  9. 2026Perception or Prejudice: Can MLLMs Go Beyond First Impressions of Personality?cited by 0
  10. 2026iVGR: Internalizing Visually Grounded Reasoning for MLLMs with Reinforcement Learningcited by 0
  11. 2026PorTEXTO: A European Portuguese Benchmark for Visual Text Extractioncited by 0
  12. 2026OmniCoT: A Benchmark for Global and Multi-Step Panoramic Reasoningcited by 0
  13. 2026MentalThink: Shaping Thoughts in Mental SVG Worldcited by 0
  14. 2026HoloCount: A Holistic Visual Counting Benchmark for MLLMscited by 0
  15. 2026MMJailBench: A Factorized Benchmark for Disentangling Multimodal Jailbreak Vulnerabilitiescited by 0
  16. 2026WeVisDoc: From Coverage to Capability for Robust End-to-End Document Parsingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Unveiling Chain of Step Reasoning for Vision-Language Models with Fine-grained Rewards
  2. 2026Balanced Thinking: Improving Chain of Thought Training in Vision Language Models
  3. 2025One RL to See Them All: Visual Triple Unified Reinforcement Learning
  4. 2026DeepVision-103K: A Visually Diverse, Broad-Coverage, and Verifiable Mathematical Dataset for Multimodal Reasoning
  5. 2025Simple o3: Towards Interleaved Vision-Language Reasoning
  6. 2026Insight-V++: Towards Advanced Long-Chain Visual Reasoning with Multimodal Large Language Models
  7. 2025Scaling Agentic Reinforcement Learning for Tool-Integrated Reasoning in VLMs
  8. 2026Difference Feedback: Generating Multimodal Process-Level Supervision for VLM Reinforcement Learning