mlsanityData to 14 Oct 2026

SAIL-VL2 Technical Report

arXiv 2509.14033 ↗First posted 17 Sep 2025cs.CVcited by 14

On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning

also in 1 more
Abstract (arXiv)

We introduce SAIL-VL2, an open-suite vision-language foundation model (LVM) for comprehensive multimodal understanding and reasoning. As the successor to SAIL-VL, SAIL-VL2 achieves state-of-the-art performance at the 2B and 8B parameter scales across diverse image and video benchmarks, demonstrating strong capabilities from fine-grained perception to complex reasoning. Its effectiveness is driven by three core innovations. First, a large-scale data curation pipeline with scoring and filtering strategies enhances both quality and distribution across captioning, OCR, QA, and video data, improving training efficiency. Second, a progressive training framework begins with a powerful pre-trained vision encoder (SAIL-ViT), advances through multimodal pre-training, and culminates in a thinking-fusion SFT-RL hybrid paradigm that systematically strengthens model capabilities. Third, architectural advances extend beyond dense LLMs to efficient sparse Mixture-of-Experts (MoE) designs. With these contributions, SAIL-VL2 demonstrates competitive performance across 106 datasets and achieves state-of-the-art results on challenging reasoning benchmarks such as MMMU and MathVista. Furthermore, on the OpenCompass leaderboard, SAIL-VL2-2B ranks first among officially released open-source models under the 4B parameter scale, while serving as an efficient and extensible foundation for the open-source multimodal community.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 76 of its 86 references that are in the map. First posted on arXiv 17 Sep 2025.

Builds on

76 of 86 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Seed1.5-VL Technical Report11 May
  2. 2025Kimi-VL Technical Report10 Apr
  3. 2025Scalable Vision Language Model Training via High Quality Data Curation10 Jan
  4. 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Step15 Nov
  5. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Models25 Sep
  6. 2024Building and better understanding vision-language models: insights and future directions22 Aug
  7. 2024Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models25 Jun
  8. 2024What matters when building vision-language models?3 May
  9. 2024MM-MATH: Advancing Multimodal Math Evaluation with Process Evaluation and Fine-grained Classification7 Apr
  10. 2024PuzzleVQA: Diagnosing Multimodal Reasoning Challenges of Language Models with Abstract Visual Patterns20 Mar

Other references · 66

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2017Proximal Policy Optimization Algorithmscited by 15,215
  5. 2024The Llama 3 Herd of Modelscited by 14,715
  6. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  7. 2025Qwen3 Technical Reportcited by 8,820
  8. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  9. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  10. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  11. 2025Qwen2.5-VL Technical Reportcited by 5,587
  12. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
38 more
  1. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  2. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  3. 2016Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question Answeringcited by 2,516
  4. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,141
  5. 2022Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answeringcited by 1,919
  6. 2020The Many Faces of Robustness: A Critical Analysis of Out-of-Distribution Generalizationcited by 1,850
  7. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
  8. 2019Do ImageNet Classifiers Generalize to ImageNet?cited by 1,515
  9. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  10. 2016CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual Reasoningcited by 1,457
  11. 2019Natural Adversarial Examplescited by 1,408
  12. 2023Video-LLaVA: Learning United Visual Representation by Alignment Before Projectioncited by 1,402
  13. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  14. 2019OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledgecited by 1,121
  15. 2023ShareGPT4V: Improving Large Multi-Modal Models with Better Captionscited by 1,005
  16. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  17. 2025Group Sequence Policy Optimizationcited by 835
  18. 2024VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMscited by 771
  19. 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 744
  20. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 665
  21. 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 662
  22. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
  23. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 583
  24. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
  25. 2024Magpie: Alignment Data Synthesis from Scratch by Prompting Aligned LLMs with Nothingcited by 346
  26. 2018DVQA: Understanding Data Visualizations via Question Answeringcited by 340
  27. 2019Scene Text Visual Question Answeringcited by 331
  28. 2025VL-Rethinker: Incentivizing Self-Reflection of Vision-Language Models with Reinforcement Learningcited by 323
  29. 2024InternVideo2: Scaling Foundation Models for Multimodal Video Understandingcited by 317
  30. 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 314
  31. 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learningcited by 303
  32. 2024Enhancing the Reasoning Ability of Multimodal Large Language Models via Mixed Preference Optimizationcited by 239
  33. 2024OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Datacited by 200
  34. 2024Direct Preference Optimization of Video Large Multimodal Models from Language Model Rewardcited by 147
  35. 2024Aria: An Open Multimodal Native Mixture-of-Experts Modelcited by 138
  36. 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scalecited by 127
  37. 2024SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Modelscited by 125
  38. 2024Multimodal Autoregressive Pre-training of Large Vision Encoderscited by 109

50 most cited of 66 All 66 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 8.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025The Scalability of Simplicity: Empirical Analysis of Vision-Language Learning with a Single Transformer
  2. 2024Enhancing Advanced Visual Reasoning Ability of Large Language Models
  3. 2025MarineEval: Assessing the Marine Intelligence of Vision-Language Models
  4. 2025Activating Visual Context and Commonsense Reasoning through Masked Prediction in VLMs
  5. 2025Skywork-R1V3 Technical Report
  6. 2025MiMo-VL Technical Report
  7. 2025Pixel-SAIL: Single Transformer For Pixel-Grounded Understanding
  8. 2025VisuLogic: A Benchmark for Evaluating Visual Reasoning in Multi-modal Large Language Models