Apriel-1.5-15b-Thinker
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
We present Apriel-1.5-15B-Thinker, a 15-billion parameter open-weights multimodal reasoning model that achieves frontier-level performance through training design rather than sheer scale. Starting from Pixtral-12B, we apply a progressive three-stage methodology: (1) depth upscaling to expand reasoning capacity without pretraining from scratch, (2) staged continual pre-training that first develops foundational text and vision understanding, then enhances visual reasoning through targeted synthetic data generation addressing spatial structure, compositional understanding, and fine-grained perception, and (3) high-quality text-only supervised fine-tuning on curated instruction-response pairs with explicit reasoning traces spanning mathematics, coding, science, and tool use. Notably, our model achieves competitive results without reinforcement learning or preference optimization, isolating the contribution of our data-centric continual pre-training approach. On the Artificial Analysis Intelligence Index, Apriel-1.5-15B-Thinker attains a score of 52, matching DeepSeek-R1-0528 despite requiring significantly fewer computational resources. Across ten image benchmarks, its performance is on average within five points of Gemini-2.5-Flash and Claude Sonnet-3.7, a key achievement for a model operating within single-GPU deployment constraints. Our results demonstrate that thoughtful mid-training 2 design can close substantial capability gaps without massive scale, making frontier-level multimodal reasoning accessible to organizations with limited infrastructure. We release the model checkpoint, all training recipes, and evaluation protocols under the MIT license to to advance open-source research.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 29 references that are in the map. First posted on arXiv 1 Oct 2025.
Builds on
22 of 29 references.
Closest ancestors · 4
Same direction, newest first
- 2025Kimi-VL Technical Report10 Apr
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contexts6 Jul
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset22 Feb
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contexts3 Oct
Other references · 18
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Visual Instruction Tuningcited by 7,792
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2024Qwen2 Technical Reportcited by 2,076
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,116
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 893
- 2016A Diagram Is Worth A Dozen Imagescited by 793
6 more
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 573
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 443
- 2024Auto-Cypher: Improving LLMs on Cypher generation via LLM-supervised generation-verification frameworkcited by 10
- 2025Apriel-Nemotron-15B-Thinkercited by 1
Built on by
Citing papers per year: 2025: 2.
2 papers.
- 2025Apriel-H1: Towards Efficient Enterprise Reasoning Modelscited by 2
- 2025AprielGuardcited by 2
- 2025AprielGuard23 Dec 2025
- 2025Apriel-H1: Towards Efficient Enterprise Reasoning Models4 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026Phi-4-reasoning-vision-15B Technical Report
- 2025OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe
- 2025V-Thinker: Interactive Thinking with Images
- 2025AStar: Boosting Multimodal Reasoning with Automated Structured Thinking
- 2025GThinker: Towards General Multimodal Reasoning via Cue-Guided Rethinking
- 2025LaRe: Latent Refocusing for Multimodal Reasoning
- 2026Thinking Diffusion: Penalize and Guide Visual-Grounded Reasoning in Diffusion Multimodal Language Models
- 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Space