mlsanityData to 7 Oct 2026

Ministral 3

arXiv 2601.08584 ↗First posted 13 Jan 2026cs.CLcited by 88

Not on the map. Why?

Cited by 36 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We introduce the Ministral 3 series, a family of parameter-efficient dense language models designed for compute and memory constrained applications, available in three model sizes: 3B, 8B, and 14B parameters. For each model size, we release three variants: a pretrained base model for general-purpose use, an instruction finetuned, and a reasoning model for complex problem-solving. In addition, we present our recipe to derive the Ministral 3 models through Cascade Distillation, an iterative pruning and continued training with distillation technique. Each model comes with image understanding capabilities, all under the Apache 2.0 license.

Key facts. Cited by 88 papers in the map (data through 7 Oct 2026). Builds on 35 of its 39 references that are in the map. First posted on arXiv 13 Jan 2026.

Builds on

35 of 39 references.

References · 35

  1. 2017Attention Is All You Needcited by 59,932
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2024The Llama 3 Herd of Modelscited by 14,192
  4. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  5. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
  6. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  7. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  8. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  9. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,581
  10. 2019HellaSwag: Can a Machine Really Finish Your Sentence?cited by 4,018
  11. 2021Program Synthesis with Large Language Modelscited by 3,509
  12. 2017TriviaQA: A Large Scale Distantly Supervised Challenge Dataset for Reading Comprehensioncited by 2,895
23 more
  1. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  2. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  3. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  4. 2020GLU Variants Improve Transformercited by 1,724
  5. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,582
  6. 2019Root Mean Square Layer Normalizationcited by 1,425
  7. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,311
  8. 2017RACE: Large-scale ReAding Comprehension Dataset From Examinationscited by 851
  9. 2023A Simple and Effective Pruning Approach for Large Language Modelscited by 776
  10. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 701
  11. 2023YaRN: Efficient Context Window Extension of Large Language Modelscited by 584
  12. 2024From Crowdsourced Data to High-Quality Benchmarks: Arena-Hard and BenchBuilder Pipelinecited by 484
  13. 2024Direct Language Model Alignment from Online AI Feedbackcited by 257
  14. 2024WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wildcited by 211
  15. 2024Are We Done with MMLU?cited by 178
  16. 2024Pixtral 12Bcited by 174
  17. 2024Compact Language Models via Pruning and Knowledge Distillationcited by 142
  18. 2024LLM Pruning and Distillation in Practice: The Minitron Approachcited by 82
  19. 2023EQ-Bench: An Emotional Intelligence Benchmark for Large Language Modelscited by 75
  20. 2025Distillation Scaling Lawscited by 59
  21. 2025PHYBench: Holistic Evaluation of Physical Perception and Reasoning in Large Language Modelscited by 57
  22. 2025Scalable-Softmax Is Superior for Attentioncited by 38
  23. 2025Distilled Pretraining: A modern lens of Data, In-Context Learning and Test-Time Scalingcited by 7

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 88.

88 papers.

Sort:

By area:

  1. 2026The Spike, the Sparse and the Sink: Anatomy of Massive Activations and Attention Sinkscited by 23
  2. 2026Capabilities Ain't All You Need: Measuring Propensities in AIcited by 6
  3. 2026EndoCoT: Scaling Endogenous Chain-of-Thought Reasoning in Diffusion Modelscited by 6
  4. 2026TERMINATOR: Learning Optimal Exit Points for Early Stopping in Chain-of-Thought Reasoningcited by 6
  5. 2026Causal Tracing of Audio-Text Fusion in Large Audio Language Modelscited by 4
  6. 2026CreativityBench: Evaluating Agent Creative Reasoning via Affordance-Based Tool Repurposingcited by 4
  7. 2026Skill Neologisms: Towards Skill-based Continual Learningcited by 4
  8. 2026Don't Trust Stubborn Neighbors: A Security Framework for Agentic Networkscited by 3
  9. 2026Reliable Chain-of-Thought via Prefix Consistencycited by 3
  10. 2026ThriftAttention: Selective Mixed Precision for Long-Context FP4 Attentioncited by 3
  11. 2026Extremely Sparse Supervision Incentivizes Reasoning Abilitycited by 3
  12. 2026UrduBench: An Urdu Reasoning Benchmark using Contextually Ensembled Translations with Human-in-the-Loopcited by 2
38 more
  1. 2026Enhancing Table Reasoning with Deterministic Table-State Rewardscited by 2
  2. 2026Balancing Faithfulness and Performance in Reasoning via Multi-Listener Soft Executioncited by 2
  3. 2026Classroom Final Exam: An Instructor-Tested Reasoning Benchmarkcited by 2
  4. 2026FDARxBench: Benchmarking Regulatory and Clinical Reasoning on FDA Generic Drug Assessmentcited by 2
  5. 2026MedSPOT: A Workflow-Aware Sequential Grounding Benchmark for Clinical GUIcited by 2
  6. 2026Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient Upcyclingcited by 2
  7. 2026DocScope: Benchmarking Verifiable Reasoning for Trustworthy Long-Document Understandingcited by 2
  8. 2026To Call or Not to Call: Diagnosing Intrinsic Over-Calling Bias in LLM Agentscited by 2
  9. 2026Deep Research as Rubric for Reinforcement Learningcited by 2
  10. 2026Compress-Distill: Reasoning Trace Compression for Efficient Knowledge Distillationcited by 2
  11. 2026Language Models Represent and Transform Concepts with Shared Geometrycited by 2
  12. 2026Beyond Holistic Scores: Automatic Trait-Based Quality Scoring of Argumentative Essayscited by 1
  13. 2026Beyond Words: Evaluating and Bridging Epistemic Divergence in User-Agent Interaction via Theory of Mindcited by 1
  14. 2026Directional Reasoning Trajectory Change (DRTC): Identifying Critical Trace Segments in Reasoning Modelscited by 1
  15. 2026DUCX: Decomposing Unfairness in Tool-Using Chest X-ray Agentscited by 1
  16. 2026Speaker Verification with Speech-Aware LLMs: Evaluation and Augmentationcited by 1
  17. 2026Reasoning over Video: Evaluating How MLLMs Extract, Integrate, and Reconstruct Spatiotemporal Evidencecited by 1
  18. 2026GeoHeight-Bench: Towards Height-Aware Multimodal Reasoning in Remote Sensingcited by 1
  19. 2026On Adaptivity in Zeroth-Order Optimizationcited by 1
  20. 2026Stateful Agent Backdoorcited by 1
  21. 2026Can RL Teach Long-Horizon Reasoning to LLMs? Expressiveness Is Keycited by 1
  22. 2026FiLM-Based Speaker Conditioning of a SpeechLLM for Pathological Speech Recognitioncited by 1
  23. 2026Shieldstralcited by 1
  24. 2026Visual Credit Audit for Multimodal Spatial Reasoningcited by 1
  25. 2026CORE: Collaborative Reasoning via Cross Teachingcited by 0
  26. 2026WorldCup Sampling for Multi-bit LLM Watermarkingcited by 0
  27. 2026Scaling-Aware Adapter for Structure-Grounded LLM Reasoningcited by 0
  28. 2026STATe-of-Thoughts: Structured Action Templates for Tree-of-Thoughtscited by 0
  29. 2026Cytoarchitecture in Words: Weakly Supervised Vision-Language Modeling for Human Brain Microscopycited by 0
  30. 2026QTrack: Query-Driven Reasoning for Multi-modal MOTcited by 0
  31. 2026MemBoost: A Memory-Boosted Framework for Cost-Aware LLM Inferencecited by 0
  32. 2026Dental-TriageBench: Benchmarking Multimodal Reasoning for Hierarchical Dental Triagecited by 0
  33. 2026Entropy Centroids as Intrinsic Rewards for Test-Time Scalingcited by 0
  34. 2026Math Education Digital Shadows for Investigating Learning with GenAI: Mathematics Performance, Anxiety, and Confidence in LLMscited by 0
  35. 2026Maistros: A Greek Large Language Model Adapted Through Knowledge Distillation From Large Reasoning Modelscited by 0
  36. 2026Post-Reasoning: Improving the Performance of Non-Thinking Models at No Costcited by 0
  37. 2026Mirror, Mirror on the Wall: Can VLM Agents Tell Who They Are at All?cited by 0
  38. 2026PRISM: A Geometric Risk Bound for Decomposing Drift into Scale, Shape, and Headcited by 0

50 most cited of 88 All 88 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025MiniCPM-V 4.5: Cooking Efficient MLLMs via Architecture, Data, and Training Recipe
  2. 2025Pretraining with hierarchical memories: separating long-tail and common knowledge
  3. 2026VibeThinker-3B: Exploring the Frontier of Verifiable Reasoning in Small Language Models
  4. 2025C3PO: Optimized Large Language Model Cascades with Probabilistic Cost Constraints for Reasoning
  5. 2023M3IT: A Large-Scale Dataset towards Multi-Modal Multilingual Instruction Tuning
  6. 2023Lifting the Curse of Capacity Gap in Distilling Language Models
  7. 2024MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies
  8. 2026Prompt Minimization: Reducing Input Redundancy Without Sacrificing Output Fidelity