Reasoning in machine vision by learning fast and slow thinking
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Reasoning is a hallmark of human intelligence, enabling adaptive decision-making in complex unfamiliar scenarios. In contrast, machine intelligence remains bound to training data, unable to dynamically refine solutions at inference. While recent advances have explored machine reasoning - trading inference-time compute for improved performance - they focus on verbal domains such as mathematical problem-solving where explicit rules govern step-by-step solution generation. Many tasks lack sufficient labelled data and require alternative performance improvement mechanisms, such as inference-time compute. Here we present a paradigm for machine reasoning in vision, enabling performance improvements with increasing thinking time (inference-time compute), even with limited labelled data. Our approach is inspired by dual-process theories of human cognition, integrating a fast-thinking System I module for generating and verifying solutions in familiar tasks, with a slow-thinking System II module that iteratively refines predictions using self-play reinforcement learning, even when task-specific data is limited. This paradigm involves proposing, competing over, and refining solutions until convergence. We demonstrate that extended inference-time compute yields superior performance compared to large-scale supervised learning, foundation models, and human experts in vision tasks. These include computer-vision benchmarks and cancer localisation across five organs, highlighting the potential of inference-time compute for data-scarce problems.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 25 of its 114 references that are in the map. First posted on arXiv 27 Jun 2025.
Builds on
25 of 114 references.
References · 25
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
- 2023Let's Verify Step by Stepcited by 3,789
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2018On First-Order Meta-Learning Algorithmscited by 1,018
- 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 928
- 2022Solving math word problems with process- and outcome-based feedbackcited by 901
- 2024Training Language Models to Self-Correct via Reinforcement Learningcited by 426
- 2023Alphazero-like Tree-Search can Guide Large Language Model Decoding and Trainingcited by 295
- 2024V-STaR: Training Verifiers for Self-Taught Reasonerscited by 217
- 2024DeepSeek-Prover-V1.5: Harnessing Proof Assistant Feedback for Reinforcement Learning and Monte-Carlo Tree Searchcited by 197
13 more
- 2025Hierarchical Reasoning Modelcited by 177
- 2019The KiTS19 Challenge Data: 300 Kidney Tumor Cases with Clinical Context, CT Semantic Segmentations, and Surgical Outcomescited by 172
- 2025Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scalingcited by 136
- 2023System 2 Attention (is something you might need too)cited by 89
- 2015Massively Parallel Methods for Deep Reinforcement Learningcited by 82
- 2024Dualformer: Controllable Fast and Slow Thinking by Learning with Randomized Reasoning Tracescited by 43
- 2025MM-IQ: Benchmarking Human-Like Abstraction and Reasoning in Multimodal Modelscited by 29
- 2022Image quality assessment by overlapping task-specific and task-agnostic measures: application to prostate multiparametric MR images for cancer segmentationcited by 8
- 2022Towards Sustainable Self-supervised Learningcited by 8
- 2021Learning to ignore: rethinking attention in CNNscited by 6
- 2024Weakly supervised localisation of prostate cancer using reinforcement learning for bi-parametric MR imagescited by 4
- 2023Fast and Slow Planningcited by 3
- 2024Biochemical Prostate Cancer Recurrence Prediction: Thinking Fast & Slowcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Active few-shot segmentation by reinforcing data selection24 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2024Visual Agents as Fast and Slow Thinkers
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning
- 2025A Survey of Slow Thinking-based Reasoning LLMs using Reinforced Learning and Inference-time Scaling Law
- 2025Limits and Gains of Test-Time Scaling in Vision-Language Reasoning
- 2022GAMR: A Guided Attention Model for (visual) Reasoning
- 2025Reasoning in Computer Vision: Taxonomy, Models, Tasks, and Methodologies
- 2025Unveiling Chain of Step Reasoning for Vision-Language Models with Fine-grained Rewards
- 2025Controlling Thinking Speed in Reasoning Models