Reasoning is a Modality
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
The Abstraction and Reasoning Corpus (ARC) provides a compact laboratory for studying abstract reasoning, an ability central to human intelligence. Modern AI systems, including LLMs and ViTs, largely operate as sequence-of-behavior prediction machines: they match observable behaviors by modeling token statistics without a persistent, readable mental state. This creates a gap with human-like behavior: humans can explain an action by decoding internal state, while AI systems can produce fluent post-hoc rationalizations that are not grounded in such a state. We hypothesize that reasoning is a modality: reasoning should exist as a distinct channel separate from the low-level workspace on which rules are applied. To test this hypothesis, on solving ARC tasks as a visual reasoning problem, we designed a novel role-separated transformer block that splits global controller tokens from grid workspace tokens, enabling iterative rule execution. Trained and evaluated within the VARC vision-centric protocol, our method achieved 62.6% accuracy on ARC-1, surpassing average human performance (60.2%) and outperforming prior methods significantly. Qualitatively, our models exhibit more coherent rule-application structure than the dense ViT baseline, consistent with a shift away from plausible probability blobs toward controller-driven reasoning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 10 of its 25 references that are in the map. First posted on arXiv 20 Jan 2026.
Builds on
10 of 25 references.
References · 10
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,386
- 2025Hierarchical Reasoning Modelcited by 177
- 2019On the Measure of Intelligencecited by 144
- 2024The Surprising Effectiveness of Test-Time Training for Few-Shot Learningcited by 96
- 2025Less is More: Recursive Reasoning with Tiny Networkscited by 45
- 2024Addressing the Abstraction and Reasoning Corpus via Procedural Example Generationcited by 33
- 2024H-ARC: A Robust Estimate of Human Performance on the Abstraction and Reasoning Corpus Benchmarkcited by 33
- 2025ARC Is a Vision Problem!cited by 24
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Do AI Models Perform Human-like Abstract Reasoning Across Modalities?
- 2023Abstract Visual Reasoning Enabled by Language
- 2026Exploring Human Behavior During Abstract Rule Inference and Problem Solving with the Cognitive Abstraction and Reasoning Corpus
- 2024Neural networks for abstraction and reasoning: Towards broad generalization in machines
- 2025ARCTraj: A Dataset and Benchmark of Human Reasoning Trajectories for Abstract Problem Solving
- 2025Your Reasoning Benchmark May Not Test Reasoning: Revealing Perception Bottleneck in Abstract Reasoning Benchmarks
- 2024Abductive Symbolic Solver on Abstraction and Reasoning Corpus
- 2026Compositional Neuro-Symbolic Reasoning