Think Visually, Reason Textually: Vision-Language Synergy in ARC
Not on the map. Why?
Abstract (arXiv)
Abstract reasoning from minimal examples remains a core unsolved problem for frontier foundation models such as GPT-5 and Grok 4. These models still fail to infer structured transformation rules from a handful of examples, which is a key hallmark of human intelligence. The Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI) provides a rigorous testbed for this capability, demanding conceptual rule induction and transfer to novel tasks. Most existing methods treat ARC-AGI as a purely textual reasoning task, overlooking the fact that humans rely heavily on visual abstraction when solving such puzzles. However, our pilot experiments reveal a paradox: naively rendering ARC-AGI grids as images degrades performance due to imprecise rule execution. This leads to our central hypothesis that vision and language possess complementary strengths across distinct reasoning stages: vision supports global pattern abstraction and verification, whereas language specializes in symbolic rule formulation and precise execution. Building on this insight, we introduce two synergistic strategies: (1) Vision-Language Synergy Reasoning (VLSR), which decomposes ARC-AGI into modality-aligned subtasks; and (2) Modality-Switch Self-Correction (MSSC), which leverages vision to verify text-based reasoning for intrinsic error correction. Extensive experiments demonstrate that our approach yields up to a 4.33% improvement over text-only baselines across diverse flagship models and multiple ARC-AGI tasks. Our findings suggest that unifying visual abstraction with linguistic reasoning is a crucial step toward achieving generalizable, human-like intelligence in future foundation models. Source code is released at https://github.com/InternLM/ARC-VL.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 27 of its 37 references that are in the map. First posted on arXiv 19 Nov 2025.
Builds on
27 of 37 references.
References · 27
- 2025Qwen3 Technical Reportcited by 8,820
- 2024GPT-4o System Cardcited by 4,588
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
- 2025TTRL: Test-Time Reinforcement Learningcited by 275
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 268
- 2025Hierarchical Reasoning Modelcited by 177
- 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 163
- 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 136
- 2023Hypothesis Search: Inductive Reasoning with Language Modelscited by 120
- 2023The ConceptARC Benchmark: Evaluating Understanding and Generalization in the ARC Domaincited by 101
- 2023Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinementcited by 89
15 more
- 2025Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzlescited by 56
- 2024Combining Induction and Transduction for Abstract Reasoningcited by 53
- 2024Understanding the Dark Side of LLMs' Intrinsic Self-Correctioncited by 42
- 2025Self-Improving Language Models for Evolutionary Program Synthesis: A Case Study on ARC-AGIcited by 36
- 2024Addressing the Abstraction and Reasoning Corpus via Procedural Example Generationcited by 33
- 2024H-ARC: A Robust Estimate of Human Performance on the Abstraction and Reasoning Corpus Benchmarkcited by 33
- 2025ArcMemo: Abstract Reasoning Composition with Lifelong LLM Memorycited by 24
- 2024CodeIt: Self-Improving Language Models with Prioritized Hindsight Replaycited by 23
- 2024Searching Latent Program Spacescited by 20
- 2025Product of Experts with LLMs: Boosting Performance on ARC Is a Matter of Perspectivecited by 17
- 2023Unraveling the ARC Puzzle: Mimicking Human Solutions with Object-Centric Decision Transformercited by 12
- 2025Neural Cellular Automata for ARC-AGIcited by 10
- 2025ARC-GEN: A Mimetic Procedural Benchmark Generator for the Abstraction and Reasoning Corpuscited by 10
- 2024ConceptSearch: Towards Efficient Program Search Using LLMs for Abstraction and Reasoning Corpus (ARC)cited by 8
- 2024ARCLE: The Abstraction and Reasoning Corpus Learning Environment for Reinforcement Learningcited by 7
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Visual Self-Refine: A Pixel-Guided Paradigm for Accurate Chart Parsingcited by 5
- 2026Reasoning or Pattern Matching? Probing Large Vision-Language Models with Visual Puzzlescited by 2
- 2026Language-Guided Abstraction for Visual Reasoningcited by 0
- 2026Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Gamescited by 0
- 2026PoTRE: Test-Time Reasoning inspired by Cognitive Heterogeneitycited by 0
- 2026GuideGround: VLM-guided Semantic Understanding and Viewpoint-aware Reasoning for 3D Visual Groundingcited by 0
- 2026GuideGround: VLM-guided Semantic Understanding and Viewpoint-aware Reasoning for 3D Visual Grounding1 Aug 2026
- 2026PoTRE: Test-Time Reasoning inspired by Cognitive Heterogeneity22 Jul 2026
- 2026Beyond the Current Observation: Evaluating Multimodal Large Language Models in Controllable Non-Markov Games17 Jun 2026
- 2026Language-Guided Abstraction for Visual Reasoning11 Jun 2026
- 2026Visual Self-Refine: A Pixel-Guided Paradigm for Accurate Chart Parsing18 Feb 2026
- 2026Reasoning or Pattern Matching? Probing Large Vision-Language Models with Visual Puzzles20 Jan 2026