mlsanityData to 14 Oct 2026

Think Visually, Reason Textually: Vision-Language Synergy in ARC

arXiv 2511.15703 ↗First posted 19 Nov 2025cs.CV cs.AI cs.CLcited by 6

Not on the map. Why?

Abstract (arXiv)

Abstract reasoning from minimal examples remains a core unsolved problem for frontier foundation models such as GPT-5 and Grok 4. These models still fail to infer structured transformation rules from a handful of examples, which is a key hallmark of human intelligence. The Abstraction and Reasoning Corpus for Artificial General Intelligence (ARC-AGI) provides a rigorous testbed for this capability, demanding conceptual rule induction and transfer to novel tasks. Most existing methods treat ARC-AGI as a purely textual reasoning task, overlooking the fact that humans rely heavily on visual abstraction when solving such puzzles. However, our pilot experiments reveal a paradox: naively rendering ARC-AGI grids as images degrades performance due to imprecise rule execution. This leads to our central hypothesis that vision and language possess complementary strengths across distinct reasoning stages: vision supports global pattern abstraction and verification, whereas language specializes in symbolic rule formulation and precise execution. Building on this insight, we introduce two synergistic strategies: (1) Vision-Language Synergy Reasoning (VLSR), which decomposes ARC-AGI into modality-aligned subtasks; and (2) Modality-Switch Self-Correction (MSSC), which leverages vision to verify text-based reasoning for intrinsic error correction. Extensive experiments demonstrate that our approach yields up to a 4.33% improvement over text-only baselines across diverse flagship models and multiple ARC-AGI tasks. Our findings suggest that unifying visual abstraction with linguistic reasoning is a crucial step toward achieving generalizable, human-like intelligence in future foundation models. Source code is released at https://github.com/InternLM/ARC-VL.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 27 of its 37 references that are in the map. First posted on arXiv 19 Nov 2025.

Builds on

27 of 37 references.

References · 27

  1. 2025Qwen3 Technical Reportcited by 8,820
  2. 2024GPT-4o System Cardcited by 4,588
  3. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  4. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
  5. 2025TTRL: Test-Time Reinforcement Learningcited by 275
  6. 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Modelscited by 268
  7. 2025Hierarchical Reasoning Modelcited by 177
  8. 2025Dynamic Cheatsheet: Test-Time Learning with Adaptive Memorycited by 163
  9. 2025Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawingcited by 136
  10. 2023Hypothesis Search: Inductive Reasoning with Language Modelscited by 120
  11. 2023The ConceptARC Benchmark: Evaluating Understanding and Generalization in the ARC Domaincited by 101
  12. 2023Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinementcited by 89
15 more
  1. 2025Enigmata: Scaling Logical Reasoning in Large Language Models with Synthetic Verifiable Puzzlescited by 56
  2. 2024Combining Induction and Transduction for Abstract Reasoningcited by 53
  3. 2024Understanding the Dark Side of LLMs' Intrinsic Self-Correctioncited by 42
  4. 2025Self-Improving Language Models for Evolutionary Program Synthesis: A Case Study on ARC-AGIcited by 36
  5. 2024Addressing the Abstraction and Reasoning Corpus via Procedural Example Generationcited by 33
  6. 2024H-ARC: A Robust Estimate of Human Performance on the Abstraction and Reasoning Corpus Benchmarkcited by 33
  7. 2025ArcMemo: Abstract Reasoning Composition with Lifelong LLM Memorycited by 24
  8. 2024CodeIt: Self-Improving Language Models with Prioritized Hindsight Replaycited by 23
  9. 2024Searching Latent Program Spacescited by 20
  10. 2025Product of Experts with LLMs: Boosting Performance on ARC Is a Matter of Perspectivecited by 17
  11. 2023Unraveling the ARC Puzzle: Mimicking Human Solutions with Object-Centric Decision Transformercited by 12
  12. 2025Neural Cellular Automata for ARC-AGIcited by 10
  13. 2025ARC-GEN: A Mimetic Procedural Benchmark Generator for the Abstraction and Reasoning Corpuscited by 10
  14. 2024ConceptSearch: Towards Efficient Program Search Using LLMs for Abstraction and Reasoning Corpus (ARC)cited by 8
  15. 2024ARCLE: The Abstraction and Reasoning Corpus Learning Environment for Reinforcement Learningcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.