mlsanityData to 14 Oct 2026

Intuition vectors

arXiv 2609.32619 ↗First posted 26 Sep 2026cs.LG cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Large self-supervised vision models learn representations that support scene segmentation and the semantic decomposition of physical objects. We ask whether their representational geometry supports transfer to visual reasoning problems without any task-specific fine-tuning. We hypothesized that relational representations may bridge perception and abstract reasoning by encoding similarities and transformations among visual inputs such that an intuitive, implicit form of reasoning may be performed via latent vector arithmetic. Specifically, we examine DINOv3, MAE, and random pixel projections on abstract and naturalistic Bongard problems, ARC-AGI-1 and ARC-AGI-2, and novel ARC-GEN instances. On both Bongard benchmarks, the accuracy of a simple nearest-centroid readout of frozen visual embeddings is within four percentage points of the task-specific baselines reported with the original benchmarks. In ARC, latent difference vectors summarizing demonstration input-output transformations, which we refer to as intuition vectors, show greater alignment with test vectors from the same task, whereas those from unrelated tasks are near orthogonal. This latent geometry is operational: transporting a query along its intuition vector consistently improves exact-output retrieval, reaching 70.7 on ARC-AGI-2 evaluation. Across 397,000 ARC-GEN instances from 794 tasks, single-pair intuition vectors identify the generating task with approximately 87% leave-one-out accuracy. These findings suggest that latent vector arithmetic over frozen visual representations supports implicit rule inference across varied problem domains without a generative model component, indicating that inferring an abstract transformation and generating its instance-specific consequence may be separable capacities.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 37 references that are in the map. First posted on arXiv 26 Sep 2026.

Builds on

26 of 37 references.

References · 26

  1. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  2. 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
  3. 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
  4. 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
  5. 2019Designing and Interpreting Probes with Control Taskscited by 640
  6. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
  7. 2025Diffusion Transformers with Representation Autoencoderscited by 295
  8. 2024Not All Language Model Features Are One-Dimensionally Linearcited by 212
  9. 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 190
  10. 2025Hierarchical Reasoning Modelcited by 177
  11. 2024The Geometry of Categorical and Hierarchical Concepts in Large Language Modelscited by 159
  12. 2024Evaluating the World Model Implicit in a Generative Modelcited by 113
14 more
  1. 2024The Surprising Effectiveness of Test-Time Training for Few-Shot Learningcited by 96
  2. 2020Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoningcited by 63
  3. 2023Discovering Interpretable Directions in the Semantic Latent Space of Diffusion Modelscited by 60
  4. 2026Revisiting the Platonic Representation Hypothesis: An Aristotelian Viewcited by 44
  5. 2025Into the Rabbit Hull: From Task-Relevant Concepts in DINO to Minkowski Geometrycited by 34
  6. 2025ARC Is a Vision Problem!cited by 24
  7. 2024Searching Latent Program Spacescited by 20
  8. 2023Bongard-OpenWorld: Few-Shot Reasoning for Free-form Visual Concepts in the Real Worldcited by 18
  9. 2025Product of Experts with LLMs: Boosting Performance on ARC Is a Matter of Perspectivecited by 17
  10. 2024Beyond the Doors of Perception: Vision Transformers Represent Relations Between Objectscited by 13
  11. 2025Adapting Self-Supervised Representations as a Latent Space for Efficient Generationcited by 13
  12. 2025ARC-GEN: A Mimetic Procedural Benchmark Generator for the Abstraction and Reasoning Corpuscited by 10
  13. 2023Support-Set Context Matters for Bongard Problemscited by 3
  14. 2025Unraveling the geometry of visual relational reasoningcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Tackling the Abstraction and Reasoning Corpus with Vision Transformers: the Importance of 2D Representation, Positions, and Objects
  2. 2026DeepLatent: Think with Images via Parallel Latent Visual Reasoning
  3. 2023The role of object-centric representations, guided attention, and external memory on generalizing visual relations
  4. 2022Towards Unsupervised Visual Reasoning: Do Off-The-Shelf Features Know How to Reason?
  5. 2026MoLE: Mixture of Latent Experts for Complementary Visual Reasoning
  6. 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning
  7. 2025Oh-A-DINO: Understanding and Enhancing Attribute-Level Information in Self-Supervised Object-Centric Representations
  8. 2022Zero-shot visual reasoning through probabilistic analogical mapping