mlsanityData to 7 Oct 2026

VISTA: A Visual Harness for Reasoning in an Interactive World

arXiv 2610.02200 ↗First posted 1 Oct 2026cs.AI cs.CVcited by 0

On the map: LLM reasoning → Multimodal reasoning also fits: Spatial and embodied reasoning

Abstract (arXiv)

We show that multimodal models possess strong reasoning abilities and that an appropriate harness can unlock their potential to solve tasks across diverse interactive environments. We introduce VISTA, a visual harness that gives a general-purpose multimodal model long-horizon vision. VISTA allows the model to directly perceive the environment through visual observations and maintains a lossless visual memory that preserves past observations in their original form. The model can actively retrieve these observations and reorganize its visual input as it reasons. On ARC-AGI-3, VISTA improves Claude Opus 5.0's Relative Human Action Efficiency score from 40.68 to a perfect 100.00, with the model completing all 25 public games using 57.4% fewer actions than first-time human participants. VISTA's simple design also allows it to extend naturally to diverse visual environments with minimal adaptation. Across three additional benchmarks covering a diverse range of visual games and puzzles, it substantially outperforms baselines using the same underlying model with minimal harnesses. Our results highlight VISTA's potential as a general-purpose visual harness for advancing multimodal agents in complex visual environments.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 45 of its 60 references that are in the map. First posted on arXiv 1 Oct 2026.

Builds on

45 of 60 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026BabyVision: Visual Reasoning Beyond Language10 Jan
  2. 2025Thinking with Images for Multimodal Reasoning: Foundations, Methods, and Future Frontiers30 Jun
  3. 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
  4. 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systems17 May
  5. 2025Product of Experts with LLMs: Boosting Performance on ARC Is a Matter of Perspective8 May
  6. 2024Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction5 Dec
  7. 2024Combining Induction and Transduction for Abstract Reasoning4 Nov

Other references · 38

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  3. 2023Visual Instruction Tuningcited by 7,792
  4. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  5. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  6. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  7. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  8. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  9. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  10. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,722
  11. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,628
  12. 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
26 more
  1. 2023MemGPT: Towards LLMs as Operating Systemscited by 1,295
  2. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,210
  3. 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
  4. 2025UI-TARS: Pioneering Automated GUI Interaction with Native Agentscited by 584
  5. 2024SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agentscited by 553
  6. 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 459
  7. 2023JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Modelscited by 170
  8. 2025Hierarchical Reasoning Modelcited by 167
  9. 2025OpenCUA: Open Foundations for Computer-Use Agentscited by 151
  10. 2024Cradle: Empowering Foundation Agents Towards General Computer Controlcited by 114
  11. 2024The Surprising Effectiveness of Test-Time Training for Few-Shot Learningcited by 88
  12. 2024Scaling Instructable Agents Across Many Simulated Worldscited by 67
  13. 2024H-ARC: A Robust Estimate of Human Performance on the Abstraction and Reasoning Corpus Benchmarkcited by 32
  14. 2026ARC-AGI-3: A New Challenge for Frontier Agentic Intelligencecited by 29
  15. 2025Game-TARS: Pretrained Foundation Models for Scalable Generalist Multimodal Game Agentscited by 23
  16. 2025ARC Is a Vision Problem!cited by 23
  17. 2026GameWorld: Towards Standardized and Verifiable Evaluation of Multimodal Game Agentscited by 22
  18. 2026Executable World Models for ARC-AGI-3 in the Era of Coding Agentscited by 12
  19. 2026AI Gamestore: Scalable, Open-Ended Evaluation of Machine General Intelligence with Human Gamescited by 10
  20. 2026OpenForgeRL: Train Harness-native Agents in Any Environmentcited by 7
  21. 2026What Memory Do GUI Agents Really Need? From Passive Records to Active Task-Driving Statescited by 5
  22. 2026Tycho: Active Abstraction with Programmatic World Models for ARC-AGI-3cited by 5
  23. 2026Qwen-CUA: Native Computer Use for (almost) Everythingcited by 5
  24. 2026ARC Prize 2025: Technical Reportcited by 4
  25. 2026Do Coding Agents Need Executable World Models, Simplification, and Verification to Solve ARC-AGI-3?cited by 3
  26. 2026Screenshots or Tools? Eliciting Tool Use and Managing Multimodal Context in Hybrid GUI-MCP Computer-Use Agentscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025V-Thinker: Interactive Thinking with Images
  2. 2025EscapeCraft: A 3D Room Escape Environment for Benchmarking Complex Multimodal Reasoning Ability
  3. 2026VisGym: Diverse, Customizable, Scalable Environments for Multimodal Agents
  4. 2025V-MAGE: A Game Evaluation Framework for Assessing Vision-Centric Capabilities in Multimodal Large Language Models
  5. 2024ING-VP: MLLMs cannot Play Easy Vision-based Games Yet
  6. 2025SPHINX: A Synthetic Environment for Visual Perception and Reasoning
  7. 2026MMSkills: Towards Multimodal Skills for General Visual Agents
  8. 2025PhysVLM-AVR: Active Visual Reasoning for Multimodal Large Language Models in Physical Environments