ATLAS: Agentic or Latent Visual Reasoning? One Word is Enough for Both
On the map: LLM reasoning → Multimodal reasoning
also in 1 more
Abstract (arXiv)
Visual reasoning, often interleaved with intermediate visual states, has emerged as a promising direction in the field. A straightforward approach is to directly generate images via unified models during reasoning, but this is computationally expensive and architecturally non-trivial. Recent alternatives include agentic reasoning through code or tool calls, and latent reasoning with learnable hidden embeddings. However, agentic methods incur context-switching latency from external execution, while latent methods lack task generalization and are difficult to train with autoregressive parallelization. To combine their strengths while mitigating their limitations, we propose ATLAS, a framework in which a single discrete 'word', termed as a functional token, serves both as an agentic operation and a latent visual reasoning unit. Each functional token is associated with an internalized visual operation, yet requires no visual supervision and remains a standard token in the tokenizer vocabulary, which can be generated via next-token prediction. This design avoids verbose intermediate visual content generation, while preserving compatibility with the vanilla scalable SFT and RL training, without architectural or methodological modifications. To further address the sparsity of functional tokens during RL, we introduce Latent-Anchored GRPO (LA-GRPO), which stabilizes the training by anchoring functional tokens with a statically weighted auxiliary objective, providing stronger gradient updates. Extensive experiments and analyses demonstrate that ATLAS achieves superior performance on challenging benchmarks while maintaining clear interpretability. We hope ATLAS offers a new paradigm inspiring future visual reasoning research.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 43 of its 45 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
43 of 45 references.
Closest ancestors · 18
Same direction, newest first
- 2025Monet: Reasoning in Latent Visual Space Beyond Images and Language26 Nov
- 2025Chain-of-Visual-Thought: Teaching VLMs to See and Think Better with Continuous Visual Tokens24 Nov
- 2025V-Thinker: Interactive Thinking with Images6 Nov
- 2025Latent Visual Reasoning29 Sep
- 2025Multi-Step Visual Reasoning with Visual Tokens Scaling and Verification8 Jun
- 2025MINT-CoT: Enabling Interleaved Visual Tokens in Mathematical Chain-of-Thought Reasoning5 Jun
- 2025Pixel Reasoner: Incentivizing Pixel-Space Reasoning with Curiosity-Driven Reinforcement Learning21 May
- 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learning20 May
- 2025SoTA with Less: MCTS-Guided Sample Selection for Data-Efficient Visual Reasoning Self-Improvement10 Apr
- 2025MM-Eureka: Exploring the Frontiers of Multimodal Reasoning with Rule-based Reinforcement Learning10 Mar
- 2025MME-CoT: Benchmarking Chain-of-Thought in Large Multimodal Models for Reasoning Quality, Robustness, and Efficiency13 Feb
- 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thought13 Jan
6 more
- 2024We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?1 Jul
- 2024Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models13 Jun
- 2024Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning25 Mar
- 2023ViperGPT: Visual Inference via Python Execution for Reasoning14 Mar
- 2023Multimodal Chain-of-Thought Reasoning in Language Models2 Feb
- 2022Visual Programming: Compositional visual reasoning without training18 Nov
Other references · 25
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 797
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 752
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 586
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
13 more
- 2023V*: Guided Visual Search as a Core Mechanism in Multimodal LLMscited by 482
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2025DanceGRPO: Unleashing GRPO on Visual Generationcited by 413
- 2024Quiet-STaR: Language Models Can Teach Themselves to Think Before Speakingcited by 301
- 2025LLaVA-OneVision-1.5: Fully Open Framework for Democratized Multimodal Trainingcited by 244
- 2023Cross-Entropy Loss Functions: Theoretical Analysis and Applicationscited by 210
- 2025Learning to Reason without External Rewardscited by 210
- 2024ANOLE: An Open, Autoregressive, Native Large Multimodal Models for Interleaved Image-Text Generationcited by 114
- 2025Unified Multimodal Understanding and Generation Models: Advances, Challenges, and Opportunitiescited by 85
- 2025Efficient Reasoning with Hidden Thinkingcited by 75
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 50
- 2025TUNA: Taming Unified Visual Representations for Native Unified Multimodal Modelscited by 34
- 2023Dual-Balancing for Multi-Task Learningcited by 27
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Diagnosing Visual Reasoning: Challenges, Insights, and a Path Forward
- 2026Beacon: Knowing When and How to Perform Agentic Visual Reasoning
- 2026Rethinking Latent Visual Reasoning: Grounding Latent Reasoning in Visual Evidence
- 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoning
- 2025Visual Agentic AI for Spatial Reasoning with a Dynamic API
- 2025TIR-Bench: A Comprehensive Benchmark for Agentic Thinking-with-Images Reasoning
- 2026SLVR: Structured Latent Visual Reasoning via Human-like Reasoning Flows
- 2026Leveraging Latent Visual Reasoning in Silence