mlsanityData to 13 Oct 2026

Resolving State-Representation Mismatch: State-Space Visual Reasoning for Open-Loop VLA Planning

arXiv 2609.33412 ↗First posted 27 Sep 2026cs.CV cs.AIcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

also in 1 more
Abstract (arXiv)

Despite rapid progress in vision-language-action (VLA) models, existing reasoning paradigms still face a fundamental state-representation mismatch in open-loop planning. Given only an initial observation, models must internally simulate action-conditioned state transitions, whereas text-, pixel-, and latent-space reasoning can suffer from lossy spatial compression, error-accumulating visual generation, and bypass of intermediate latent tokens, respectively, undermining reliable long-horizon planning. We propose State-Space Visual Reasoning (SSVR), which decouples static visual context, language constraints, and a recurrent latent state. SSVR encodes the initial image and instruction once, then conditions each action prediction on the latent state and updates it with an action-conditioned GRU. Using Qwen2.5-VL as the backbone, SSVR achieves 99.5/99.6, 96.3/98.0, and 83.9/90.6 EM/PR on FrozenLake, Maze, and MiniBehavior, substantially outperforming prior methods. Extensive experiments support the effectiveness of recurrent state modeling for VLA open-loop planning across input transformations and transfer settings. By reusing static visual-textual context and updating a compact recurrent state, SSVR supports efficient multi-step inference, achieving up to 98.58× faster Maze decoding rollouts than the evaluated baselines with the prefix cache prebuilt.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 26 of its 38 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

26 of 38 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning15 Mar
  2. 2024VSP: Assessing the dual challenges of perception and reasoning in spatial planning tasks for VLMs2 Jul
  3. 2024Mind's Eye of LLMs: Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models4 Apr

Other references · 23

  1. 2025Qwen2.5-VL Technical Reportcited by 5,499
  2. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,363
  3. 2025DeepEyes: Incentivizing "Thinking with Images" via Reinforcement Learningcited by 402
  4. 2025Imagine while Reasoning in Space: Multimodal Visualization-of-Thoughtcited by 205
  5. 2023Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planningcited by 161
  6. 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokenscited by 122
  7. 2025DeepEyesV2: Toward Agentic Multimodal Modelcited by 120
  8. 2025Latent Visual Reasoningcited by 101
  9. 2025Monet: Reasoning in Latent Visual Space Beyond Images and Languagecited by 78
  10. 2025Thinking with Generated Imagescited by 72
  11. 2024Perception Tokens Enhance Visual Reasoning in Multimodal Language Modelscited by 69
  12. 2026Zooming without Zooming: Region-to-Image Distillation for Fine-Grained Multimodal Perceptioncited by 48
11 more
  1. 2026The Latent Space: Foundation, Evolution, Mechanism, Ability, and Outlookcited by 41
  2. 2023A Configurable Library for Generating and Manipulating Maze Datasetscited by 31
  3. 2025Reasoning Within the Mind: Dynamic Multimodal Interleaving in Latent Spacecited by 27
  4. 2025How Visual Representations Map to Language Feature Space in Multimodal LLMscited by 24
  5. 2023Mini-BEHAVIOR: A Procedurally Generated Benchmark for Long-horizon Decision-Making in Embodied AIcited by 23
  6. 2025Thinking with Visual Abstract: Enhancing Multimodal Reasoning via Visual Abstractioncited by 15
  7. 2025PureKV: Plug-and-Play KV Cache Optimization with Spatial-Temporal Sparse Attention for Vision-Language Large Modelscited by 6
  8. 2026Retrieve, Integrate, and Synthesize: Spatial-Semantic Grounded Latent Visual Reasoningcited by 6
  9. 2025Simulation to Rules: A Dual-VLM Framework for Formal Visual Planningcited by 4
  10. 2026Fill the GAP: A Granular Alignment Paradigm for Visual Reasoning in Multimodal Large Language Modelscited by 4
  11. 2026ASCII Art Turns LLMs into VLA Controllerscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Explicit Language Memory for Long-Horizon Planning in Vision-Language-Action Models
  2. 2026VisualThink-VLA: Visual Intermediate Reasoning for Effective and Low-Latency Vision-Language-Action Policies
  3. 2025Visual Planning: Let's Think Only with Images
  4. 2026Learning Visual Spatial Planning from Symbolic State via Modality-Gap-Aware Self-Distillation
  5. 2026Unlocking Complex Visual Generation via Closed-Loop Verified Reasoning
  6. 2025Using VLM Reasoning to Constrain Task and Motion Planning
  7. 2026PearlVLA: Progressive Embodied Action-Plan Refinement in Latent Space
  8. 2026DriveMA: Rethinking Language Interfaces in Driving VLAs with One-Step Meta-Actions