LaST0: Latent Spatio-Temporal Chain-of-Thought for Robotic Vision-Language-Action Model
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
Vision-Language-Action (VLA) models have recently shown strong generalization, with some approaches seeking to explicitly generate linguistic reasoning traces or predict future observations prior to execution. However, explicit reasoning typically incurs non-negligible inference latency, which constrains the temporal resolution required for robotic manipulation. Moreover, such reasoning is confined to the linguistic space, imposing a representational bottleneck that struggles to faithfully capture ineffable physical attributes. To mitigate these limitations, we propose LaST0, a framework that enables efficient reasoning before acting through a Latent Spatio-Temporal Chain-of-Thought (CoT), capturing fine-grained physical and robotic dynamics that are often difficult to verbalize. Specifically, we introduce a token-efficient latent CoT space that models future visual dynamics, 3D structural information, and robot proprioceptive states, and further extends these representations across time to enable temporally consistent implicit reasoning trajectories. Furthermore, LaST0 adopts a dual-system architecture implemented via a Mixture-of-Transformers design, where a reasoning expert conducts low-frequency latent inference and an acting expert generates high-frequency actions conditioned on robotics-oriented latent representations. To facilitate coordination, LaST0 is trained with heterogeneous operation frequencies, enabling adaptive switching during deployment. Across 10 real-world tasks spanning tabletop, mobile, and dexterous hand manipulation, LaST0 improves mean success rates by 13%, 14% and 14% over prior SOTA VLA methods, respectively.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 44 of its 83 references that are in the map. First posted on arXiv 8 Jan 2026.
Builds on
44 of 83 references.
Closest ancestors · 5
Same direction, newest first
- 2025ManualVLA: A Unified VLA Model for Chain-of-Thought Manual Generation and Robotic Manipulation1 Dec
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning22 Jul
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation24 Dec
Other references · 39
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
27 more
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 730
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 313
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 231
- 2024From Explicit CoT to Implicit CoT: Learning to Internalize CoT Step by Stepcited by 225
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 180
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 176
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
- 2025Unified Vision-Language-Action Modelcited by 128
- 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokenscited by 120
- 2025AdaWorld: Learning Adaptable World Models with Latent Actionscited by 108
- 2025OneTwoVLA: A Unified Vision-Language-Action Model with Adaptive Reasoningcited by 105
- 2022From Play to Policy: Conditional Behavior Generation from Uncurated Robot Datacited by 103
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
- 2025Monet: Reasoning in Latent Visual Space Beyond Images and Languagecited by 75
- 2025Reasoning Beyond Language: A Comprehensive Survey on Latent Chain-of-Thought Reasoningcited by 72
- 2024Diffusion-VLA: Generalizable and Interpretable Robot Foundation Model via Self-Generated Reasoningcited by 57
- 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Modelscited by 38
- 2025RoboMIND 2.0: A Multimodal, Bimanual Mobile Manipulation Dataset for Generalizable Embodied Intelligencecited by 31
- 2025MLA: A Multisensory Language-Action Model for Multimodal Understanding and Forecasting in Robotic Manipulationcited by 22
- 2025Latent Implicit Visual Reasoningcited by 16
- 2025Latent Chain-of-Thought World Modeling for End-to-End Drivingcited by 14
Built on by
Citing papers per year: 2026: 28.
28 papers.
Sort:
By area:
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videoscited by 68
- 2026WALL-WM: Carving World Action Modeling at the Event Jointscited by 14
- 2026WAM4D: Fast 4D World Action Model via Spatial Register Tokenscited by 12
- 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Modelscited by 10
- 2026T-Rex: Tactile-Reactive Dexterous Manipulationcited by 10
- 2026LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoningcited by 7
- 2026TwinRL: Digital Twin-Driven Reinforcement Learning for Real-World Robotic Manipulationcited by 5
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulationcited by 4
- 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Modelscited by 4
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Modelscited by 3
16 more
- 2026Continuous Reasoning for Vision-Language-Actioncited by 2
- 2026Self-Improving VLA Policies: Selected Diffusion Noise for Spurious-Robust Action Smoothingcited by 1
- 2026ThinkingVLA: Interleaved Vision and Language Reasoning for Robotic Manipulationcited by 1
- 2026SA-VLA: State-aware tokenizer for improving Vision-Language-Action Models' performancecited by 1
- 2026Lift3D-VLA: Lifting VLA Models to 3D Geometry and Dynamics-Aware Manipulationcited by 1
- 2026CapVector: Learning Transferable Capability Vectors in Parametric Space for Vision-Language-Action Modelscited by 0
- 2026MoASE++: Mixture of Activation Sparsity Experts with Domain-Adaptive On-policy Distillation for Continual Test Time Adaptationcited by 0
- 2026DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners?cited by 0
- 2026VideoLatent: Video-Language Learning via Latent Self-Forcingcited by 0
- 2026PonderPounce: A Pretrained MLLM as an Episode Context Engine for Robot Controlcited by 0
- 2026DeCAL: Towards Physically-Grounded Dexterous Vision-Language-Action Models via Contact-Aware Latent Co-Imaginationcited by 0
- 2026Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoningcited by 0
- 2026SCULPT-VLA: Learning Structured Control through Staged Action Groundingcited by 0
- 2026X-Planner: Event-Structured Task Planning for Embodied Intelligencecited by 0
- 2026Token-World: World Modeling in Vision-Language Model Token Space for Robot Manipulationcited by 0
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injectioncited by 0
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection1 Oct 2026
- 2026Token-World: World Modeling in Vision-Language Model Token Space for Robot Manipulation30 Sep 2026
- 2026X-Planner: Event-Structured Task Planning for Embodied Intelligence21 Sep 2026
- 2026SCULPT-VLA: Learning Structured Control through Staged Action Grounding20 Sep 2026
- 2026Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoning17 Sep 2026
- 2026DeCAL: Towards Physically-Grounded Dexterous Vision-Language-Action Models via Contact-Aware Latent Co-Imagination8 Sep 2026
- 2026PonderPounce: A Pretrained MLLM as an Episode Context Engine for Robot Control25 Aug 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026Lift3D-VLA: Lifting VLA Models to 3D Geometry and Dynamics-Aware Manipulation7 Jul 2026
- 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Models30 Jun 2026
- 2026SA-VLA: State-aware tokenizer for improving Vision-Language-Action Models' performance29 Jun 2026
- 2026VideoLatent: Video-Language Learning via Latent Self-Forcing22 Jun 2026
16 more
- 2026ThinkingVLA: Interleaved Vision and Language Reasoning for Robotic Manipulation16 Jun 2026
- 2026T-Rex: Tactile-Reactive Dexterous Manipulation15 Jun 2026
- 2026Self-Improving VLA Policies: Selected Diffusion Noise for Spurious-Robust Action Smoothing12 Jun 2026
- 2026WAM4D: Fast 4D World Action Model via Spatial Register Tokens12 Jun 2026
- 2026DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners?10 Jun 2026
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation2 Jun 2026
- 2026WALL-WM: Carving World Action Modeling at the Event Joints1 Jun 2026
- 2026Continuous Reasoning for Vision-Language-Action29 May 2026
- 2026MoASE++: Mixture of Activation Sparsity Experts with Domain-Adaptive On-policy Distillation for Continual Test Time Adaptation18 May 2026
- 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models11 May 2026
- 2026CapVector: Learning Transferable Capability Vectors in Parametric Space for Vision-Language-Action Models11 May 2026
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos30 Apr 2026
- 2026LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoning30 Apr 2026
- 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models16 Mar 2026
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb 2026
- 2026TwinRL: Digital Twin-Driven Reinforcement Learning for Real-World Robotic Manipulation9 Feb 2026
- 2026T-Rex: Tactile-Reactive Dexterous Manipulationcited by 10
- 2026TwinRL: Digital Twin-Driven Reinforcement Learning for Real-World Robotic Manipulationcited by 5
- 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Modelscited by 4
- 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Modelscited by 3
- 2026Self-Improving VLA Policies: Selected Diffusion Noise for Spurious-Robust Action Smoothingcited by 1
- 2026ThinkingVLA: Interleaved Vision and Language Reasoning for Robotic Manipulationcited by 1
- 2026SA-VLA: State-aware tokenizer for improving Vision-Language-Action Models' performancecited by 1
- 2026Lift3D-VLA: Lifting VLA Models to 3D Geometry and Dynamics-Aware Manipulationcited by 1
- 2026CapVector: Learning Transferable Capability Vectors in Parametric Space for Vision-Language-Action Modelscited by 0
- 2026SCULPT-VLA: Learning Structured Control through Staged Action Groundingcited by 0
- 2026X-Planner: Event-Structured Task Planning for Embodied Intelligencecited by 0
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injectioncited by 0
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection1 Oct 2026
- 2026X-Planner: Event-Structured Task Planning for Embodied Intelligence21 Sep 2026
- 2026SCULPT-VLA: Learning Structured Control through Staged Action Grounding20 Sep 2026
- 2026Lift3D-VLA: Lifting VLA Models to 3D Geometry and Dynamics-Aware Manipulation7 Jul 2026
- 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Models30 Jun 2026
- 2026SA-VLA: State-aware tokenizer for improving Vision-Language-Action Models' performance29 Jun 2026
- 2026ThinkingVLA: Interleaved Vision and Language Reasoning for Robotic Manipulation16 Jun 2026
- 2026T-Rex: Tactile-Reactive Dexterous Manipulation15 Jun 2026
- 2026Self-Improving VLA Policies: Selected Diffusion Noise for Spurious-Robust Action Smoothing12 Jun 2026
- 2026CapVector: Learning Transferable Capability Vectors in Parametric Space for Vision-Language-Action Models11 May 2026
- 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models16 Mar 2026
- 2026TwinRL: Digital Twin-Driven Reinforcement Learning for Real-World Robotic Manipulation9 Feb 2026
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videoscited by 68
- 2026WALL-WM: Carving World Action Modeling at the Event Jointscited by 14
- 2026WAM4D: Fast 4D World Action Model via Spatial Register Tokenscited by 12
- 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Modelscited by 10
- 2026Token-World: World Modeling in Vision-Language Model Token Space for Robot Manipulationcited by 0
- 2026Token-World: World Modeling in Vision-Language Model Token Space for Robot Manipulation30 Sep 2026
- 2026WAM4D: Fast 4D World Action Model via Spatial Register Tokens12 Jun 2026
- 2026WALL-WM: Carving World Action Modeling at the Event Joints1 Jun 2026
- 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models11 May 2026
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos30 Apr 2026
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb 2026
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulationcited by 4
- 2026Continuous Reasoning for Vision-Language-Actioncited by 2
- 2026DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners?cited by 0
- 2026VideoLatent: Video-Language Learning via Latent Self-Forcingcited by 0
- 2026Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoningcited by 0
- 2026Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoning17 Sep 2026
- 2026VideoLatent: Video-Language Learning via Latent Self-Forcing22 Jun 2026
- 2026DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners?10 Jun 2026
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation2 Jun 2026
- 2026Continuous Reasoning for Vision-Language-Action29 May 2026
- 2026LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoningcited by 7
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026MoASE++: Mixture of Activation Sparsity Experts with Domain-Adaptive On-policy Distillation for Continual Test Time Adaptationcited by 0
- 2026DeCAL: Towards Physically-Grounded Dexterous Vision-Language-Action Models via Contact-Aware Latent Co-Imaginationcited by 0
- 2026DeCAL: Towards Physically-Grounded Dexterous Vision-Language-Action Models via Contact-Aware Latent Co-Imagination8 Sep 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
- 2026MoASE++: Mixture of Activation Sparsity Experts with Domain-Adaptive On-policy Distillation for Continual Test Time Adaptation18 May 2026
- 2026LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoning30 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Models
- 2026Thinking in Text and Images: Interleaved Vision--Language Reasoning Traces for Long-Horizon Robot Manipulation
- 2026LaST-VLA: Thinking in Latent Spatio-Temporal Space for Vision-Language-Action in Autonomous Driving
- 2025Unifying Perception and Action: A Hybrid-Modality Pipeline with Implicit Visual Chain-of-Thought for Robotic Action Generation
- 2026DualCoT-VLA: Visual-Linguistic Chain of Thought via Parallel Reasoning for Vision-Language-Action Models
- 2026PHR-VLA: Planning Horizon Reasoning for Vision-Language-Action Models
- 2026Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planning
- 2026CoTinyVLA: Chain-of-Thought Distillation for a Sub-Billion-Parameter Vision-Language-Action Model