LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoning
Not on the map. Why?
Abstract (arXiv)
Robotic foundation models require reasoning over complex visual scenes to execute adaptive actions in dynamic environments. While recent studies on latent-reasoning Vision-Language-Action (VLA) models have demonstrated the capability to capture fine-grained physical dynamics, they remain predominantly confined to static imitation learning, severely limiting their adaptability and generalization. In this paper, we present LaST-R1, a novel reinforcement learning (RL) post-training framework designed to effectively harness "latent reasoning-before-acting" policies. Specifically, we propose Latent-to-Action Policy Optimization (LAPO), a core RL algorithm that jointly optimizes the latent reasoning process and the action generation. By explicitly embedding latent Chain-of-Thought (CoT) reasoning directly within the RL optimization loop, LAPO stimulates profound physical world modeling, which in turn drives robust execution in interactive environments. Furthermore, an adaptive latent CoT mechanism is introduced, allowing the policy to dynamically modulate its reasoning horizon based on diverse environment states. Experiments show that LaST-R1 achieves a near-perfect 99.9% average success rate on the LIBERO benchmark with only one-shot supervised warm-up, significantly improving convergence speed and performance over prior state-of-the-art (SOTA) methods. In real-world deployments, LaST-R1 yields up to a 22.5% average improvement over SOTA supervised fine-tuning approach across four complex tasks, including both single-arm and dual-arm settings. Finally, LaST-R1 demonstrates strong generalization across simulated and real-world environments.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 76 of its 85 references that are in the map. First posted on arXiv 30 Apr 2026.
Builds on
76 of 85 references.
References · 76
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2024HybridFlow: A Flexible and Efficient RLHF Frameworkcited by 1,980
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
38 more
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025DINOv3cited by 1,297
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2018QT-Opt: Scalable Deep Reinforcement Learning for Vision-Based Robotic Manipulationcited by 730
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2023PyTorch FSDP: Experiences on Scaling Fully Sharded Data Parallelcited by 641
- 2022BC-Z: Zero-Shot Task Generalization with Robotic Imitation Learningcited by 517
- 2017Ray: A Distributed Framework for Emerging AI Applicationscited by 516
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
- 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
- 2022Interactive Language: Talking to Robots in Real Timecited by 217
- 2018RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitationcited by 202
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Modelcited by 176
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
- 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learningcited by 166
- 2024Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learningcited by 153
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
- 2023Structured World Models from Human Videoscited by 144
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 141
- 2025ConRFT: A Reinforced Fine-tuning Method for VLA Models via Consistency Policycited by 139
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulationcited by 132
- 2025Interactive Post-Training for Vision-Language-Action Modelscited by 129
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 127
- 2025Machine Mental Imagery: Empower Multimodal Reasoning with Latent Visual Tokenscited by 120
50 most cited of 76 All 76 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026Discrete-WAM: Unified Discrete Vision-Action Token Editing for World-Policy Learningcited by 3
- 2026ExToken: Structured Exploration for Efficient Vision-Language-Action Reinforcement Fine-tuningcited by 2
- 2026Temporal GRPO: Beyond Trajectory-Level Credit in Vision-Language-Action Reinforcement Learningcited by 1
- 2026Teach and Grow: An Agent-Centered Architecture for General Robot Learningcited by 0
- 2026HaWMPO: Hallucination-Aware World Model-based Policy Optimization for Generalist Robot Policycited by 0
- 2026Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoningcited by 0
- 2026PF-RL: Progress Field Reinforcement Learning via Goal-Conditioned Value Geometry for Vision-Language-Action Modelscited by 0
- 2026PF-RL: Progress Field Reinforcement Learning via Goal-Conditioned Value Geometry for Vision-Language-Action Models26 Sep 2026
- 2026Uni-LaDiR: Latent Diffusion Unifies Multimodal Reasoning17 Sep 2026
- 2026HaWMPO: Hallucination-Aware World Model-based Policy Optimization for Generalist Robot Policy9 Sep 2026
- 2026Teach and Grow: An Agent-Centered Architecture for General Robot Learning17 Aug 2026
- 2026Temporal GRPO: Beyond Trajectory-Level Credit in Vision-Language-Action Reinforcement Learning13 Aug 2026
- 2026ExToken: Structured Exploration for Efficient Vision-Language-Action Reinforcement Fine-tuning14 Jul 2026
- 2026Discrete-WAM: Unified Discrete Vision-Action Token Editing for World-Policy Learning4 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planning
- 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Models
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models
- 2025MIND-V: Hierarchical World Model for Long-Horizon Robotic Manipulation with RL-based Physical Alignment
- 2025SRPO: Self-Referential Policy Optimization for Vision-Language-Action Models
- 2025LoLA: Long Horizon Latent Action Learning for General Robot Manipulation
- 2025RoboGPT-R1: Enhancing Robot Task Planning with Reinforcement Learning
- 2026PHR-VLA: Planning Horizon Reasoning for Vision-Language-Action Models