Self-Supervised Bootstrapping of Action-Predictive Embodied Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
Embodied Chain-of-Thought (CoT) reasoning has significantly enhanced Vision-Language-Action (VLA) models, yet current methods rely on rigid templates to specify reasoning primitives (e.g., objects in the scene, high-level plans, structural affordances). These templates can force policies to process irrelevant information that distracts from critical action-prediction signals. This creates a bottleneck: without successful policies, we cannot verify reasoning quality; without quality reasoning, we cannot build robust policies. We introduce R&B-EnCoRe, which enables models to bootstrap embodied reasoning from internet-scale knowledge through self-supervised refinement. By treating reasoning as a latent variable within importance-weighted variational inference, models can generate and distill a refined reasoning training dataset of embodiment-specific strategies without external rewards, verifiers, or human annotation. We validate R&B-EnCoRe across manipulation (Franka Panda in simulation, WidowX in hardware), legged navigation (bipedal, wheeled, bicycle, quadruped), and autonomous driving embodiments using various VLA architectures with 1B, 4B, 7B, and 30B parameters. Our approach achieves 28% gains in manipulation success, 101% improvement in navigation scores, and 21% reduction in collision-rate metric over models that indiscriminately reason about all available primitives. R&B-EnCoRe enables models to distill reasoning that is predictive of successful control, bypassing manual annotation engineering while grounding internet-scale knowledge in physical execution.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 94 of its 114 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
94 of 114 references.
Closest ancestors · 10
Same direction, newest first
- 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification18 Oct
- 2025MolmoAct: Action Reasoning Models that can Reason in Space11 Aug
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning22 Jul
- 2025Training Strategies for Efficient Embodied Reasoning13 May
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning18 Mar
- 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning16 Dec
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
- 2023RoboVQA: Multimodal Long-Horizon Reasoning for Robotics1 Nov
Other references · 84
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2017Neural Discrete Representation Learningcited by 4,650
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
38 more
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2023SGLang: Efficient Execution of Structured Language Model Programscited by 1,107
- 2022Planning-oriented Autonomous Drivingcited by 1,068
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2023WizardCoder: Empowering Code Large Language Models with Evol-Instructcited by 728
- 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
- 2024Phi-4 Technical Reportcited by 675
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2023Textbooks Are All You Need II: phi-1.5 technical reportcited by 559
- 2015Importance Weighted Autoencoderscited by 454
- 2024LLaVA-CoT: Let Vision Language Models Reason Step-by-Stepcited by 446
- 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 397
- 2023GPT-Driver: Learning to Drive with GPTcited by 344
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
- 2023Beyond Human Data: Scaling Self-Training for Problem-Solving with Language Modelscited by 325
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 321
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2023Towards Revealing the Mystery behind Chain of Thought: A Theoretical Perspectivecited by 293
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 2024Chain of Thought Empowers Transformers to Solve Inherently Serial Problemscited by 256
- 2023Magicoder: Empowering Code Generation with OSS-Instructcited by 251
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 212
- 2024Chain-of-Thought Reasoning Without Promptingcited by 208
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
- 2025OpenDriveVLA: Towards End-to-end Autonomous Driving with Large Vision Language Action Modelcited by 172
- 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 171
- 2023A Language Agent for Autonomous Drivingcited by 161
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
50 most cited of 84 All 84 (JSON)
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoningcited by 1
- 2026DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners?cited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Drivingcited by 0
- 2026Beyond Textual Chain-of-Thought: A Survey on Action-Grounded Reasoning in Autonomous Driving31 Aug 2026
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoning6 Jul 2026
- 2026DIRECT: When and Where Should You Allocate Test-Time Compute in Embodied Planners?10 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation
- 2026Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Models
- 2026MobileVLA-R1 2.0: RL-Enhanced Reasoning for Mobile Robot Control
- 2026Guide, Think, Act: Interactive Embodied Reasoning in Vision-Language-Action Models
- 2025DeepThinkVLA: Enhancing Reasoning Capability of Vision-Language-Action Models
- 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training
- 2026Unmasking the Illusion of Embodied Reasoning in Vision-Language-Action Models
- 2026VisualThink-VLA: Visual Intermediate Reasoning for Effective and Low-Latency Vision-Language-Action Policies