Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification
On the map: LLM reasoning → Spatial and embodied reasoning
also in 1 more
Abstract (arXiv)
Reasoning Vision Language Action (VLA) models improve robotic instruction-following by generating step-by-step textual plans before low-level actions, an approach inspired by Chain-of-Thought (CoT) reasoning in language models. Yet even with a correct textual plan, the generated actions can still miss the intended outcomes in the plan, especially in out-of-distribution (OOD) scenarios. We formalize this phenomenon as a lack of embodied CoT faithfulness, and introduce a training-free, runtime policy steering method for reasoning-action alignment. Given a reasoning VLA's intermediate textual plan, our framework samples multiple candidate action sequences from the same model, predicts their outcomes via simulation, and uses a pre-trained Vision-Language Model (VLM) to select the sequence whose outcome best aligns with the VLA's own textual plan. Only executing action sequences that align with the textual reasoning turns our base VLA's natural action diversity from a source of error into a strength, boosting robustness to semantic and visual OOD perturbations and enabling novel behavior composition without costly re-training. We also contribute a reasoning-annotated extension of LIBERO-100, environment variations tailored for OOD evaluation, and demonstrate up to 15% performance gain over prior work on behavior composition tasks and scales with compute and data diversity. Project Website at: https://yilin-wu98.github.io/steering-reasoning-vla/
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 26 references that are in the map. First posted on arXiv 18 Oct 2025.
Builds on
24 of 26 references.
Closest ancestors · 4
Same direction, newest first
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning22 Jul
- 2025Training Strategies for Efficient Embodied Reasoning13 May
- 2025From Foresight to Forethought: VLM-In-the-Loop Policy Steering via Latent Alignment3 Feb
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
Other references · 20
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,245
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023Language Models Don't Always Say What They Think: Unfaithful Explanations in Chain-of-Thought Promptingcited by 1,081
- 2019Multilingual Universal Sentence Encoder for Semantic Retrievalcited by 192
- 2023Physically Grounded Vision-Language Models for Robotic Manipulationcited by 163
- 2025RoboTwin: Dual-Arm Robot Benchmark with Generative Digital Twinscited by 117
8 more
- 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 112
- 2025OneTwoVLA: A Unified Vision-Language-Action Model with Adaptive Reasoningcited by 105
- 2024Steering Your Generalists: Improving Robotic Foundation Models via Value Guidancecited by 100
- 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 95
- 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progresscited by 63
- 2025RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Modelscited by 56
- 2024Inference-Time Policy Steering through Human Interactionscited by 35
- 2025Adapting by Analogy: OOD Generalization of Visuomotor Policies via Functional Correspondencecited by 3
Built on by
Citing papers per year: 2026: 25.
25 papers.
Sort:
By area:
- 2026Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planningcited by 20
- 2026VLS: Steering Pretrained Robot Policies via Vision-Language Modelscited by 14
- 2026Open-Loop Planning, Closed-Loop Verification: Speculative Verification for VLAcited by 5
- 2026When to Act, Ask, or Learn: Uncertainty-Aware Policy Steeringcited by 4
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulationcited by 4
- 2026Learning What to Say to Your VLA: Mostly Harmless Vision Language Action Model Steeringcited by 4
- 2026Self-Supervised Bootstrapping of Action-Predictive Embodied Reasoningcited by 3
- 2026Contrastive Conceptor Activation Steering (COAST): Unlocking Vision-Language-Action Models through Hidden Statescited by 3
- 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Modelscited by 3
- 2026Embodied Interpretability: Linking Causal Understanding to Generalization in Vision-Language-Action Modelscited by 2
- 2026SAPS: Shared Autonomy for Policy Steering by Blending Teleoperation with a Pretrained VLAcited by 1
- 2026Visual Verification Enables Inference-time Steering and Autonomous Policy Improvementcited by 1
13 more
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoningcited by 1
- 2026Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundationscited by 0
- 2026VLESA: Vision-Language Embodied Safety Agent for Human Activity Monitoringcited by 0
- 2026Reasoning as a Double-Edged Sword: Architecture and Cross-Stage Robustness in Vision-Language-Action Modelscited by 0
- 2026Grounded Semantic Re-Binding for Robust Instruction Generalization in Vision-Language-Action Modelscited by 0
- 2026Trajectory Divergence Horizon Decision for Reliable Dual-Arm Surgical Subtask Manipulationcited by 0
- 2026TrapVLA: Trapping Vision-Language-Action Models in Configured Failure Modescited by 0
- 2026Drive the Thoughts: Runtime Monitoring of VLA Reasoning-Trajectory Consistencycited by 0
- 2026GT-VLA: Target-Conditioned Trace Guidance for Generalizable Robotic Manipulationcited by 0
- 2026RECAST: Recasting Vision-Language Semantics into an Actionable Cost Map for Robot Navigationcited by 0
- 2026Correcting WHERE, Preserving HOW: Compositional Generalization for Vision-Language-Action Models via Referential Guidancecited by 0
- 2026When Reasoning Helps Action: Monitoring and Steering Chain-of-Thought in Vision-Language-Action Policiescited by 0
- 2026Rephrase Before You Act: Characterizing and Mitigating Language Sensitivity in Vision-Language-Action Modelscited by 0
- 2026Rephrase Before You Act: Characterizing and Mitigating Language Sensitivity in Vision-Language-Action Models7 Oct 2026
- 2026When Reasoning Helps Action: Monitoring and Steering Chain-of-Thought in Vision-Language-Action Policies30 Sep 2026
- 2026Correcting WHERE, Preserving HOW: Compositional Generalization for Vision-Language-Action Models via Referential Guidance29 Sep 2026
- 2026RECAST: Recasting Vision-Language Semantics into an Actionable Cost Map for Robot Navigation26 Sep 2026
- 2026GT-VLA: Target-Conditioned Trace Guidance for Generalizable Robotic Manipulation25 Sep 2026
- 2026Drive the Thoughts: Runtime Monitoring of VLA Reasoning-Trajectory Consistency30 Aug 2026
- 2026TrapVLA: Trapping Vision-Language-Action Models in Configured Failure Modes27 Aug 2026
- 2026Trajectory Divergence Horizon Decision for Reliable Dual-Arm Surgical Subtask Manipulation10 Aug 2026
- 2026Grounded Semantic Re-Binding for Robust Instruction Generalization in Vision-Language-Action Models3 Aug 2026
- 2026Reasoning as a Double-Edged Sword: Architecture and Cross-Stage Robustness in Vision-Language-Action Models20 Jul 2026
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoning6 Jul 2026
- 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models4 Jul 2026
13 more
- 2026Visual Verification Enables Inference-time Steering and Autonomous Policy Improvement16 Jun 2026
- 2026SAPS: Shared Autonomy for Policy Steering by Blending Teleoperation with a Pretrained VLA14 Jun 2026
- 2026Learning What to Say to Your VLA: Mostly Harmless Vision Language Action Model Steering10 Jun 2026
- 2026VLESA: Vision-Language Embodied Safety Agent for Human Activity Monitoring2 Jun 2026
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation2 Jun 2026
- 2026Back to Parsimonious Latents: Learning Task-Centric World Models from Visual Foundations25 May 2026
- 2026Contrastive Conceptor Activation Steering (COAST): Unlocking Vision-Language-Action Models through Hidden States16 May 2026
- 2026Embodied Interpretability: Linking Causal Understanding to Generalization in Vision-Language-Action Models1 May 2026
- 2026Open-Loop Planning, Closed-Loop Verification: Speculative Verification for VLA3 Apr 2026
- 2026When to Act, Ask, or Learn: Uncertainty-Aware Policy Steering25 Feb 2026
- 2026Self-Supervised Bootstrapping of Action-Predictive Embodied Reasoning9 Feb 2026
- 2026VLS: Steering Pretrained Robot Policies via Vision-Language Models3 Feb 2026
- 2026Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planning14 Jan 2026
- 2026Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planningcited by 20
- 2026Open-Loop Planning, Closed-Loop Verification: Speculative Verification for VLAcited by 5
- 2026Learning What to Say to Your VLA: Mostly Harmless Vision Language Action Model Steeringcited by 4
- 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Modelscited by 3
- 2026Embodied Interpretability: Linking Causal Understanding to Generalization in Vision-Language-Action Modelscited by 2
- 2026SAPS: Shared Autonomy for Policy Steering by Blending Teleoperation with a Pretrained VLAcited by 1
- 2026Visual Verification Enables Inference-time Steering and Autonomous Policy Improvementcited by 1
- 2026Grounded Semantic Re-Binding for Robust Instruction Generalization in Vision-Language-Action Modelscited by 0
- 2026Trajectory Divergence Horizon Decision for Reliable Dual-Arm Surgical Subtask Manipulationcited by 0
- 2026TrapVLA: Trapping Vision-Language-Action Models in Configured Failure Modescited by 0
- 2026GT-VLA: Target-Conditioned Trace Guidance for Generalizable Robotic Manipulationcited by 0
- 2026Correcting WHERE, Preserving HOW: Compositional Generalization for Vision-Language-Action Models via Referential Guidancecited by 0
- 2026Correcting WHERE, Preserving HOW: Compositional Generalization for Vision-Language-Action Models via Referential Guidance29 Sep 2026
- 2026GT-VLA: Target-Conditioned Trace Guidance for Generalizable Robotic Manipulation25 Sep 2026
- 2026TrapVLA: Trapping Vision-Language-Action Models in Configured Failure Modes27 Aug 2026
- 2026Trajectory Divergence Horizon Decision for Reliable Dual-Arm Surgical Subtask Manipulation10 Aug 2026
- 2026Grounded Semantic Re-Binding for Robust Instruction Generalization in Vision-Language-Action Models3 Aug 2026
- 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models4 Jul 2026
- 2026Visual Verification Enables Inference-time Steering and Autonomous Policy Improvement16 Jun 2026
- 2026SAPS: Shared Autonomy for Policy Steering by Blending Teleoperation with a Pretrained VLA14 Jun 2026
- 2026Learning What to Say to Your VLA: Mostly Harmless Vision Language Action Model Steering10 Jun 2026
- 2026Embodied Interpretability: Linking Causal Understanding to Generalization in Vision-Language-Action Models1 May 2026
- 2026Open-Loop Planning, Closed-Loop Verification: Speculative Verification for VLA3 Apr 2026
- 2026Fast-ThinkAct: Efficient Vision-Language-Action Reasoning via Verbalizable Latent Planning14 Jan 2026
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulationcited by 4
- 2026Self-Supervised Bootstrapping of Action-Predictive Embodied Reasoningcited by 3
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoningcited by 1
- 2026Reasoning as a Double-Edged Sword: Architecture and Cross-Stage Robustness in Vision-Language-Action Modelscited by 0
- 2026Drive the Thoughts: Runtime Monitoring of VLA Reasoning-Trajectory Consistencycited by 0
- 2026When Reasoning Helps Action: Monitoring and Steering Chain-of-Thought in Vision-Language-Action Policiescited by 0
- 2026When Reasoning Helps Action: Monitoring and Steering Chain-of-Thought in Vision-Language-Action Policies30 Sep 2026
- 2026Drive the Thoughts: Runtime Monitoring of VLA Reasoning-Trajectory Consistency30 Aug 2026
- 2026Reasoning as a Double-Edged Sword: Architecture and Cross-Stage Robustness in Vision-Language-Action Models20 Jul 2026
- 2026Do Vision-Language-Action Models Mean What They Say? On the Role of Faithfulness in Embodied Reasoning6 Jul 2026
- 2026Revisiting Embodied Chain-of-Thought for Generalizable Robot Manipulation2 Jun 2026
- 2026Self-Supervised Bootstrapping of Action-Predictive Embodied Reasoning9 Feb 2026
- 2026VLS: Steering Pretrained Robot Policies via Vision-Language Modelscited by 14
- 2026Contrastive Conceptor Activation Steering (COAST): Unlocking Vision-Language-Action Models through Hidden Statescited by 3
- 2026Rephrase Before You Act: Characterizing and Mitigating Language Sensitivity in Vision-Language-Action Modelscited by 0
- 2026Rephrase Before You Act: Characterizing and Mitigating Language Sensitivity in Vision-Language-Action Models7 Oct 2026
- 2026Contrastive Conceptor Activation Steering (COAST): Unlocking Vision-Language-Action Models through Hidden States16 May 2026
- 2026VLS: Steering Pretrained Robot Policies via Vision-Language Models3 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning
- 2025DeepThinkVLA: Enhancing Reasoning Capability of Vision-Language-Action Models
- 2026In-Context VLA: Endowing Vision-Language-Action Models with Language via In-Context Post-Training and Agentic Tool Use
- 2026CoTinyVLA: Chain-of-Thought Distillation for a Sub-Billion-Parameter Vision-Language-Action Model
- 2026Scaling Verification Can Be More Effective than Scaling Policy Learning for Vision-Language-Action Alignment
- 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Models
- 2026Continuous Reasoning for Vision-Language-Action
- 2026G0.5: One Autoregressive Stream for Robot Reasoning and Action