Towards Deploying VLA without Fine-Tuning: Plug-and-Play Inference-Time VLA Policy Steering via Embodied Evolutionary Diffusion
On the map: Vision-language-action models → Reinforcement learning and post-training
Abstract (arXiv)
Vision-Language-Action (VLA) models have demonstrated significant potential in real-world robotic manipulation. However, pre-trained VLA policies still suffer from substantial performance degradation during downstream deployment. Although fine-tuning can mitigate this issue, its reliance on costly demonstration collection and intensive computation makes it impractical in real-world settings. In this work, we introduce VLA-Pilot, a plug-and-play inference-time policy steering method for zero-shot deployment of pre-trained VLA without any additional fine-tuning or data collection. We evaluate VLA-Pilot on six real-world downstream manipulation tasks across two distinct robotic embodiments, encompassing both in-distribution and out-of-distribution scenarios. Experimental results demonstrate that VLA-Pilot substantially boosts the success rates of off-the-shelf pre-trained VLA policies, enabling robust zero-shot generalization to diverse tasks and embodiments. Experimental videos and code are available at: https://rip4kobe.github.io/vla-pilot/.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 26 of its 33 references that are in the map. First posted on arXiv 18 Nov 2025.
Builds on
26 of 33 references.
Closest ancestors · 2
Same direction, newest first
- 2024GRAPE: Generalizing Robot Policy via Preference Alignment28 Nov
- 2024Steering Your Generalists: Improving Robotic Foundation Models via Value Guidance17 Oct
Other references · 24
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 346
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 224
12 more
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 216
- 2025Steering Your Diffusion Policy with Latent Space Reinforcement Learningcited by 169
- 2024DINOv2 Meets Text: A Unified Framework for Image- and Pixel-Level Vision-Language Alignmentcited by 79
- 2025RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Modelscited by 61
- 2025Hume: Introducing System-2 Thinking in Visual-Language-Action Modelcited by 56
- 2025From Foresight to Forethought: VLM-In-the-Loop Policy Steering via Latent Alignmentcited by 52
- 2024Inference-Time Policy Steering through Human Interactionscited by 38
- 2025RoVer: Robot Reward Model as Test-Time Verifier for Vision-Language-Action Modelcited by 19
- 2024Diffusion Models are Evolutionary Algorithmscited by 17
- 2025ManiDP: Manipulability-Aware Diffusion Policy for Posture-Dependent Bimanual Manipulationcited by 4
- 2025Extremum Flow Matching for Offline Goal Conditioned Reinforcement Learningcited by 3
- 2024Human-Humanoid Robots Cross-Embodiment Behavior-Skill Transfer Using Decomposed Adversarial Learning from Demonstrationcited by 1
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026VLS: Steering Pretrained Robot Policies via Vision-Language Modelscited by 15
- 2026Breaking Lock-In: Preserving Steerability under Low-Data VLA Post-Trainingcited by 6
- 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Modelscited by 4
- 2026Self-Improving VLA Policies: Selected Diffusion Noise for Spurious-Robust Action Smoothingcited by 1
- 2026Pose6DAug: Physically Plausible Multi-view Object Swapping for Robot Data Augmentationcited by 1
- 2026Trust Your Instincts: Confidence-Driven Test-Time RL for Vision-Language-Action Modelscited by 1
- 2026A Causality-aware Infer-diagnose-refine Framework for Test-time Modality Adaptation in VLA Modelscited by 0
- 2026RL2-VLA: Adaptive RL Latent Compositional Steering with Test-Time Scaling for Vision-Language-Action Modelscited by 0
- 2026RL2-VLA: Adaptive RL Latent Compositional Steering with Test-Time Scaling for Vision-Language-Action Models29 Jul 2026
- 2026A Causality-aware Infer-diagnose-refine Framework for Test-time Modality Adaptation in VLA Models28 Jul 2026
- 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models4 Jul 2026
- 2026Trust Your Instincts: Confidence-Driven Test-Time RL for Vision-Language-Action Models29 Jun 2026
- 2026Pose6DAug: Physically Plausible Multi-view Object Swapping for Robot Data Augmentation18 Jun 2026
- 2026Self-Improving VLA Policies: Selected Diffusion Noise for Spurious-Robust Action Smoothing12 Jun 2026
- 2026Breaking Lock-In: Preserving Steerability under Low-Data VLA Post-Training25 Apr 2026
- 2026VLS: Steering Pretrained Robot Policies via Vision-Language Models3 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026DREAMSTEER: Latent World Models Can Steer VLA Policies During Deployment Without Any Finetuning
- 2026VLA-REPLICA: A Low-Cost, Reproducible Benchmark for Real-World Evaluation of Vision-Language-Action Models
- 2026On-the-Fly VLA Adaptation via Test-Time Reinforcement Learning
- 2026SimVLA: A Simple VLA Baseline for Robotic Manipulation
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
- 2026EmbodiedSkills: A Unified Framework for Orchestrating, Training, and Deploying VLA Agents
- 2026Vision-Language-Action Jump-Starting for Reinforcement Learning Robotic Agents