SwitchVLA: Execution-Aware Task Switching for Vision-Language-Action Models
On the map: Vision-language-action models → Failure recovery and robustness
Abstract (arXiv)
Robots deployed in dynamic environments must be able to not only follow diverse language instructions but flexibly adapt when user intent changes mid-execution. While recent Vision-Language-Action (VLA) models have advanced multi-task learning and instruction following, they typically assume static task intent, failing to respond when new instructions arrive during ongoing execution. This limitation hinders natural and robust interaction in dynamic settings, such as retail or household environments, where real-time intent changes are common. We propose SwitchVLA, a unified, execution-aware framework that enables smooth and reactive task switching without external planners or additional switch-specific data. We model task switching as a behavior modulation problem conditioned on execution state and instruction context. Expert demonstrations are segmented into temporally grounded contact phases, allowing the policy to infer task progress and adjust its behavior accordingly. A multi-behavior conditional policy is then trained to generate flexible action chunks under varying behavior modes through conditioned trajectory modeling. Experiments in both simulation and real-world robotic manipulation demonstrate that SwitchVLA enables robust instruction adherence, fluid task switching, and strong generalization-outperforming prior VLA baselines in both task success rate and interaction naturalness.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 32 of its 37 references that are in the map. First posted on arXiv 4 Jun 2025.
Builds on
32 of 37 references.
References · 32
- 2017Attention Is All You Needcited by 59,932
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
20 more
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 305
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2022DaViT: Dual Attention Vision Transformerscited by 174
- 2023Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planningcited by 161
- 2024Yell At Your Robot: Improving On-the-Fly from Language Correctionscited by 123
- 2024BAKU: An Efficient Transformer for Multi-Task Policy Learningcited by 80
- 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformerscited by 72
- 2024RACER: Rich Language-Guided Failure Recovery Policies for Imitation Learningcited by 46
- 2024RT-Affordance: Affordances are Versatile Intermediate Representations for Robot Manipulationcited by 40
- 2025MoManipVLA: Transferring Vision-language-action Models for General Mobile Manipulationcited by 34
- 2022Learning Neuro-symbolic Programs for Language Guided Robot Manipulationcited by 9
- 2025Adversarial Data Collection: Human-Collaborative Perturbations for Efficient and Robust Robotic Imitation Learningcited by 9
Built on by
Citing papers per year: 2025: 7; 2026: 8.
15 papers.
Sort:
By area:
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 82
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 46
- 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Modelscited by 22
- 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representationscited by 15
- 2026FutureVLA: Joint Visuomotor Prediction for Vision-Language-Action Modelcited by 14
- 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulationcited by 10
- 2026CRAFT: Adapting VLA Models to Contact-rich Manipulation via Force-aware Curriculum Fine-tuningcited by 7
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
- 2025Robotic Manipulation via Imitation Learning: Taxonomy, Evolution, Benchmark, and Challengescited by 3
- 2025VITA-E: Natural Embodied Interaction with Concurrent Seeing, Hearing, Speaking, and Actingcited by 1
- 2026FlowHijack: A Dynamics-Aware Backdoor Attack on Flow-Matching Vision-Language-Action Modelscited by 1
- 2026RoboAware: Learning to Coordinate Embodied Skills from Counterfactual Outcomes8 Oct 2026
- 2026Causeway: Restoring Task Accessibility for Instruction Switching in VLA Policies25 Sep 2026
- 2026Position: Vision-Language-Action Models Cannot Be Verified to Perform Physical Reasoning28 Jun 2026
- 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulation9 Apr 2026
- 2026FlowHijack: A Dynamics-Aware Backdoor Attack on Flow-Matching Vision-Language-Action Models30 Mar 2026
- 2026FutureVLA: Joint Visuomotor Prediction for Vision-Language-Action Model11 Mar 2026
- 2026CRAFT: Adapting VLA Models to Contact-rich Manipulation via Force-aware Curriculum Fine-tuning13 Feb 2026
- 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Models12 Feb 2026
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges12 Dec 2025
- 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representations4 Nov 2025
- 2025VITA-E: Natural Embodied Interaction with Concurrent Seeing, Hearing, Speaking, and Acting21 Oct 2025
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct 2025
3 more
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorizationcited by 166
- 2026FutureVLA: Joint Visuomotor Prediction for Vision-Language-Action Modelcited by 14
- 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulationcited by 10
- 2026CRAFT: Adapting VLA Models to Contact-rich Manipulation via Force-aware Curriculum Fine-tuningcited by 7
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
- 2026FlowHijack: A Dynamics-Aware Backdoor Attack on Flow-Matching Vision-Language-Action Modelscited by 1
- 2026Causeway: Restoring Task Accessibility for Instruction Switching in VLA Policiescited by 0
- 2026Causeway: Restoring Task Accessibility for Instruction Switching in VLA Policies25 Sep 2026
- 2026HEX: Humanoid-Aligned Experts for Cross-Embodiment Whole-Body Manipulation9 Apr 2026
- 2026FlowHijack: A Dynamics-Aware Backdoor Attack on Flow-Matching Vision-Language-Action Models30 Mar 2026
- 2026FutureVLA: Joint Visuomotor Prediction for Vision-Language-Action Model11 Mar 2026
- 2026CRAFT: Adapting VLA Models to Contact-rich Manipulation via Force-aware Curriculum Fine-tuning13 Feb 2026
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges12 Dec 2025
- 2025LIBERO-PRO: Towards Robust and Fair Evaluation of Vision-Language-Action Models Beyond Memorization4 Oct 2025
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 82
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Surveycited by 46
- 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Modelscited by 22
- 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representationscited by 15
- 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Models12 Feb 2026
- 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representations4 Nov 2025
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct 2025
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey23 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025Vision-Language-Policy Model for Dynamic Robot Task Planning
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling
- 2026MIKASA-Robo-VLA: Benchmarking Memory in VLA Models for Long-Horizon Manipulation
- 2026SWAP: Stepwise Action Policy Routing for Vision-Language-Action Models
- 2026ActionGround: Training-Free Runtime Refinement of Frozen VLA Policies
- 2026Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration
- 2026IMPACT-VLA: Interaction-aware Multimodal Propagation Attribution via Counterfactual Trajectories for Vision-Language-Action Policies