mlsanityData to 7 Oct 2026

SwitchVLA: Execution-Aware Task Switching for Vision-Language-Action Models

arXiv 2506.03574 ↗First posted 4 Jun 2025cs.ROcited by 15

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Robots deployed in dynamic environments must be able to not only follow diverse language instructions but flexibly adapt when user intent changes mid-execution. While recent Vision-Language-Action (VLA) models have advanced multi-task learning and instruction following, they typically assume static task intent, failing to respond when new instructions arrive during ongoing execution. This limitation hinders natural and robust interaction in dynamic settings, such as retail or household environments, where real-time intent changes are common. We propose SwitchVLA, a unified, execution-aware framework that enables smooth and reactive task switching without external planners or additional switch-specific data. We model task switching as a behavior modulation problem conditioned on execution state and instruction context. Expert demonstrations are segmented into temporally grounded contact phases, allowing the policy to infer task progress and adjust its behavior accordingly. A multi-behavior conditional policy is then trained to generate flexible action chunks under varying behavior modes through conditioned trajectory modeling. Experiments in both simulation and real-world robotic manipulation demonstrate that SwitchVLA enables robust instruction adherence, fluid task switching, and strong generalization-outperforming prior VLA baselines in both task success rate and interaction naturalness.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 32 of its 37 references that are in the map. First posted on arXiv 4 Jun 2025.

Builds on

32 of 37 references.

References · 32

  1. 2017Attention Is All You Needcited by 59,932
  2. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  6. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  8. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  9. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  10. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  11. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  12. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
20 more
  1. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  2. 2023Florence-2: Advancing a Unified Representation for a Variety of Vision Taskscited by 403
  3. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  4. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 377
  5. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
  6. 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 305
  7. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  8. 2023RVT: Robotic View Transformer for 3D Object Manipulationcited by 224
  9. 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
  10. 2024RT-H: Action Hierarchies Using Languagecited by 204
  11. 2022DaViT: Dual Attention Vision Transformerscited by 174
  12. 2023Look Before You Leap: Unveiling the Power of GPT-4V in Robotic Vision-Language Planningcited by 161
  13. 2024Yell At Your Robot: Improving On-the-Fly from Language Correctionscited by 123
  14. 2024BAKU: An Efficient Transformer for Multi-Task Policy Learningcited by 80
  15. 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformerscited by 72
  16. 2024RACER: Rich Language-Guided Failure Recovery Policies for Imitation Learningcited by 46
  17. 2024RT-Affordance: Affordances are Versatile Intermediate Representations for Robot Manipulationcited by 40
  18. 2025MoManipVLA: Transferring Vision-language-action Models for General Mobile Manipulationcited by 34
  19. 2022Learning Neuro-symbolic Programs for Language Guided Robot Manipulationcited by 9
  20. 2025Adversarial Data Collection: Human-Collaborative Perturbations for Efficient and Robust Robotic Imitation Learningcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 8.

15 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025Vision-Language-Policy Model for Dynamic Robot Task Planning
  2. 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
  3. 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling
  4. 2026MIKASA-Robo-VLA: Benchmarking Memory in VLA Models for Long-Horizon Manipulation
  5. 2026SWAP: Stepwise Action Policy Routing for Vision-Language-Action Models
  6. 2026ActionGround: Training-Free Runtime Refinement of Frozen VLA Policies
  7. 2026Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration
  8. 2026IMPACT-VLA: Interaction-aware Multimodal Propagation Attribution via Counterfactual Trajectories for Vision-Language-Action Policies