Can Vision-Language-Action Models Learn from Real-World Data Continually without Forgetting?
On the map: Vision-language-action models → Reinforcement learning and post-training
Abstract (arXiv)
Vision-Language-Action (VLA) models provide a promising foundation for general-purpose robotics, yet their real-world deployment demands the ability to continually acquire new skills without forgetting prior ones. While recent studies have explored continual learning for VLA models in simulated settings, the challenge remains largely unexamined under realistic physical conditions. To bridge this gap, we construct a real-world continual learning benchmark comprising ten diverse sequential manipulation tasks across both single-arm and bimanual configurations. Through extensive experiments on this benchmark, we find that naive sequential fine-tuning leads to severe catastrophic forgetting, whereas a well-configured experience replay (ER) approach can effectively mitigate forgetting and outperform joint multi-task training under equivalent computational budgets. Notably, by synthesizing our empirical findings, we successfully achieve stable continual learning across the full 10-task heterogeneous stream, retaining previously acquired capabilities while adapting to diverse new skills in real-world deployment. This work presents an empirical study grounded in real-world continual VLA learning and offers actionable insights for deploying robust, long-lived robotic policies.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 29 of its 40 references that are in the map. First posted on arXiv 26 May 2026.
Builds on
29 of 40 references.
Closest ancestors · 5
Same direction, newest first
- 2026Simple Recipe Works: Vision-Language-Action Models are Natural Continual Learners with Reinforcement Learning12 Mar
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models9 Mar
- 2026Pretrained Vision-Language-Action Models are Surprisingly Resistant to Forgetting in Continual Learning4 Mar
- 2026Towards Long-Lived Robots: Continual Learning VLA Models via Reinforcement Fine-Tuning11 Feb
- 2026CLARE: Continual Learning for Vision-Language-Action Models via Autonomous Adapter Routing and Expansion14 Jan
Other references · 24
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2016iCaRL: Incremental Classifier and Representation Learningcited by 2,333
- 2017Gradient Episodic Memory for Continual Learningcited by 1,898
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2016Progressive Neural Networkscited by 1,361
- 2018Experience Replay for Continual Learningcited by 1,095
- 2018Efficient Lifelong Learning with A-GEMcited by 1,058
- 2020Dark Experience for General Continual Learning: a Strong, Simple Baselinecited by 911
- 2017PackNet: Adding Multiple Tasks to a Single Network by Iterative Pruningcited by 898
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
12 more
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2018Overcoming catastrophic forgetting with hard attention to the taskcited by 681
- 2018Progress & Compress: A scalable framework for continual learningcited by 520
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2017PathNet: Evolution Channels Gradient Descent in Super Neural Networkscited by 364
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
- 2024Continual Learning of Large Language Models: A Comprehensive Surveycited by 234
- 2018Online Structured Laplace Approximations For Overcoming Catastrophic Forgettingcited by 201
- 2026LeRobot: An Open-Source Library for End-to-End Robot Learningcited by 73
- 2021Layerwise Optimization by Gradient Decomposition for Continual Learningcited by 51
- 2026Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baselinecited by 9
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Embodied Turing Machines: Stateful Code for Robot Recursive Self-Improvementcited by 1
- 2026LargeMonitor: Monitoring Online Task-Free Continual Learning via Large Pretrained Modelscited by 0
- 2026FAN: Foresight Action Normalization for Continual Adaptation of Vision-Language-Action Modelscited by 0
- 2026SAMBAR: Selective Anchoring via Method of Multipliers for Balanced Knowledge Acquisition and Retention in Vision-Language-Action Modelscited by 0
- 2026RIFAR: Reliability and Forgetting-Aware Replay for Continual Robot Learningcited by 0
- 2026Dream to Remember: Continual Steering of Generalist Robot Policies with World Modelscited by 0
- 2026Dream to Remember: Continual Steering of Generalist Robot Policies with World Models9 Oct 2026
- 2026Embodied Turing Machines: Stateful Code for Robot Recursive Self-Improvement8 Oct 2026
- 2026RIFAR: Reliability and Forgetting-Aware Replay for Continual Robot Learning2 Oct 2026
- 2026SAMBAR: Selective Anchoring via Method of Multipliers for Balanced Knowledge Acquisition and Retention in Vision-Language-Action Models26 Sep 2026
- 2026FAN: Foresight Action Normalization for Continual Adaptation of Vision-Language-Action Models18 Sep 2026
- 2026LargeMonitor: Monitoring Online Task-Free Continual Learning via Large Pretrained Models8 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026PHASER: Phase-Aware and Semantic Experience Replay for Vision-Language-Action Models
- 2026RECALL: Recovery Experience Collection for Active Lifelong Learning in Vision-Language-Action Models
- 2026Towards Human-like Physical Intelligence: Lifelong Vision-Language-Action Learning for Robotic Manipulation
- 2026World Action Models Enable Continual Imitation Learning with Recurrent Generative Replays
- 2026OrthoSkillVLA: Continual Skill Learning via Gradient-Informed Skill Subspace Adaptation
- 2026CRL-VLA: Continual Vision-Language-Action Learning
- 2026Information-Theoretic Constraints for Continual Vision-Language-Action Alignment
- 2026Does Continual Imitation Learning Remain Grounded? A Language-Perturbed Benchmark for Robotic Task Retention