EvoVLA: Self-Evolving Vision-Language-Action Model
On the map: Vision-language-action models → Reinforcement learning and post-training
Abstract (arXiv)
Long-horizon robotic manipulation remains challenging for Vision-Language-Action (VLA) models despite recent progress in zero-shot generalization and simulation-to-real-world transfer. Current VLA models suffer from stage hallucination, where agents exploit coarse evaluation signals to shortcut multi-step tasks, reporting high progress without truly completing them. We present EvoVLA, a self-supervised VLA framework that addresses this issue through three complementary components: Stage-Aligned Reward (SAR), which uses triplet contrastive learning with Gemini-generated hard negatives to prevent visual shortcuts; Pose-Based Object Exploration (POE), which grounds curiosity in relative object-gripper pose instead of raw pixels; and Long-Horizon Memory, which uses selective context retention and gated fusion to stabilize intrinsic shaping during extended rollouts. Extensive evaluations on Discoverse-L, a long-horizon manipulation benchmark with three multi-stage tasks, show that EvoVLA improves average task success by 10.2 percentage points over the strongest baseline (OpenVLA-OFT), reaching 69.2 percent. EvoVLA also achieves one-and-a-half times better sample efficiency and reduces stage hallucination from 38.5 percent to 14.8 percent. Real-world deployment on physical robots reaches an average success rate of 54.6 percent across four manipulation tasks, outperforming OpenVLA-OFT by 11 points, demonstrating effective sim-to-real transfer and strong generalization. Code: https://github.com/AIGeeksGroup/EvoVLA. Website: https://aigeeksgroup.github.io/EvoVLA.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 34 of its 56 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
34 of 56 references.
Closest ancestors · 10
Same direction, newest first
- 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Models2 Oct
- 2025VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulators1 Oct
- 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning11 Sep
- 2025CO-RFT: Efficient Fine-Tuning of Vision-Language-Action Models through Chunked Offline Reinforcement Learning4 Aug
- 2025RFTF: Reinforcement Fine-tuning for Embodied Agents with Temporal Feedback26 May
- 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learning24 May
- 2025ReinboT: Amplifying Robot Visual-Language Manipulation with Reinforcement Learning12 May
- 2025ConRFT: A Reinforced Fine-tuning Method for VLA Models via Consistency Policy8 Feb
- 2025Improving Vision-Language-Action Model with Online Reinforcement Learning28 Jan
- 2024Octo: An Open-Source Generalist Robot Policy20 May
Other references · 24
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
- 2018Soft Actor-Critic Algorithms and Applicationscited by 1,179
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2018Exploration by Random Network Distillationcited by 966
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
12 more
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2024Titans: Learning to Memorize at Test Timecited by 303
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
- 2024FLaRe: Achieving Masterful and Adaptive Robot Policies with Large-Scale Reinforcement Learning Fine-Tuningcited by 54
- 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understandingcited by 47
- 2025Nav-R1: Reasoning and Navigation in Embodied Scenescited by 37
- 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Modelscited by 26
- 2025DC-Scene: Data-Centric Learning for 3D Scene Understandingcited by 15
- 20253D CoCa: Contrastive Learners are 3D Captionerscited by 13
- 2025DISCOVERSE: Efficient Robot Simulation in Complex High-Fidelity Environmentscited by 12
- 2025StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenescited by 8
- 2023ALP: Action-Aware Embodied Learning for Perceptioncited by 4
Built on by
Citing papers per year: 2025: 3; 2026: 8.
11 papers.
- 2025Memory in the Age of AI Agentscited by 285
- 2025MobileVLA-R1: Reinforcing Vision-Language-Action for Mobile Robotscited by 15
- 2026μVLA: On Recurrent Memory for Partially Observable Manipulation in VLA Modelscited by 7
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusioncited by 5
- 2026AnyDepth: Depth Estimation Made Easycited by 4
- 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligencecited by 3
- 2026Self-Supervised Bootstrapping of Action-Predictive Embodied Reasoningcited by 3
- 2026Recursive Belief Vision Language Action Modelscited by 3
- 2026Silent Failures in Physical AI: A Literature Review of Runtime Action Authorization for Autonomous Systemscited by 0
- 2026DriveVLA-M0: Failure-Aware Memory Augmentation for Autonomous Drivingcited by 0
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluationcited by 0
- 2026Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluation17 Aug 2026
- 2026DriveVLA-M0: Failure-Aware Memory Augmentation for Autonomous Driving11 Aug 2026
- 2026μVLA: On Recurrent Memory for Partially Observable Manipulation in VLA Models10 Jun 2026
- 2026Silent Failures in Physical AI: A Literature Review of Runtime Action Authorization for Autonomous Systems23 May 2026
- 2026Recursive Belief Vision Language Action Models24 Feb 2026
- 2026Self-Supervised Bootstrapping of Action-Predictive Embodied Reasoning9 Feb 2026
- 20263D CoCa v2: Contrastive Learners with Test-Time Search for Generalizable Spatial Intelligence10 Jan 2026
- 2026AnyDepth: Depth Estimation Made Easy6 Jan 2026
- 2025Memory in the Age of AI Agents15 Dec 2025
- 2025EgoLCD: Egocentric Video Generation with Long Context Diffusion4 Dec 2025
- 2025MobileVLA-R1: Reinforcing Vision-Language-Action for Mobile Robots22 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulation
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2026SARM2: Multi-Task Stage Aware Reward Modeling for Self Improving Robotic Manipulation
- 2026EvoMem-VLA: State-Evolution Memory for Long-Horizon Robot Manipulation
- 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models
- 2026ChainVLA: Chaining Vision-Language-Action Queries through a Unified Execution State for Long-Horizon Manipulation
- 2026NS-VLA: Towards Neuro-Symbolic Vision-Language-Action Models
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation