mlsanityData to 7 Oct 2026

EvoVLA: Self-Evolving Vision-Language-Action Model

arXiv 2511.16166 ↗First posted 20 Nov 2025cs.CVcited by 11

On the map: Vision-language-action models → Reinforcement learning and post-training

Abstract (arXiv)

Long-horizon robotic manipulation remains challenging for Vision-Language-Action (VLA) models despite recent progress in zero-shot generalization and simulation-to-real-world transfer. Current VLA models suffer from stage hallucination, where agents exploit coarse evaluation signals to shortcut multi-step tasks, reporting high progress without truly completing them. We present EvoVLA, a self-supervised VLA framework that addresses this issue through three complementary components: Stage-Aligned Reward (SAR), which uses triplet contrastive learning with Gemini-generated hard negatives to prevent visual shortcuts; Pose-Based Object Exploration (POE), which grounds curiosity in relative object-gripper pose instead of raw pixels; and Long-Horizon Memory, which uses selective context retention and gated fusion to stabilize intrinsic shaping during extended rollouts. Extensive evaluations on Discoverse-L, a long-horizon manipulation benchmark with three multi-stage tasks, show that EvoVLA improves average task success by 10.2 percentage points over the strongest baseline (OpenVLA-OFT), reaching 69.2 percent. EvoVLA also achieves one-and-a-half times better sample efficiency and reduces stage hallucination from 38.5 percent to 14.8 percent. Real-world deployment on physical robots reaches an average success rate of 54.6 percent across four manipulation tasks, outperforming OpenVLA-OFT by 11 points, demonstrating effective sim-to-real transfer and strong generalization. Code: https://github.com/AIGeeksGroup/EvoVLA. Website: https://aigeeksgroup.github.io/EvoVLA.

Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 34 of its 56 references that are in the map. First posted on arXiv 20 Nov 2025.

Builds on

34 of 56 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Models2 Oct
  2. 2025VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulators1 Oct
  3. 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learning11 Sep
  4. 2025CO-RFT: Efficient Fine-Tuning of Vision-Language-Action Models through Chunked Offline Reinforcement Learning4 Aug
  5. 2025RFTF: Reinforcement Fine-tuning for Embodied Agents with Temporal Feedback26 May
  6. 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learning24 May
  7. 2025ReinboT: Amplifying Robot Visual-Language Manipulation with Reinforcement Learning12 May
  8. 2025ConRFT: A Reinforced Fine-tuning Method for VLA Models via Consistency Policy8 Feb
  9. 2025Improving Vision-Language-Action Model with Online Reinforcement Learning28 Jan
  10. 2024Octo: An Open-Source Generalist Robot Policy20 May

Other references · 24

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  4. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  6. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  7. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  8. 2015High-Dimensional Continuous Control Using Generalized Advantage Estimationcited by 1,916
  9. 2018Soft Actor-Critic Algorithms and Applicationscited by 1,179
  10. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
  11. 2018Exploration by Random Network Distillationcited by 966
  12. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
12 more
  1. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  2. 2024Titans: Learning to Memorize at Test Timecited by 303
  3. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
  4. 2024FLaRe: Achieving Masterful and Adaptive Robot Policies with Large-Scale Reinforcement Learning Fine-Tuningcited by 54
  5. 20253D-R1: Enhancing Reasoning in 3D VLMs for Unified Scene Understandingcited by 47
  6. 2025Nav-R1: Reasoning and Navigation in Embodied Scenescited by 37
  7. 2025ManipLVM-R1: Reinforcement Learning for Reasoning in Embodied Manipulation with Large Vision-Language Modelscited by 26
  8. 2025DC-Scene: Data-Centric Learning for 3D Scene Understandingcited by 15
  9. 20253D CoCa: Contrastive Learners are 3D Captionerscited by 13
  10. 2025DISCOVERSE: Efficient Robot Simulation in Complex High-Fidelity Environmentscited by 12
  11. 2025StereoAdapter: Adapting Stereo Depth Estimation to Underwater Scenescited by 8
  12. 2023ALP: Action-Aware Embodied Learning for Perceptioncited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 8.

11 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulation
  2. 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
  3. 2026SARM2: Multi-Task Stage Aware Reward Modeling for Self Improving Robotic Manipulation
  4. 2026EvoMem-VLA: State-Evolution Memory for Long-Horizon Robot Manipulation
  5. 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models
  6. 2026ChainVLA: Chaining Vision-Language-Action Queries through a Unified Execution State for Long-Horizon Manipulation
  7. 2026NS-VLA: Towards Neuro-Symbolic Vision-Language-Action Models
  8. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation