mlsanityData to 7 Oct 2026

LEEVLA: Seeing What Matters in Latent Environment Evolution for Vision-Language-Action

arXiv 2607.08182 ↗First posted 9 Jul 2026cs.CV cs.AIcited by 0

On the map: Vision-language-action models → World model-based VLA

Abstract (arXiv)

Vision-language-action (VLA) models aim to map multimodal inputs to robot actions. However, most existing approaches struggle to cover complex dynamic scenarios due to treating all visual tokens uniformly and reasoning with human-selected factors, which lack mechanisms to emphasize task-critical evidence and ignore underlying factors. To address this issue, we propose LEEVLA, a VLA architecture for seeing what matters in Latent Environment Evolution that explicitly guides the model toward informative regions while preserving the structured evolution of latent world representations. To identify salient and instruction-relevant regions, we introduce drift-guided dynamic prioritization (DGDP), which combines dynamic position prioritization (DPP) with semantic drift guidance (SDG) to guide the VLA agent where to attend during training. On top of this, we introduce structured feature flow generation (SFFG), which models how these prioritized features should evolve in latent space via prototype-to-periphery (P2P) prediction, and a mutual-neighborhood contrastive (MC) loss to maintain topological consistency among neighborhoods. Together, DGDP and SFFG form a task-aware "where-how" training framework. Extensive experiments on VLA benchmarks show that LEEVLA consistently outperforms prior methods, confirming that explicit task-evidence guidance and structured latent reasoning are both crucial for scalable VLA. Our code is available at https://github.com/LyuQi127/LEEVLA.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World model-based VLA, one of 13 directions in Vision-language-action models. Builds on 43 of its 56 references that are in the map. First posted on arXiv 9 Jul 2026.

Builds on

43 of 56 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026World Action Models are Zero-shot Policies17 Feb
  2. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledge6 Jul

Other references · 41

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  2. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  3. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  6. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  7. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  8. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  9. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  10. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  11. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
  12. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
29 more
  1. 2024Genie: Generative Interactive Environmentscited by 706
  2. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  3. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  4. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  5. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  6. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  7. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  8. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
  9. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
  10. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 218
  11. 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 187
  12. 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
  13. 2022CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memorycited by 164
  14. 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 161
  15. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
  16. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 142
  17. 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 136
  18. 2025Unified Vision-Language-Action Modelcited by 128
  19. 2020Leakage-Adjusted Simulatability: Can Models Generate Non-Trivial Explanations of Their Behavior in Natural Language?cited by 95
  20. 2025Universal Actions for Enhanced Embodied Foundation Modelscited by 80
  21. 2025FLOWER: Democratizing Generalist Robot Policies with Efficient Vision-Language-Action Flow Policiescited by 56
  22. 2024Learning by Reconstruction Produces Uninformative Features For Perceptioncited by 54
  23. 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extractioncited by 54
  24. 2021What to Learn, and How: Toward Effective Learning from Rationalescited by 25
  25. 2025Efficient Robotic Policy Learning via Latent Space Backward Planningcited by 14
  26. 2022Learning General World Models in a Handful of Reward-Free Deploymentscited by 12
  27. 2025Compressor-VLA: Instruction-Guided Visual Token Compression for Efficient Robotic Manipulationcited by 7
  28. 2026SeqWalker: Sequential-Horizon Vision-and-Language Navigation with Hierarchical Planningcited by 3
  29. 2026SAB-LVLM: Significance-Aware Binarization for Large Vision-Language Modelscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PriorVLA: Prior-Preserving Adaptation for Vision-Language-Action Models
  2. 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variation
  3. 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Models
  4. 2026ViDAL: A Visual Dynamics-Grounded Action Latent Space for Vision-Language-Action Models
  5. 2026DIAL: Decoupling Intent and Action via Latent World Modeling for End-to-End VLA
  6. 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention
  7. 2026Wall-OSS-0.5 Technical Report
  8. 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specialization