LEEVLA: Seeing What Matters in Latent Environment Evolution for Vision-Language-Action
On the map: Vision-language-action models → World model-based VLA
Abstract (arXiv)
Vision-language-action (VLA) models aim to map multimodal inputs to robot actions. However, most existing approaches struggle to cover complex dynamic scenarios due to treating all visual tokens uniformly and reasoning with human-selected factors, which lack mechanisms to emphasize task-critical evidence and ignore underlying factors. To address this issue, we propose LEEVLA, a VLA architecture for seeing what matters in Latent Environment Evolution that explicitly guides the model toward informative regions while preserving the structured evolution of latent world representations. To identify salient and instruction-relevant regions, we introduce drift-guided dynamic prioritization (DGDP), which combines dynamic position prioritization (DPP) with semantic drift guidance (SDG) to guide the VLA agent where to attend during training. On top of this, we introduce structured feature flow generation (SFFG), which models how these prioritized features should evolve in latent space via prototype-to-periphery (P2P) prediction, and a mutual-neighborhood contrastive (MC) loss to maintain topological consistency among neighborhoods. Together, DGDP and SFFG form a task-aware "where-how" training framework. Extensive experiments on VLA benchmarks show that LEEVLA consistently outperforms prior methods, confirming that explicit task-evidence guidance and structured latent reasoning are both crucial for scalable VLA. Our code is available at https://github.com/LyuQi127/LEEVLA.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in World model-based VLA, one of 13 directions in Vision-language-action models. Builds on 43 of its 56 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
43 of 56 references.
Closest ancestors · 2
Same direction, newest first
- 2026World Action Models are Zero-shot Policies17 Feb
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledge6 Jul
Other references · 41
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
29 more
- 2024Genie: Generative Interactive Environmentscited by 706
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 218
- 2024RoboDreamer: Learning Compositional World Models for Robot Imaginationcited by 187
- 2024VLABench: A Large-Scale Benchmark for Language-Conditioned Robotics Manipulation with Long-Horizon Reasoning Taskscited by 171
- 2022CLIP-Fields: Weakly Supervised Semantic Fields for Robotic Memorycited by 164
- 2024Enhancing End-to-End Autonomous Driving with Latent World Modelcited by 161
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Bettercited by 142
- 2024iVideoGPT: Interactive VideoGPTs are Scalable World Modelscited by 136
- 2025Unified Vision-Language-Action Modelcited by 128
- 2020Leakage-Adjusted Simulatability: Can Models Generate Non-Trivial Explanations of Their Behavior in Natural Language?cited by 95
- 2025Universal Actions for Enhanced Embodied Foundation Modelscited by 80
- 2025FLOWER: Democratizing Generalist Robot Policies with Efficient Vision-Language-Action Flow Policiescited by 56
- 2024Learning by Reconstruction Produces Uninformative Features For Perceptioncited by 54
- 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extractioncited by 54
- 2021What to Learn, and How: Toward Effective Learning from Rationalescited by 25
- 2025Efficient Robotic Policy Learning via Latent Space Backward Planningcited by 14
- 2022Learning General World Models in a Handful of Reward-Free Deploymentscited by 12
- 2025Compressor-VLA: Instruction-Guided Visual Token Compression for Efficient Robotic Manipulationcited by 7
- 2026SeqWalker: Sequential-Horizon Vision-and-Language Navigation with Hierarchical Planningcited by 3
- 2026SAB-LVLM: Significance-Aware Binarization for Large Vision-Language Modelscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026PriorVLA: Prior-Preserving Adaptation for Vision-Language-Action Models
- 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variation
- 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Models
- 2026ViDAL: A Visual Dynamics-Grounded Action Latent Space for Vision-Language-Action Models
- 2026DIAL: Decoupling Intent and Action via Latent World Modeling for End-to-End VLA
- 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention
- 2026Wall-OSS-0.5 Technical Report
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specialization