One Token Per Frame: Reconsidering Visual Bandwidth in World Models for VLA Policy
On the map: World models → Embodied and robot world models
also in 1 more
Abstract (arXiv)
Vision-language-action (VLA) models can use visual prediction to anticipate future states, but dense visual features make the generative sequence grow with the number of camera views, prediction horizon, and encoder resolution. Whether such dense representations are necessary for effective control remains unclear. We introduce OneWM-VLA, which represents each retained camera view with one predictive token per future step. Adaptive Attention Pooling compresses visual features into compact latents, which are jointly generated with robot actions under a conditional flow-matching objective. Future observations provide the latent targets during training and are not required at inference. This design incorporates visual prediction into a pretrained VLA policy while keeping the generative sequence compact. On MetaWorld~MT50, OneWM-VLA improves the average success rate of the π0 backbone from 47.91% to 61.53%, reaching 72.01% after 60k training steps. It also achieves 98.1% success on LIBERO and raises Fold Cloth success on a real Piper arm from 20.0% to 60.0% relative to π0. Comparisons on two additional VLA backbones consistently favor one token over three across the evaluated checkpoints. A matched ablation at a longer action horizon further shows that removing the latent loss reduces success from 58.09% to 21.64%, supporting the benefit of future supervision for policy learning.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 54 of its 60 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
54 of 60 references.
Closest ancestors · 7
Same direction, newest first
- 2025RynnVLA-002: A Unified Vision-Language-Action and World Model21 Nov
- 2025World-Env: Leveraging World Model as a Virtual Environment for VLA Post-Training29 Sep
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
- 2025DreamGen: Unlocking Generalization in Robot Learning through Video World Models19 May
- 20243D-VLA: A 3D Vision-Language-Action Generative World Model14 Mar
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
- 2022Masked World Models for Visual Control28 Jun
Other references · 47
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
35 more
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 678
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2022VIP: Towards Universal Visual Reward and Representation via Value-Implicit Pre-Trainingcited by 384
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 279
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 237
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
- 2023LIV: Language-Image Representations and Rewards for Robotic Controlcited by 180
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
- 2025Training Agents Inside of Scalable World Modelscited by 122
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
- 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 80
- 2024Prediction with Action: Visual Policy Learning via Joint Denoising Processcited by 64
- 2025VLA-0: Building State-of-the-Art VLAs with Zero Modificationcited by 49
- 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Modelscited by 38
- 2025Meta-World+: An Improved, Standardized, RL Benchmarkcited by 37
- 2025Latent Diffusion Planning for Imitation Learningcited by 26
- 2025RynnVLA-001: Using Human Demonstrations to Improve Robot Manipulationcited by 24
- 2024DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learningcited by 19
- 2025Efficient Robotic Policy Learning via Latent Space Backward Planningcited by 14
- 2024Efficient and Generalized end-to-end Autonomous Driving System with Latent Deep Reinforcement Learning and Demonstrationscited by 7
- 2024VLASCD: A Visual Language Action Model for Simultaneous Chatting and Decision Makingcited by 5
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Modelcited by 28
- 2026ALAM: Algebraically Consistent Latent Action Model for Vision-Language-Action Modelscited by 3
- 2026DLAM: Distributional Latent Actions with Temporal Constraintscited by 1
- 2026World Tokens: Enhancing Embodied Policies with Training-Time World Modelingcited by 1
- 2026SLIM-0.5B: Learning Action-Grounded Predictive Latents for Robot Manipulationcited by 0
- 2026Token-World: World Modeling in Vision-Language Model Token Space for Robot Manipulationcited by 0
- 2026Token-World: World Modeling in Vision-Language Model Token Space for Robot Manipulation30 Sep 2026
- 2026SLIM-0.5B: Learning Action-Grounded Predictive Latents for Robot Manipulation10 Aug 2026
- 2026World Tokens: Enhancing Embodied Policies with Training-Time World Modeling10 Aug 2026
- 2026DLAM: Distributional Latent Actions with Temporal Constraints29 Jul 2026
- 2026ABot-M0.5: Unified Mobility-and-Manipulation World Action Model1 Jul 2026
- 2026ALAM: Algebraically Consistent Latent Action Model for Vision-Language-Action Models11 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model
- 2026StreamingVLA: Streaming Vision-Language-Action Model with Action Flow Matching and Adaptive Early Observation
- 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalization
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
- 2026Beyond World-Frame Action Heads: Motion-Centric Action Frames for Vision-Language-Action Models
- 2026Devol-ONE: One Autoregressive Mixture of Transformers to Unify Vision-Language-Action and Latent World Modeling
- 2026Chain of World: World Model Thinking in Latent Motion