LiLa-WAM: Lightweight Latent Reasoning World-Action Model for Robotic Manipulation
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World-action modeling has emerged as a promising paradigm for robotic control, as it empowers models to go beyond reacting to observations and anticipate how a scene will evolve. However, existing WAMs often incur substantial computational overhead. Pixel-space methods often allocate substantial capacity to visual details that may not be directly relevant to control, while some latent-space methods require multi-stage training to construct the reasoning space. The resulting training cost can make such methods difficult to train under modest computational budgets. In this work, we propose LiLa-WAM, a lightweight world-action model that reasons about the future in a compact latent space and can be trained end-to-end on a single 24GB GPU. Its core design is a compact latent reasoning space jointly shaped by future-state prediction and action generation, which keeps the model lightweight while remaining well aligned with control. For task specification, we further propose the Visual Transition Token(VTT), a language-free task representation that encodes each task as a direction in visual feature space. Experiments on RoboTwin~2.0, LIBERO, and real-robot tasks demonstrate LiLa-WAM's effectiveness, achieving 90.48% success across 50 RoboTwin tasks with single-GPU training.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 55 of its 56 references that are in the map. First posted on arXiv 4 Aug 2026.
Builds on
55 of 56 references.
Closest ancestors · 19
Same direction, newest first
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun
- 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies14 Jun
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing8 Jun
- 2026WALL-WM: Carving World Action Modeling at the Event Joints1 Jun
- 2026World Action Models: The Next Frontier in Embodied AI12 May
- 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos30 Apr
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Guidance: World Modeling in Condition Space for Action Generation25 Feb
- 2026FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignment19 Feb
- 2026Causal World Modeling for Robot Control29 Jan
7 more
- 2025Act2Goal: From World Model To General Goal-conditioned Policy29 Dec
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025Goal-VLA: Image-Generative VLMs as Object-Centric World Models Empowering Zero-shot Robot Manipulation30 Jun
- 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
- 2025FLARE: Robot Learning with Implicit World Modeling21 May
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
Other references · 36
- 2016Feature Pyramid Networks for Object Detectioncited by 5,036
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2025DINOv3cited by 1,414
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
24 more
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2022Vision Transformer Adapter for Dense Predictionscited by 565
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 2024Latent Action Pretraining from Videoscited by 321
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2025Unified Video Action Modelcited by 205
- 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 142
- 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 138
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 137
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
- 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulationcited by 62
- 2025Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructionscited by 51
- 2024RT-Sketch: Goal-Conditioned Imitation Learning from Hand-Drawn Sketchescited by 41
- 2025Evo-1: Lightweight Vision-Language-Action Model with Preserved Semantic Alignmentcited by 41
- 2025GEVRM: Goal-Expressive Video Generation Model For Robust Visual Manipulationcited by 27
- 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Modelscited by 24
- 2024VIP: Vision Instructed Pre-training for Robotic Manipulationcited by 11
Built on by
Citing papers per year: 2026: 9.
9 papers.
- 2026Show-Harness: Just a VLM Agent Can Play Robotscited by 20
- 2026GlanceWAM: Sparse Test-Time Imagination for World-Action Modelscited by 3
- 2026Rethinking Representations for World-Action Modelingcited by 1
- 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Modelscited by 0
- 2026AR-WAM: A Visual-Conditioned Agent-Ready World Action Model for Robotic Manipulationcited by 0
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulationcited by 0
- 2026DeltaWAM: Change-Centric Visual Foresight via Delta Tokens for an Efficient World-Action Modelcited by 0
- 2026MVG-WAM: Multiple View Geometry-Aware World-Action Modeling for Robotic Manipulationcited by 0
- 2026Learning Skills from Historical Action Trajectories: Action Experience Dictionary for World Action Modelscited by 0
- 2026Learning Skills from Historical Action Trajectories: Action Experience Dictionary for World Action Models30 Sep 2026
- 2026Rethinking Representations for World-Action Modeling29 Sep 2026
- 2026MVG-WAM: Multiple View Geometry-Aware World-Action Modeling for Robotic Manipulation29 Sep 2026
- 2026DeltaWAM: Change-Centric Visual Foresight via Delta Tokens for an Efficient World-Action Model27 Sep 2026
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulation26 Sep 2026
- 2026AR-WAM: A Visual-Conditioned Agent-Ready World Action Model for Robotic Manipulation20 Sep 2026
- 2026The Right Future for Action: Learning Action-Relevant Predictive States in World Action Models20 Sep 2026
- 2026Show-Harness: Just a VLM Agent Can Play Robots9 Sep 2026
- 2026GlanceWAM: Sparse Test-Time Imagination for World-Action Models25 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory
- 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
- 2026RM-WAM: Reliable Memory-Augmented World Action Models for Long-Horizon Robot Manipulation
- 2026Latent Action as Intention Enables Efficient Future Imagination for World Action Models
- 2026STARRY: Spatial-Temporal Action-Centric World Modeling for Robotic Manipulation
- 2026SmolWAM: A Latent World-Action Model for Robotic Manipulation on Edge Devices
- 2026Light-WAM: Efficient World Action Models with State-Fusion Action Decoding
- 2026PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulation