mlsanityData to 14 Oct 2026

LiLa-WAM: Lightweight Latent Reasoning World-Action Model for Robotic Manipulation

arXiv 2608.03701 ↗First posted 4 Aug 2026cs.RO cs.AIcited by 9

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World-action modeling has emerged as a promising paradigm for robotic control, as it empowers models to go beyond reacting to observations and anticipate how a scene will evolve. However, existing WAMs often incur substantial computational overhead. Pixel-space methods often allocate substantial capacity to visual details that may not be directly relevant to control, while some latent-space methods require multi-stage training to construct the reasoning space. The resulting training cost can make such methods difficult to train under modest computational budgets. In this work, we propose LiLa-WAM, a lightweight world-action model that reasons about the future in a compact latent space and can be trained end-to-end on a single 24GB GPU. Its core design is a compact latent reasoning space jointly shaped by future-state prediction and action generation, which keeps the model lightweight while remaining well aligned with control. For task specification, we further propose the Visual Transition Token(VTT), a language-free task representation that encodes each task as a direction in visual feature space. Experiments on RoboTwin~2.0, LIBERO, and real-robot tasks demonstrate LiLa-WAM's effectiveness, achieving 90.48% success across 50 RoboTwin tasks with single-GPU training.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 55 of its 56 references that are in the map. First posted on arXiv 4 Aug 2026.

Builds on

55 of 56 references.

Closest ancestors · 19

Same direction, newest first

  1. 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun
  2. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies14 Jun
  3. 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing8 Jun
  4. 2026WALL-WM: Carving World Action Modeling at the Event Joints1 Jun
  5. 2026World Action Models: The Next Frontier in Embodied AI12 May
  6. 2026Being-H0.7: A Latent World-Action Model from Egocentric Videos30 Apr
  7. 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developing6 Apr
  8. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
  9. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  10. 2026World Guidance: World Modeling in Condition Space for Action Generation25 Feb
  11. 2026FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignment19 Feb
  12. 2026Causal World Modeling for Robot Control29 Jan
7 more
  1. 2025Act2Goal: From World Model To General Goal-conditioned Policy29 Dec
  2. 2025Motus: A Unified Latent Action World Model15 Dec
  3. 2025Goal-VLA: Image-Generative VLMs as Object-Centric World Models Empowering Zero-shot Robot Manipulation30 Jun
  4. 2025WorldVLA: Towards Autoregressive Action World Model26 Jun
  5. 2025FLARE: Robot Learning with Implicit World Modeling21 May
  6. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
  7. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar

Other references · 36

  1. 2016Feature Pyramid Networks for Object Detectioncited by 5,036
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  3. 2025Qwen3-VL Technical Reportcited by 2,793
  4. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  7. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  8. 2025DINOv3cited by 1,414
  9. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  10. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  12. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
24 more
  1. 2024PaliGemma: A versatile 3B VLM for transfercited by 696
  2. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  3. 2022Vision Transformer Adapter for Dense Predictionscited by 565
  4. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
  5. 2023Learning Universal Policies via Text-Guided Video Generationcited by 522
  6. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  7. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  8. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
  9. 2024Latent Action Pretraining from Videoscited by 321
  10. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
  11. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  12. 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
  13. 2025Unified Video Action Modelcited by 205
  14. 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 142
  15. 2026π0.7: a Steerable Generalist Robotic Foundation Model with Emergent Capabilitiescited by 138
  16. 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 137
  17. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
  18. 2025Vidar: Embodied Video Diffusion Model for Generalist Manipulationcited by 62
  19. 2025Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructionscited by 51
  20. 2024RT-Sketch: Goal-Conditioned Imitation Learning from Hand-Drawn Sketchescited by 41
  21. 2025Evo-1: Lightweight Vision-Language-Action Model with Preserved Semantic Alignmentcited by 41
  22. 2025GEVRM: Goal-Expressive Video Generation Model For Robust Visual Manipulationcited by 27
  23. 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Modelscited by 24
  24. 2024VIP: Vision Instructed Pre-training for Robotic Manipulationcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 9.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026MemoryWAM: Efficient World Action Modeling with Persistent Memory
  2. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
  3. 2026RM-WAM: Reliable Memory-Augmented World Action Models for Long-Horizon Robot Manipulation
  4. 2026Latent Action as Intention Enables Efficient Future Imagination for World Action Models
  5. 2026STARRY: Spatial-Temporal Action-Centric World Modeling for Robotic Manipulation
  6. 2026SmolWAM: A Latent World-Action Model for Robotic Manipulation on Edge Devices
  7. 2026Light-WAM: Efficient World Action Models with State-Fusion Action Decoding
  8. 2026PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulation