mlsanityData to 14 Oct 2026

Box-WAM: Box Trajectories as Compact State Representations for World Action Models

arXiv 2610.17526 ↗First posted 13 Oct 2026cs.RO cs.AIcited by 0

On the map: World models → Embodied and robot world models

Abstract (arXiv)

World action models (WAMs) are a category of policy models that ex- plicitly predict both actions and future world states. They have been shown to outperform action-only models across various robotic manipulation tasks. How- ever, representing the future with full-frame video prediction can be computation- ally expensive during both training and inference. This raises a central question: what compact state representation preserves the planning and supervision bene- fits of future prediction? In this paper, we propose BoxWAM, which replaces dense future frames with oriented bounding box trajectories of task-relevant ob- jects. By explicitly imagining object-centric future motion, our method provides a lightweight prediction target that captures the key physical changes induced by robot actions. We show that box trajectory prediction substantially reduces com- putational cost while improving action prediction performance, suggesting that object-centric compact states can serve as an efficient alternative to video-based world action modeling for robotic manipulation. Result videos can be found on https://box-wam.github.io

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 56 of its 60 references that are in the map. First posted on arXiv 13 Oct 2026.

Builds on

56 of 60 references.

Closest ancestors · 8

Same direction, newest first

  1. 2026Mask World Model: Predicting What Matters for Robust Robot Policy Learning21 Apr
  2. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  3. 2026World Action Models are Zero-shot Policies17 Feb
  4. 2026Causal World Modeling for Robot Control29 Jan
  5. 2025Motus: A Unified Latent Action World Model15 Dec
  6. 2025TraceGen: World Modeling in 3D Trace Space Enables Learning from Cross-Embodiment Videos26 Nov
  7. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
  8. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar

Other references · 48

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  3. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  5. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  7. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  8. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  9. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  10. 2025DINOv3cited by 1,414
  11. 2022Planning-oriented Autonomous Drivingcited by 1,087
  12. 2020Mastering Atari with Discrete World Modelscited by 1,007
36 more
  1. 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
  2. 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
  3. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  4. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
  5. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
  6. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  7. 2023Learning Interactive Real-World Simulatorscited by 458
  8. 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 397
  9. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
  10. 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 344
  11. 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
  12. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
  13. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  14. 2016Deep Visual Foresight for Planning Robot Motioncited by 285
  15. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
  16. 2021End-to-end Interpretable Neural Motion Plannercited by 242
  17. 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 230
  18. 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 209
  19. 2025Unified Video Action Modelcited by 205
  20. 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 189
  21. 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
  22. 2015Deep Spatial Autoencoders for Visuomotor Learningcited by 153
  23. 2019kPAM: KeyPoint Affordances for Category-Level Robotic Manipulationcited by 153
  24. 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 153
  25. 2018Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulationcited by 142
  26. 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 137
  27. 2025Training Agents Inside of Scalable World Modelscited by 136
  28. 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 128
  29. 2025Video Generators are Robot Policiescited by 92
  30. 2019KETO: Learning Keypoint Representations for Tool Manipulationcited by 69
  31. 2020DSDNet: Deep Structured self-Driving Networkcited by 62
  32. 2023Learning Generalizable Manipulation Policies with Object-Centric 3D Representationscited by 61
  33. 2025What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?cited by 43
  34. 2019Learning Robotic Manipulation through Visual Planning and Actingcited by 41
  35. 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Placecited by 41
  36. 2025MimicFunc: Imitating Tool Manipulation from a Single Human Video via Functional Correspondencecited by 13

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
  2. 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
  3. 2026MoWAM: Explicit Future Motion Prediction for Efficient World Action Models
  4. 2026Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination
  5. 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulation
  6. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  7. 2026DeltaWAM: Distilling Action Tangent Fields into World Action Models
  8. 2026RepWAM: World Action Modeling with Representation Visual-Action Tokenizers