Box-WAM: Box Trajectories as Compact State Representations for World Action Models
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World action models (WAMs) are a category of policy models that ex- plicitly predict both actions and future world states. They have been shown to outperform action-only models across various robotic manipulation tasks. How- ever, representing the future with full-frame video prediction can be computation- ally expensive during both training and inference. This raises a central question: what compact state representation preserves the planning and supervision bene- fits of future prediction? In this paper, we propose BoxWAM, which replaces dense future frames with oriented bounding box trajectories of task-relevant ob- jects. By explicitly imagining object-centric future motion, our method provides a lightweight prediction target that captures the key physical changes induced by robot actions. We show that box trajectory prediction substantially reduces com- putational cost while improving action prediction performance, suggesting that object-centric compact states can serve as an efficient alternative to video-based world action modeling for robotic manipulation. Result videos can be found on https://box-wam.github.io
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 56 of its 60 references that are in the map. First posted on arXiv 13 Oct 2026.
Builds on
56 of 60 references.
Closest ancestors · 8
Same direction, newest first
- 2026Mask World Model: Predicting What Matters for Robust Robot Policy Learning21 Apr
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
- 2026World Action Models are Zero-shot Policies17 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2025Motus: A Unified Latent Action World Model15 Dec
- 2025TraceGen: World Modeling in 3D Trace Space Enables Learning from Cross-Embodiment Videos26 Nov
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning11 Jun
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
Other references · 48
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2025DINOv3cited by 1,414
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2020Mastering Atari with Discrete World Modelscited by 1,007
36 more
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2018Recurrent World Models Facilitate Policy Evolutioncited by 785
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2023Learning Interactive Real-World Simulatorscited by 458
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worstcited by 397
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
- 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 344
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
- 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 300
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2016Deep Visual Foresight for Planning Robot Motioncited by 285
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
- 2021End-to-end Interpretable Neural Motion Plannercited by 242
- 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 230
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 209
- 2025Unified Video Action Modelcited by 205
- 2023GELLO: A General, Low-Cost, and Intuitive Teleoperation Framework for Robot Manipulatorscited by 189
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
- 2015Deep Spatial Autoencoders for Visuomotor Learningcited by 153
- 2019kPAM: KeyPoint Affordances for Category-Level Robotic Manipulationcited by 153
- 2024Gen2Act: Human Video Generation in Novel Scenarios enables Generalizable Robot Manipulationcited by 153
- 2018Dense Object Nets: Learning Dense Visual Object Descriptors By and For Robotic Manipulationcited by 142
- 2025Genie Envisioner: A Unified World Foundation Platform for Robotic Manipulationcited by 137
- 2025Training Agents Inside of Scalable World Modelscited by 136
- 2025EgoVLA: Learning Vision-Language-Action Models from Egocentric Human Videoscited by 128
- 2025Video Generators are Robot Policiescited by 92
- 2019KETO: Learning Keypoint Representations for Tool Manipulationcited by 69
- 2020DSDNet: Deep Structured self-Driving Networkcited by 62
- 2023Learning Generalizable Manipulation Policies with Object-Centric 3D Representationscited by 61
- 2025What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?cited by 43
- 2019Learning Robotic Manipulation through Visual Planning and Actingcited by 41
- 2023M2T2: Multi-Task Masked Transformer for Object-centric Pick and Placecited by 41
- 2025MimicFunc: Imitating Tool Manipulation from a Single Human Video via Functional Correspondencecited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026DELE-w0.5: Inferring Action from Future Latent State for Robotic Manipulation
- 2026τ0-WM: A Unified Video-Action World Model for Robotic Manipulation
- 2026MoWAM: Explicit Future Motion Prediction for Efficient World Action Models
- 2026Efficient-WAM: A 1B-Parameter World-Action Model with Low-Cost Future Imagination
- 2026Copper-Policy: Focus on the Representation for Robust Robot Manipulation
- 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
- 2026DeltaWAM: Distilling Action Tangent Fields into World Action Models
- 2026RepWAM: World Action Modeling with Representation Visual-Action Tokenizers