mlsanityData to 7 Oct 2026

Visual Foresight for Robotic Stow: A Diffusion-Based World Model from Sparse Snapshots

arXiv 2602.13347 ↗First posted 12 Feb 2026cs.CV cs.AI cs.ROcited by 0

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Automated warehouses execute millions of stow operations, where robots place objects into storage bins. For these systems it is valuable to anticipate how a bin will look from the current observations and the planned stow behavior before real execution. We propose FOREST, a stow-intent-conditioned world model that represents bin states as item-aligned instance masks and uses a latent diffusion transformer to predict the post-stow configuration from the observed context. Our evaluation shows that FOREST substantially improves the geometric agreement between predicted and true post-stow layouts compared with heuristic baselines. We further evaluate the predicted post-stow layouts in two downstream tasks, in which replacing the real post-stow masks with FOREST predictions causes only modest performance loss in load-quality assessment and multi-stow reasoning, indicating that our model can provide useful foresight signals for warehouse planning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 19 of its 25 references that are in the map. First posted on arXiv 12 Feb 2026.

Builds on

19 of 25 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025LaDi-WM: A Latent Diffusion-based World Model for Predictive Manipulation13 May

Other references · 18

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  3. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  4. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,598
  5. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  6. 2018Recurrent World Models Facilitate Policy Evolutioncited by 761
  7. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 337
  8. 2024Diffusion for World Modeling: Visual Details Matter in Ataricited by 285
  9. 2016Deep Visual Foresight for Planning Robot Motioncited by 276
  10. 2024Navigation World Modelscited by 262
  11. 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 220
  12. 2019Understanding and Improving Layer Normalizationcited by 213
6 more
  1. 2023SAM3D: Segment Anything in 3D Scenescited by 155
  2. 2016Analysis and Observations from the First Amazon Picking Challengecited by 41
  3. 2019Improvisation through Physical Understanding: Using Novel Objects as Tools with Visual Foresightcited by 34
  4. 2017Cartman: The low-cost Cartesian Manipulator that won the Amazon Robotics Challengecited by 19
  5. 2023Predicting Object Interactions with Behavior Primitives: An Application in Stowing Taskscited by 12
  6. 2025Stow: Robotic Packing of Items into Fabric Podscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulation
  2. 2025GUIDE: A Diffusion-Based Autonomous Robot Exploration Framework Using Global Graph Inference
  3. 2026Beyond Dense Futures: World Models as Structured Planners for Robotic Manipulation
  4. 2025IndustryNav: Exploring Spatial Reasoning of Embodied Agents in Dynamic Industrial Navigation
  5. 2026VLM-DEWM: Dynamic External World Model for Verifiable and Resilient Vision-Language Planning in Manufacturing
  6. 2026PackLab: A Comprehensive Framework for Developing, Training, and Evaluating MLLMs in Robotic Bin Packing ↗
  7. 2026Unifying Object-Centric World Models and Diffusion Policy: A Hierarchical Framework for Multi-Stage Robotic Tasks
  8. 2026DeltaWAM: Change-Centric Visual Foresight via Delta Tokens for an Efficient World-Action Model