mlsanityData to 14 Oct 2026

STRIPS-WM: Learning Grounded Propositional STRIPS-style World Models from Images

arXiv 2606.06832 ↗First posted 5 Jun 2026cs.ROcited by 0

On the map: World models → Embodied and robot world models

Abstract (arXiv)

Robots performing long-horizon visual manipulation observe high-dimensional images, but successful plans depend on action-relevant facts: what can be done now and what changes afterward. A useful planning representation should discard irrelevant visual details while preserving action applicability and effects. Classical task planners exploit this structure through symbolic operators with preconditions and effects, but obtaining such representations from raw visual experience remains challenging. We study a visual task-planning setting in which a robot receives only image transitions: the current image, executed high-level action, and the resulting image. At test time, given a start image and a goal image, the robot must produce a sequence of high-level actions that reaches the goal. To address this problem, we introduce STRIPS-WM, a framework for learning image-grounded STRIPS-style world models directly from visual transitions. STRIPS-WM first induces a finite abstract transition graph from images, then learns latent binary predicates and one grounded propositional operator per action label. The learned operators form a symbolic action model with sparse preconditions and add/delete effects. Finally, the learned predicates are distilled into a visual encoder, enabling classical planning directly from novel start and goal images. Experiments on visual rearrangement tasks show that STRIPS-WM improves image-to-plan success over the tested visual rollout, latent graph-search and latent-symbolic baselines.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 6 of its 29 references that are in the map. First posted on arXiv 5 Jun 2026.

Builds on

6 of 29 references.

References · 6

  1. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
  2. 2019Contrastive Learning of Structured World Modelscited by 209
  3. 2019Learning First-Order Symbolic Representations for Planning from the Structure of the State Spacecited by 38
  4. 2018Universal Planning Networkscited by 30
  5. 2024From Real World to Logic and Back: Learning Generalizable Relational Concepts For Long Horizon Robot Planningcited by 9
  6. 2025Learning Discrete Abstractions for Visual Rearrangement Tasks Using Vision-Guided Graph Coloringcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024From Pixels to Predicates: Learning Symbolic World Models via Pretrained Vision-Language Models
  2. 2026Rethinking World-Action Model for Compositional and In-Context Robotic Manipulation
  3. 2026Thinking in Text and Images: Interleaved Vision--Language Reasoning Traces for Long-Horizon Robot Manipulation
  4. 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model
  5. 2026SWEET: Sparse World Modeling with Image Editing for Embodied Task Execution
  6. 2026InternW0-Δ: A World Action Model Bridging Predictive Dynamics and Actions with 20K+ Hours of Open Data
  7. 2026PACT-WAM: Predicting Actions and Visual Foresight with Compact Temporal Encoding for Robot Manipulation
  8. 2024VisualPredicator: Learning Abstract World Models with Neuro-Symbolic Predicates for Robot Planning