Representation World Model: Learning States, Transition and Executable Plans in Representation
On the map: World models → Embodied and robot world models also fits: Latent predictive world models
Abstract (arXiv)
We propose the Representation World Model (RWM), which learns states, transitions, and executable plans directly in representation space. Unlike existing world models that typically learn latent representations together with explicit dynamics models and perform planning through search, optimization, or policy-based prediction, RWM directly incorporates planning into the learned representation geometry. RWM learns the representation geometry by applying inverse-dynamics supervision locally along latent paths constructed from endpoint representations, requiring these paths to preserve task-relevant state and transition information. At inference, planning is performed by directly constructing a latent path between the current and goal representations, with inverse dynamics used to recover the corresponding actions, without recursive rollouts or action-space search. Experiments on continuous-control benchmarks demonstrate the effectiveness of RWM for direct planning, while results on robotic manipulation further show its potential to extend to more complex embodied control tasks. These results suggest that planning directly in representation space provides a promising alternative to conventional world-model planning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 32 of its 34 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
32 of 34 references.
Closest ancestors · 1
Same direction, newest first
Other references · 31
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2018Unsupervised Feature Learning via Non-Parametric Instance-level Discriminationcited by 1,845
- 2021Barlow Twins: Self-Supervised Learning via Redundancy Reductioncited by 1,838
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
19 more
- 2018World Modelscited by 1,513
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,353
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,057
- 2020Mastering Atari with Discrete World Modelscited by 1,007
- 2021iBOT: Image BERT Pre-Training with Online Tokenizercited by 903
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024Genie: Generative Interactive Environmentscited by 747
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 386
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
- 2026Causal-JEPA: Learning World Models through Object-Level Latent Maskingcited by 29
- 2026Predictive but Not Plannable: RC-aux for Latent World Modelscited by 19
- 2026Latent Geometry Beyond Search: Amortizing Planning in World Modelscited by 15
- 2026Fast LeWorldModelcited by 15
- 2026PRISM: PRior-guided Imagination Sampling in world Modelscited by 8
- 2026No Gaussian Required: Contrastive Inverse Dynamics for JEPA World Modelscited by 5
- 2026Qantara: Bridge-Flow Training for Multi-Paradigm JEPA Controlcited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Rethinking Representations for World-Action Modeling
- 2026Hierarchical Planning with Latent World Models
- 2026Decoupling Intention from Trajectory: A Representational Deduction Framework for World Action Models
- 2026The Planning Limits of Latent World Models
- 2026Unifying Object-Centric World Models and Diffusion Policy: A Hierarchical Framework for Multi-Stage Robotic Tasks
- 2025MoWM: Mixture-of-World-Models for Embodied Planning via Latent-to-Pixel Feature Modulation
- 2026SG-WAM: Self-Guided World Modeling in Geometry-Aware Policy Space
- 2026World Models for Robotic Manipulation: A Survey