FlowMo-WM: A World Model with Object Momentum and Hidden Ambient Drift
On the map: World models → Embodied and robot world models
Abstract (arXiv)
World models in robot learning predict future states from visual observations and actions, enabling agents to reason about the consequences of their controls. However, many action-conditioned models are evaluated in settings where motion is dominated by immediate control, whereas aquatic surface vehicles and other real-world objects continue moving under inertia and are displaced by hidden ambient drift, such as water currents or wind. We propose FlowMo-WM, an end-to-end trainable visual world model that infers object-centric motion state and a predictive long-history context associated with hidden drift from image-action histories without direct supervision of flow fields. FlowMo-WM factorizes image-action history into a short-history latent state, trained to summarize object-centric motion, and a longer-history context, trained to summarize slowly varying exogenous influences. A zero-context residual transition separates action-conditioned base dynamics from context-dependent drift effects during latent rollout. In simulated aquatic surface-vehicle environments with diverse hidden flows, disturbances, and randomized vehicle dynamics, FlowMo-WM improves long-horizon rollout accuracy over representative action-conditioned latent world models. Prediction-time context ablations, in which the inferred context is zeroed or shuffled during rollout, show that the ambient context is important for stable prediction under hidden drift, while frozen linear probes characterize information encoded in the learned factors.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 25 of its 34 references that are in the map. First posted on arXiv 11 Jun 2026.
Builds on
25 of 34 references.
References · 25
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018World Modelscited by 1,513
- 2016Understanding intermediate layers using linear classifier probescited by 1,353
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,264
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 1,039
- 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 512
- 2022DayDreamer: World Models for Physical Robot Learningcited by 400
- 2022Temporal Difference Learning for Model Predictive Controlcited by 397
- 2019Efficient Off-Policy Meta-Reinforcement Learning via Probabilistic Context Variablescited by 389
- 2018An Intriguing Failing of Convolutional Neural Networks and the CoordConv Solutioncited by 307
13 more
- 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 273
- 2016Unsupervised Learning for Physical Interaction through Video Predictioncited by 260
- 2019VariBAD: A Very Good Method for Bayes-Adaptive Deep RL via Meta-Learningcited by 217
- 2016Deep Variational Bayes Filters: Unsupervised Learning of State Space Models from Raw Datacited by 156
- 2017Preparing for the Unknown: Learning a Universal Policy with Online System Identificationcited by 141
- 2017Self-Supervised Visual Planning with Temporal Skip Connectionscited by 139
- 2022Denoised MDPs: Learning World Models Better Than the World Itselfcited by 68
- 2019Variational Recurrent Models for Solving Partially Observable Control Taskscited by 47
- 2023Pre-training Contextualized World Models with In-the-wild Videos for Reinforcement Learningcited by 45
- 2022Agent-Controller Representations: Principled Offline RL with Rich Exogenous Informationcited by 16
- 2025Learning Interactive World Model for Object-Centric Reinforcement Learningcited by 11
- 2024SeePerSea: Multi-modal Perception Dataset of In-water Objects for Autonomous Surface Vehiclescited by 2
- 2024An Untethered Bioinspired Robotic Tensegrity Dolphin with Multi-Flexibility Design for Aquatic Locomotioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026AquaWAM: A Dynamics-aware World Action Model for Underwater Embodied Agents
- 2026Flow Equivariant World Models: Memory for Partially Observed Dynamic Environments
- 2026HarnessWAM: Bridging Prediction and Deliberation in World Action Models
- 2026Persistent Robot World Models: Stabilizing Multi-Step Rollouts via Reinforcement Learning
- 2026Foresight Without Seeing: Latent Futures for World Action Models
- 2026FBFM: A Training-Free Asynchronous Feedback Mechanism for Flow-Matching in World-Action Models Execution
- 2026DeltaWAM: Distilling Action Tangent Fields into World Action Models
- 2026Learning Transferable Dynamics Priors from Action to World Modeling