mlsanityData to 7 Oct 2026

Latent predictive world models

296 papers10 this weekLow confidence in this grouping: the papers may belong to more than one topic, or the group may changeLow confidence in this grouping: the papers may belong to more than one topic, or the group may change · About

Keywords: latent, physical, dynamics, planning, predictive

Key facts. Latent predictive world models: 296 papers on arXiv since 2014 (data through 7 Oct 2026). 103 of its 296 mapped papers (35%) cite “Learning Latent Dynamics for Planning from Pixels” (2018, arXiv 1811.04551). 79 of its 296 mapped papers (27%) cite “DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning” (2024, arXiv 2411.04983). 72 new papers 17 Sep–7 Oct.

What’s new

17 Sep – 7 Oct 2026

72 new papers, 17 Sep – 7 Oct; 10 this week.

  1. This week · 10
  2. Sparse Planning in Visual World Models via Cost Gradients
  3. LeCuration: A Tiny World Model as a Data Curation Multi-Tool also fits: World models for language agents
  4. Towards Financial World Modeling
  5. Directed Temporal Representations for Offline Visual Control also fits: Embodied and robot world models
  6. World Models' Last Exam in Physics also fits: Video-generation world models and simulators
  7. Parallel Predictive World Models for Accurate and Efficient Long-Horizon Planning
  8. Modeling Latent Disturbances for Robust Decision-Making in World Models also fits: Latent dynamics models and model-based RL
  9. Preserving Unstable Modes Through Inverse Dynamics in JEPA World Models
  10. Generative World Models Enable Predictive Control of Laser Melt Pool Dynamics
  11. EpicWorldModel: Exploration-driven Planning with Latent World Models
  12. Earlier · 62
All 72
  1. Identifiable World Models from Pretrained Diffusion Representations
  2. BeliefGraph-JEPA: Structured Latent World Models for Action-Conditioned Time Series
  3. Pythia: Toward Foundation World Models for Multimodal Time Series
  4. How Long, Not How Close: A Learned Temporal Metric for Planning in Latent World Models
  5. Frozen in a Frame: The Velocity Blind Spot in JEPA World Models
  6. LatentQuant: Preserving the Policy-Facing Latent Contract under NVFP4 VAE Quantization also fits: Embodied and robot world models
  7. AVL-JEPA: Preventing Causal Dynamics Information Collapse In Joint Embedding Predictive Architecture World Models
  8. Keeping JEPA World Models Plannable When Little of the Frame Moves also fits: Embodied and robot world models
  9. Counterfactual Action Evaluation, Observation Bottlenecks, and Representation Geometry in Joint-Embedding Predictive World Models
  10. Latent-Foresight: End-to-End Learning Predictable Representations for Latent World Models
  11. Learning Commute-Time-Preserving World Models for Planning
  12. Supervise What Decides Success: Criterion-Aligned Auxiliary Losses for Latent World-Model Planning also fits: Latent dynamics models and model-based RL
  13. CF-JEPA: Improving Robustness of JEPA World Models via Controllability Factorization also fits: Embodied and robot world models
  14. JEPA-TTT: Persistent Test-Time Training of Latent World Models for Planning under Dynamics Shifts
  15. DeepJEPA: Scaling World Models from Within
  16. Why Do Conventional World Models Fail to Learn Cellular Automata? also fits: Video-generation world models and simulators
  17. MEND: Label-Free Detection, Localisation, and Correction of Latent Hallucination in World Models also fits: Video-generation world models and simulators
  18. World-as-Graph: Relational World Modeling Through Latent Space Graphs also fits: Embodied and robot world models
  19. ATLAS: Aligned Transport of Latent Structure for Reliable World Model Planning
  20. Stochastic World Models for Verifying Vision-Based Neural Feedback Systems
  21. Beyond a single latent space: a dual-latent world model for long-horizon planning
  22. Anisotropic Representations Improve Planning in JEPA World Models
  23. Do-JEPA: From Masking to Intervention in Latent World Models
  24. Differentiating Bisimulation Metrics: A Framework for Parametric Markov Chain Fitting via Bicausal Optimal Transport also fits: Latent dynamics models and model-based RL
  25. Abductive World Modeling via Causal Representation Learning also fits: World models for language agents
  26. FlexiWorld: Learning and Planning via Flexible Action Chunks Across Multiple Time Scales also fits: Embodied and robot world models
  27. What Makes World Action Models Generalize? An Empirical Study of Test-Time Future Modeling also fits: Embodied and robot world models
  28. Bilinear World Models: Learning Representations with Structured Dynamics for Efficient Control
  29. Control-Geometry Straightening for Sampling-Based Latent Planning
  30. NeuronDiscover: Agent-in-Twin for Mechanistic Discovery in Neuronal Microenvironments with World Action Models also fits: World models for language agents
  31. EMPIRIC: Experiment-Driven Learning of Residual World Models for Robot Planning also fits: Latent dynamics models and model-based RL
  32. Learning What to Recall: Adaptive Multi-Cue Episodic Memory for World Models also fits: Video-generation world models and simulators
  33. Efficient World Action Model Inference with Adaptive Intermediate States also fits: Embodied and robot world models
  34. LRC-JEPA: Disentangling Dynamics and Residual Context for Efficient World Models
  35. When World Models Lie: Adaptive Safety Analysis Under Wrong Imaginations also fits: World model security and GUI agents
  36. Behavioral Monitoring of JEPA World Models with Jacobian Centroids
  37. ViBR-WM: Visual Bayesian Regression for World Modeling
  38. Beyond One-Step Accuracy: State-Affine Latent Transition for Reliable Visual Planning
  39. Hamiltonian JEPA: Action-Conditioned World Models with an Inherited Control State
  40. MultiEcho: An Experimental Science of Learned Worlds
  41. Adaptive Latent Capacity for World Models
  42. World Models with Predictable Long-Horizon Marginals
  43. What Do Latent Predictive Vehicle Representations Retain? Measuring State, Geometry, and Local Response
  44. WorldTS: World Modeling for Multimodal Covariate-aware Time Series Forecasting
  45. I Act Therefore I Am: When Is JEPA's Action-Conditioning Enough to Learn Causal Mechanisms?
  46. OneWorld: Learning Consistent Physics Across Actions in World Models also fits: Embodied and robot world models
  47. Stable and Counterfactually Robust Physical World Models from Imposed Structure and Learned Physics
  48. AD-WM: Action-Discriminative World Models for Counterfactual Model Predictive Control also fits: Latent dynamics models and model-based RL
  49. Underwater C3-JEPA: An Object-Centric Cross-View World Model for ROV Salvage also fits: World models for navigation
  50. Beyond Static Graph World Models: Learning Stochastic Latent Dynamics over Evolving Topologies also fits: World models for language agents
  51. Frozen Flows Forget: Diagnosing and Restoring Lost Motion in a Latent-flow World Model
  52. A JEPA Recipe for Tabular Foundation Models
  53. D-JEPA: A Decision-Aligned Latent World Model also fits: Embodied and robot world models
  54. NeuIDO: Neural Intrinsic Dynamics Operator for Physics-Informed 4D World Models also fits: Video-generation world models and simulators
  55. MotionJEPA: Preventing Temporal Feature Collapse by Capturing Visual Changes in Latent Space
  56. OnlineWM: Causality-Aware Active Online Learning for Effective World Modeling also fits: World models for language agents
  57. CausalWM: Causal Chain-of-Thought Reasoning for Embodied World Model
  58. PileBelief: Persistent Physical State for Interaction-Driven World Modeling also fits: World models for navigation
  59. Compact but Moving: Intervention-Relevant Geometry in Recurrent World Models
  60. Sandwich-Residuals: Parameter-Efficient Test-time Adaptation of World Models
  61. JEPA-Anything: Learning Predictive Models across Different Worlds also fits: Medical and surgical world models
  62. Conservation Buys Stability and Factoring Buys Counterfactuals in Physical World Models

Foundations

Most cited by papers here

  1. Learning Latent Dynamics for Planning from Pixels2018cited by 103 here
  2. DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planning2024cited by 79 here
  3. Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture2023cited by 75 here
  4. LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels2026cited by 64 here
  5. Revisiting Feature Prediction for Learning Visual Representations from Video2024cited by 54 here

Lineage

The papers this direction builds on, oldest first.

Each paper on the line cites the one before.

  1. 2018World Modelscited by 102 here
  2. 2018Learning Latent Dynamics for Planning from Pixelscited by 103 here
  3. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 114 here
  4. 2020Mastering Atari with Discrete World Modelscited by 60 here
  5. 2022Transformers are Sample-Efficient World Modelscited by 35 here
  6. 2023Mastering Diverse Domains through World Modelscited by 83 here
  7. 2023Learning Interactive Real-World Simulatorscited by 28 here
  8. 2024Genie: Generative Interactive Environmentscited by 45 here
  9. 2025Cosmos World Foundation Model Platform for Physical AIcited by 34 here
  10. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 70 here
  11. 2026LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixelscited by 64 here
13 more it builds on, not in this chain
  1. 2018Recurrent World Models Facilitate Policy Evolutioncited by 52 here
  2. 2019Contrastive Learning of Structured World Modelscited by 26 here
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 36 here
  4. 2022Temporal Difference Learning for Model Predictive Controlcited by 43 here
  5. 2022Scalable Diffusion Models with Transformerscited by 31 here
  6. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 75 here
  7. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 35 here
  8. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 27 here
  9. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 74 here
  10. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 54 here
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 27 here
  12. 2024DINO-WM: World Models on Pre-trained Visual Features enable Zero-shot Planningcited by 79 here
  13. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 29 here

The 24 most cited of 546.

Browse

30 of 296, ranked 6–35

  1. 6Temporal Difference Learning for Model Predictive Control202243
  2. 7Contrastive Learning of Structured World Models201926
  3. 8How Far is Video Generation from World Model: A Physical Law Perspective202423
  4. 9Hierarchical Planning with Latent World Models202613
  5. 10What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?202512
  6. 11Conditional Object-Centric Learning from Video202111
  7. 12PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation20249
  8. 13Causal-JEPA: Learning World Models through Object-Level Latent Masking20268
  9. 14When Does LeJEPA Learn a World Model?20268
  10. 15Closing the Train-Test Gap in World Models for Gradient-Based Planning20258
All 30
  1. 16Value-guided action planning with JEPA world models20258
  2. 17Learning Symmetric Embeddings for Equivariant World Models20228
  3. 18SCALOR: Generative World Models with Scalable Object Representations20198
  4. 19Predictive but Not Plannable: RC-aux for Latent World Models20267
  5. 20Subspace-Decomposed JEPAs: Disentangling Progression and Content in Latent World Models20267
  6. 21Learning and Leveraging World Models in Visual Representation Learning20247
  7. 22Temporal Straightening for Latent Planning20266
  8. 23Latent Geometry Beyond Search: Amortizing Planning in World Models20266
  9. 24Sub-JEPA: Subspace Gaussian Regularization for Stable End-to-End World Models20266
  10. 25Sensorimotor World Models: Perception for Action via Inverse Dynamics20266
  11. 26Interpreting Physics in Video World Models20265
  12. 27stable-worldmodel-v1: Reproducible World Modeling Research and Evaluation20265
  13. 28FF-JEPA: Long-Horizon Planning in World Models with Latent Planners20265
  14. 29Delta-JEPA: Learning Action-Sensitive World Models via Latent Difference Decoding20265
  15. 30AdaJEPA: An Adaptive Latent World Model20265
  16. 31Evaluating Newtonian Mechanics in Video Generative Models with Real Physical Systems20255
  17. 32Joint Embedding Predictive Architectures Focus on Slow Features20225
  18. 33Beyond the Next Step: Variable-Length Latent World Models for Long-Horizon Planning20264
  19. 34A Control Theory of Predictability in Latent World Models20264
  20. 35Force Prompting: Video Generation Models Can Learn and Generalize Physics-based Control Signals20254