One-Step Next-Latent Prediction Is Not a World Model
Not on the map. Why?
Abstract (arXiv)
Next-latent prediction fits a map from the current embedding to the next one. LeNEPA carries this objective to time series, replacing the stop-gradient of next-embedding prediction with the isotropy penalty of LeJEPA. A world model is a transition kernel that can be rolled out. The one-step regression identifies a conditional mean, and a mean is a kernel only in special cases. For a linear-Gaussian Markov latent, the mean transition and the innovation covariance are fixed by the one-step problem, and the open-loop squared error at horizon K equals the trace of the sum of the pushed-forward innovation covariances. That error grows with K after the one-step fit is exact. If the conditional mean is nonlinear, composing it is not the multi-step conditional mean. If the observation is a non-injective function of a Markov state, a memoryless one-step map does not determine future observations, while a short window can. An isotropy penalty is a function of the embedding marginal, so its partial derivative in the transition weights is zero. On a scalar autoregression with coefficient 0.9, the one-step mean squared error is 0.998 and the 16-step open-loop error is 5.10. On a hidden rotation, an eight-step window reaches 16-step error 0.056, while the current scalar alone reaches 0.778. Raising the isotropy weight from 0.1 to 10 leaves eight-step latent error inside [0.78,0.85] on three seeds.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 154 of its 178 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
154 of 178 references.
References · 154
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2020Denoising Diffusion Implicit Modelscited by 9,781
38 more
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2016Layer Normalizationcited by 5,669
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
- 2017Neural Discrete Representation Learningcited by 4,712
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,101
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
50 most cited of 154 All 154 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Towards Unraveling and Improving Generalization in World Models
- 2026Pythia: Toward Foundation World Models for Multimodal Time Series
- 2025Hierarchical Stochastic Differential Equation Models for Latent Manifold Learning in Neural Time Series
- 2026WorldDynCache: Risk-Controlled Latent Dynamics Approximation for Diffusion World Model
- 2026What a World Model Represents Is Three Questions
- 2026Do-JEPA: From Masking to Intervention in Latent World Models
- 2024A Multi-step Loss Function for Robust Learning of the Dynamics in Model-based Reinforcement Learning
- 2026BeliefGraph-JEPA: Structured Latent World Models for Action-Conditioned Time Series