Sora and V-JEPA Have Not Learned The Complete Real World Model -- A Philosophical Analysis of Video AIs Through the Theory of Productive Imagination
On the map: World models → World models for language agents
Abstract (arXiv)
Sora from Open AI has shown exceptional performance, yet it faces scrutiny over whether its technological prowess equates to an authentic comprehension of reality. Critics contend that it lacks a foundational grasp of the world, a deficiency V-JEPA from Meta aims to amend with its joint embedding approach. This debate is vital for steering the future direction of Artificial General Intelligence(AGI). We enrich this debate by developing a theory of productive imagination that generates a coherent world model based on Kantian philosophy. We identify three indispensable components of the coherent world model capable of genuine world understanding: representations of isolated objects, an a priori law of change across space and time, and Kantian categories. Our analysis reveals that Sora is limited because of its oversight of the a priori law of change and Kantian categories, flaws that are not rectifiable through scaling up the training. V-JEPA learns the context-dependent aspect of the a priori law of change. Yet it fails to fully comprehend Kantian categories and incorporate experience, leading us to conclude that neither system currently achieves a comprehensive world understanding. Nevertheless, each system has developed components essential to advancing an integrated AI productive imagination-understanding engine. Finally, we propose an innovative training framework for an AI productive imagination-understanding engine, centered around a joint embedding system designed to transform disordered perceptual input into a structured, coherent world model. Our philosophical analysis pinpoints critical challenges within contemporary video AI technologies and a pathway toward achieving an AI system capable of genuine world understanding, such that it can be applied for reasoning and planning in the future.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World models for language agents, one of 11 directions in World models. Builds on 14 of its 30 references that are in the map. First posted on arXiv 6 May 2024.
Builds on
14 of 30 references.
References · 14
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2017The Kinetics Human Action Video Datasetcited by 1,909
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2018World Modelscited by 1,513
- 2016Colorful Image Colorizationcited by 1,114
- 2017The "something something" video database for learning and evaluating visual common sensecited by 1,103
- 2015Unsupervised Visual Representation Learning by Context Predictioncited by 1,066
- 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 531
- 2024Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Modelscited by 477
2 more
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026From Generative Engines to Actionable Simulators: The Imperative of Physical Grounding in World Models
- 2025Beyond World Models: Rethinking Understanding in AI Models
- 2025WoW: Towards a World omniscient World model Through Embodied Interaction
- 2024The Phenomenology of Machine: A Comprehensive Analysis of the Sentience of the OpenAI-o1 Model Integrating Functionalism, Consciousness Theories, Active Inference, and AI Architectures
- 2022A World-Self Model Towards Understanding Intelligence
- 2026Human Cognition in Machines: A Unified Perspective of World Models
- 2026Generalist Open-World Temporal Perception
- 2026Epistemology of Generative AI: The Geometry of Knowing