WorldString: Actionable World Representation
On the map: World models → Latent predictive world models
Abstract (arXiv)
Inspired by the emergent behaviors in large language models that generalized human intelligence, the research community is pursuing similar emergent capabilities within world models, with a emphasis on modeling the physical world. Within the scope of physical world model, objects are the fundamental primitives that constitute physical reality. From humans to computers, nearly everything we interact with is an object. These objects are rarely static; they are actionable entities with varying states determined by their intrinsic properties. While current methods approach object action states either via video generation or dynamic scene reconstruction, none explicitly model this basic element in a unified, principled way to build an actionable object representation. We propose WorldString, a neural architecture capable of modeling the state manifold of real-world objects by learning directly from point clouds or RGB-D video streams. Serving as a versatile digital twin, it acts as a foundational building block for physical world models; thus, we name it WorldString. Sweetly, its fully differentiable structure seamlessly enables future integration with policy learning and neural dynamics.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Latent predictive world models, one of 11 directions in World models. Builds on 13 of its 59 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
13 of 59 references.
Closest ancestors · 1
Same direction, newest first
Other references · 12
- 2023Mastering Diverse Domains through World Modelscited by 1,253
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 864
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2024VideoPhy: Evaluating Physical Commonsense for Video Generationcited by 228
- 2024CoTracker3: Simpler and Better Point Tracking by Pseudo-Labelling Real Videoscited by 128
- 2025PhysTwin: Physics-Informed Reconstruction and Simulation of Deformable Objects from Videoscited by 87
- 2025Vid2World: Crafting Video Diffusion Models to Interactive World Modelscited by 76
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 51
- 2025The Reality Gap in Robotics: Challenges, Solutions, and Best Practicescited by 24
- 2024Differentiable Robot Renderingcited by 21
- 2024Differentiable Physics-based System Identification for Robotic Manipulation of Elastoplastic Materialscited by 6
- 2025NeuSpring: Neural Spring Fields for Reconstruction and Simulation of Deformable Objects from Videoscited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025From Masks to Worlds: A Hitchhiker's Guide to World Models
- 2026WorldCast: Exploring Intelligent Visual Generation in World State Prediction
- 2026PhiZero: A World Model Built Around Physical Language
- 2026Emergent Semantic Representations in World Models through Physical Interaction without Linguistic Supervision
- 20243D-VLA: A 3D Vision-Language-Action Generative World Model
- 2026Physical Object Understanding with a Physically Controllable World Model
- 2026UniWAM: Unified World-Action Model
- 2026World-Language-Action Model for Unified World Modeling, Language Reasoning, and Action Synthesis