mlsanityData to 7 Oct 2026

CG-World: A Large-Scale World-State Dataset and Protocol for World Models

arXiv 2607.26452 ↗First posted 29 Jul 2026cs.AI cs.CV cs.GRcited by 1

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

World models must learn the joint dynamics of states, actions, events, and observations, yet existing video, robotics, and simulation datasets usually capture only part of this structure. We introduce CG-World, a large-scale world-state dataset and protocol derived from industrial computer graphics production pipelines. CG-World explicitly records intermediate states, including multimodal semantics, spatial structure, skeletal and controller states, motion curves, camera and lighting parameters, physics caches, contact events, and multi-pass renderings. CG-World v1 contains approximately 850,000 temporally aligned segments of 1-5 seconds. It separates latent states, observations, relations, events, and branch metadata, and organizes them into unified spatiotemporal samples. To support intervention learning and counterfactual reasoning, CG-World defines a branch lineage covering factual trajectories, observation interventions, action interventions, mechanism interventions, and strict counterfactual branches, with intervention targets, invariants, and alternative outcomes explicitly recorded. We evaluate the dataset on geometry-conditioned video generation, action prediction, and closed-loop vision-language-action policy transfer. Results show that CG-World provides reusable structured supervision for controlled generation, action modeling, and embodied policy transfer. We plan to expand CG-World through continued data collection and community collaboration toward a shared data infrastructure for world models, Physical AI, and embodied intelligence.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 0 of its 41 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

0 of 41 references.

No references here yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026VIDEAS: Distilling Explicit Action Semantics from Demonstration Videos for World Models via Prior-Guided Simulation
  2. 2026World in World: Explore the World with World Models
  3. 2026World Tokens: Enhancing Embodied Policies with Training-Time World Modeling
  4. 2026stable-worldmodel: A Platform for Reproducible World Modeling Research and Evaluation
  5. 2025Vid2World: Crafting Video Diffusion Models to Interactive World Models
  6. 2026Interactive World Simulator for Robot Policy Training and Evaluation
  7. 2026From World Models to World Action Models: Rethinking Next-State Prediction
  8. 2026Sekai2: From World Exploration to Interactive World Modeling