GAZE:Governance-Aware pre-annotation for Zero-shot World Model Environments
On the map: World models → Video-generation world models and simulators
Abstract (arXiv)
Training robust world models requires large-scale, precisely labeled multimodal datasets, a process historically bottlenecked by slow and expensive manual annotation. We present a production-tested GAZE pipeline that automates the conversion of raw, long-form video into rich, task-ready supervision for world-model training. Our system (i) normalizes proprietary 360-degree formats into standard views and shards them for parallel processing; (ii) applies a suite of AI models (scene understanding, object tracking, audio transcription, PII/NSFW/minor detection) for dense, multimodal pre-annotation; and (iii) consolidates signals into a structured output specification for rapid human validation. The GAZE workflow demonstrably yields efficiency gains (~19 minutes saved per review hour) and reduces human review volume by >80% through conservative auto-skipping of low-salience segments. By increasing label density and consistency while integrating privacy safeguards and chain-of-custody metadata, our method generates high-fidelity, privacy-aware datasets directly consumable for learning cross-modal dynamics and action-conditioned prediction. We detail our orchestration, model choices, and data dictionary to provide a scalable blueprint for generating high-quality world model training data without sacrificing throughput or governance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 8 of its 15 references that are in the map. First posted on arXiv 7 Oct 2025.
Builds on
8 of 15 references.
References · 8
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
- 2025Unmasking the Reality of PII Masking Models: Performance Gaps and the Call for Accountabilitycited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026World in World: Explore the World with World Models
- 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining
- 2026World Tokens: Enhancing Embodied Policies with Training-Time World Modeling
- 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity
- 2026Olaf-World: Orienting Latent Actions for Video World Modeling
- 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data
- 2025WorldModelBench: Judging Video Generation Models As World Models
- 2026ReWorld: An Interactive World Model with Long-Horizon Memory