mlsanityData to 7 Oct 2026

GAZE:Governance-Aware pre-annotation for Zero-shot World Model Environments

arXiv 2510.14992 ↗First posted 7 Oct 2025cs.CV cs.AIcited by 0

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

Training robust world models requires large-scale, precisely labeled multimodal datasets, a process historically bottlenecked by slow and expensive manual annotation. We present a production-tested GAZE pipeline that automates the conversion of raw, long-form video into rich, task-ready supervision for world-model training. Our system (i) normalizes proprietary 360-degree formats into standard views and shards them for parallel processing; (ii) applies a suite of AI models (scene understanding, object tracking, audio transcription, PII/NSFW/minor detection) for dense, multimodal pre-annotation; and (iii) consolidates signals into a structured output specification for rapid human validation. The GAZE workflow demonstrably yields efficiency gains (~19 minutes saved per review hour) and reduces human review volume by >80% through conservative auto-skipping of low-salience segments. By increasing label density and consistency while integrating privacy safeguards and chain-of-custody metadata, our method generates high-fidelity, privacy-aware datasets directly consumable for learning cross-modal dynamics and action-conditioned prediction. We detail our orchestration, model choices, and data dictionary to provide a scalable blueprint for generating high-quality world model training data without sacrificing throughput or governance.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 8 of its 15 references that are in the map. First posted on arXiv 7 Oct 2025.

Builds on

8 of 15 references.

References · 8

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  2. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  5. 2015FaceNet: A Unified Embedding for Face Recognition and Clusteringcited by 2,833
  6. 2018YOLOv3: An Incremental Improvementcited by 2,652
  7. 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
  8. 2025Unmasking the Reality of PII Masking Models: Performance Gaps and the Call for Accountabilitycited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026World in World: Explore the World with World Models
  2. 2026OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining
  3. 2026World Tokens: Enhancing Embodied Policies with Training-Time World Modeling
  4. 2026WorldExam: Benchmarking World Models from Apparent Appearance to Inherent Reactivity
  5. 2026Olaf-World: Orienting Latent Actions for Video World Modeling
  6. 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data
  7. 2025WorldModelBench: Judging Video Generation Models As World Models
  8. 2026ReWorld: An Interactive World Model with Long-Horizon Memory