mlsanityData to 14 Oct 2026

WorldRover: A Scalable Synthetic Video Data Engine for World Exploration with Rich Annotations

arXiv 2608.15659 ↗First posted 16 Aug 2026cs.CV cs.GRcited by 2

Not on the map. Why?

Abstract (arXiv)

Learning to generate or reconstruct explorable worlds requires video paired with more than RGB: camera motion, scene geometry, temporal correspondence and, for interactive models, control signals. Real capture can provide some of these signals, but dense geometry and long-range correspondence usually rely on estimation or specialised instrumentation. Rendering provides these quantities directly, yet existing synthetic resources rarely combine them on the same frames while also supporting controlled changes of viewpoint and appearance. We introduce WorldRover, a data engine for generating richly annotated, long-range explorations of artist-built environments. At its core, WorldRover-Engine is an Unreal Engine pipeline that executes and offline-renders minute-scale routes while preserving their full trajectories and scene geometry. The same exploration can be replayed from first-person, third-person, and 360 panoramic cameras under different environmental states. Using WorldRover-Engine, we construct WorldRover-10M, whose sequences pair RGB with metric depth, camera trajectories, and trajectory-derived action signals throughout each exploration. Third-person subsets additionally provide dense optical flow, long-range 2D/3D point tracks with visibility, and a character trajectory distinct from the camera trajectory. The engine can render a traversal from first-person, third-person and 360 panoramic viewpoints, under different environmental states or with a neutral white material, while preserving the route and scene geometry. WorldRover therefore turns long-horizon world exploration into a scalable data-generation problem, providing supervision for models that must build, maintain, and revisit coherent representations of an explorable world.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 35 of its 38 references that are in the map. First posted on arXiv 16 Aug 2026.

Builds on

35 of 38 references.

References · 35

  1. 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
  2. 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
  3. 2016Playing for Data: Ground Truth from Computer Gamescited by 818
  4. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  5. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  6. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 523
  7. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  8. 2022Kubric: A scalable dataset generatorcited by 381
  9. 2023PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Trackingcited by 276
  10. 2023BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motioncited by 236
  11. 2023Habitat 3.0: A Co-Habitat for Humans, Avatars and Robotscited by 228
  12. 2017Playing for Benchmarkscited by 169
23 more
  1. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  2. 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 148
  3. 2023Infinite Photorealistic Worlds using Procedural Generationcited by 147
  4. 2025GameFactory: Creating New Games with Generative Interactive Videoscited by 130
  5. 2024GameGen-X: Interactive Open-world Game Video Generationcited by 128
  6. 2025MineWorld: a Real-Time and Open-Source Interactive World Model on Minecraftcited by 97
  7. 2025Yume-1.5: A Text-Controlled Interactive World Generation Modelcited by 84
  8. 2018Learning to Detect and Track Visible and Occluded Body Joints in a Virtual Worldcited by 82
  9. 2025Sekai: A Video Dataset towards World Explorationcited by 67
  10. 2025OmniWorld: A Multi-Domain and Multi-Modal Dataset for 4D World Modelingcited by 62
  11. 2026Infinite Worlds with Versatile Interactionscited by 48
  12. 2016UnrealCV: Connecting Computer Vision to Unreal Enginecited by 41
  13. 2026WorldMark: A Unified Benchmark Suite for Interactive Video World Modelscited by 26
  14. 2024UnrealZoo: Enriching Photo-realistic Virtual Worlds for Embodied AIcited by 25
  15. 2025BEDLAM2.0: Synthetic Humans and Cameras in Motioncited by 25
  16. 2026WildWorld: A Large-Scale Dataset for Dynamic World Modeling with Actions and Explicit State toward Generative ARPGcited by 13
  17. 2025AirSim360: A Panoramic Simulation Platform within Drone Viewcited by 12
  18. 2026AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Reportcited by 11
  19. 2026Generative World Renderercited by 10
  20. 2026Coarse-to-Real: Generative Rendering for Populated Dynamic Scenescited by 9
  21. 2026Syn4D: A Multiview Synthetic 4D Datasetcited by 4
  22. 2026SPEAR: A Simulator for Photorealistic Embodied AI Researchcited by 4
  23. 2026OmniX: Any-view and Any-time 4D Reconstruction via Feed-forward Trajectory Fieldscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.