mlsanityData to 7 Oct 2026

ABot-World-0: Infinite Interactive World Rollout on a Single Desktop GPU

arXiv 2607.19191 ↗First posted 21 Jul 2026cs.CV cs.AI cs.LGcited by 13

On the map: World models → Video-generation world models and simulators

Abstract (arXiv)

We present ABot-World-0, an action-conditioned video world model for real-time, long-horizon closed-loop interaction, supported by a multi-source data infrastructure spanning AAA games, simulation engines, and internet videos to learn controllable world dynamics. WorldExplorer performs agent-driven collection guided by training feedback, while a unified pipeline applies 14 deterministic quality checks, VLM-based assessment, and synchronized action and text annotation. We progressively distill a bidirectional action-conditioned teacher into a causal student through teacher forcing and ODE distillation, and introduce LongForcing to align long student self-rollouts with an extended-horizon teacher, mitigating accumulated distribution shift and autoregressive drift. Raw keyboard actions provide a unified control interface for scene roaming and third-person character interaction, while reference-character memory provides persistent appearance cues for identity consistency during third-person rollouts. For deployment, we co-design a streaming inference stack with a lightweight VAE decoder, efficient attention, memory-aware scheduling, and low-bit DiT inference. Across optimized low-bit configurations, ABot-World-0 streams 720P video at up to 16 FPS on a single NVIDIA RTX 5090 desktop GPU, with 1.2s action-to-first-frame latency and approximately 19GiB peak VRAM. Experiments on WorldRoamBench and extended interactive rollouts demonstrate competitive controllability and coherent long-horizon world evolution.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Video-generation world models and simulators, one of 11 directions in World models. Builds on 50 of its 88 references that are in the map. First posted on arXiv 21 Jul 2026.

Builds on

50 of 88 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026ABot-3DWorld 0: A Universal World Model to Explore Any 3D Space13 Jul
  2. 2026WorldRoamBench: An Open-World Benchmark for Long-Horizon Stability of Interactive World Models30 Jun
  3. 2026Advancing Open-source World Models28 Jan
  4. 2025RELIC: Interactive Video World Model with Long-Horizon Memory3 Dec
  5. 2025Rolling Forcing: Autoregressive Long Video Diffusion in Real Time29 Sep
  6. 2025Matrix-game 2.0: An open-source real-time and streaming interactive world model18 Aug
  7. 2025DeepVerse: 4D Autoregressive Video Generation as a World Model1 Jun
  8. 2025MAGI-1: Autoregressive Video Generation at Scale19 May
  9. 2025Wan: Open and Advanced Large-Scale Video Generative Models26 Mar
  10. 2024Diffusion Models Are Real-Time Game Engines27 Aug
  11. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer12 Aug
  12. 2022Flow Matching for Generative Modeling6 Oct
1 more
  1. 2021VideoGPT: Video Generation using VQ-VAE and Transformers20 Apr

Other references · 37

  1. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  2. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  3. 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,597
  4. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 973
  5. 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
  6. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  7. 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 569
  8. 2024LTX-Video: Realtime Video Latent Diffusioncited by 549
  9. 2024Latte: Latent Diffusion Transformer for Video Generationcited by 536
  10. 2024CameraCtrl: Enabling Camera Control for Text-to-Video Generationcited by 448
  11. 2024Pyramidal Flow Matching for Efficient Video Generative Modelingcited by 354
  12. 2021GODIVA: Generating Open-DomaIn Videos from nAtural Descriptionscited by 254
25 more
  1. 2023DeepSpeed Ulysses: System Optimizations for Enabling Training of Extreme Long Sequence Transformer Modelscited by 239
  2. 2025LongLive: Real-time Interactive Long Video Generationcited by 237
  3. 2025SkyReels-V2: Infinite-length Film Generative Modelcited by 218
  4. 2025Self-Forcing++: Towards Minute-Scale High-Quality Video Generationcited by 176
  5. 2025Step-Video-T2V Technical Report: The Practice, Challenges, and Future of Video Foundation Modelcited by 163
  6. 2026Causal Forcing: Autoregressive Diffusion Distillation Done Right for High-Quality Real-Time Interactive Video Generationcited by 159
  7. 2025TurboQuant: Online Vector Quantization with Near-optimal Distortion Ratecited by 116
  8. 2024SageAttention2: Efficient Attention with Thorough Outlier Smoothing and Per-thread INT4 Quantizationcited by 113
  9. 2025Deep Forcing: Training-Free Long Video Generation with Deep Sink and Participative Compressioncited by 72
  10. 2025MotionStream: Real-Time Video Generation with Interactive Motion Controlscited by 71
  11. 2024Progressive Autoregressive Video Diffusion Modelscited by 65
  12. 2025AR-Diffusion: Asynchronous Video Generation with Auto-Regressive Diffusioncited by 53
  13. 2026Context Forcing: Consistent Autoregressive Video Generation with Long Contextcited by 47
  14. 2025StreamDiT: Real-Time Streaming Text-to-Video Generationcited by 43
  15. 2026LoL: Longer than Longer, Scaling Video Generation to Hourcited by 29
  16. 2026LongLive-2.0: An NVFP4 Parallel Infrastructure for Long Video Generationcited by 25
  17. 2026MemRoPE: Training-Free Infinite Video Generation via Evolving Memory Tokenscited by 20
  18. 2026Relax Forcing: Relaxed KV-Memory for Consistent Long Video Generationcited by 20
  19. 2026Quant VideoGen: Auto-Regressive Long Video Generation via 2-Bit KV-Cache Quantizationcited by 18
  20. 2026PackForcing: Short Video Training Suffices for Long Video Sampling and Long Context Inferencecited by 14
  21. 2026HiAR: Efficient Autoregressive Long Video Generation via Hierarchical Denoisingcited by 13
  22. 2026ReRoPE: Repurposing RoPE for Relative Camera Controlcited by 12
  23. 2025DualCamCtrl: Dual-Branch Diffusion Model for Geometry-Aware Camera-Controlled Video Generationcited by 11
  24. 2025SpaceTimePilot: Generative Rendering of Dynamic Scenes Across Space and Timecited by 9
  25. 2026Train Short, Inference Long: Training-free Horizon Extension for Autoregressive Video Generationcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026ActWorld: From Explorable to Interactive World Model via Action-Aware Memory
  2. 2026Towards Interactive Video World Modeling: Frontiers, Challenges, Benchmarks, and Future Trends
  3. 2026Matrix-Game 3.5: Enhancing Real-Time Streaming Interactive World Models with Patch Memory
  4. 2025WorldPlay: Towards Long-Term Geometric Consistency for Real-Time Interactive World Modeling
  5. 2026Matrix-Game 3.0: Real-Time and Streaming Interactive World Model with Long-Horizon Memory
  6. 2026GameWAM: A World Action Model for Video Games
  7. 2026DreamForge-World 0.1 Preview: A Low-Compute Real-Time Controllable World Model
  8. 2026Programmable World Model