mlsanityData to 14 Oct 2026

InfinityDrive: Breaking Time Limits in Driving World Models

arXiv 2412.01522 ↗First posted 2 Dec 2024cs.CVcited by 21

On the map: World models → World models for autonomous driving

also in 1 more
Abstract (arXiv)

Autonomous driving systems struggle with complex scenarios due to limited access to diverse, extensive, and out-of-distribution driving data which are critical for safe navigation. World models offer a promising solution to this challenge; however, current driving world models are constrained by short time windows and limited scenario diversity. To bridge this gap, we introduce InfinityDrive, the first driving world model with exceptional generalization capabilities, delivering state-of-the-art performance in high fidelity, consistency, and diversity with minute-scale video generation. InfinityDrive introduces an efficient spatio-temporal co-modeling module paired with an extended temporal training strategy, enabling high-resolution (576×1024) video generation with consistent spatial and temporal coherence. By incorporating memory injection and retention mechanisms alongside an adaptive memory curve loss to minimize cumulative errors, achieving consistent video generation lasting over 1500 frames (more than 2 minutes). Comprehensive experiments in multiple datasets validate InfinityDrive's ability to generate complex and varied scenarios, highlighting its potential as a next-generation driving world model built for the evolving demands of autonomous driving. Our project homepage: https://metadrivescape.github.io/papersproject/InfinityDrive/page.html

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 51 of its 56 references that are in the map. First posted on arXiv 2 Dec 2024.

Builds on

51 of 56 references.

Closest ancestors · 9

Same direction, newest first

  1. 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representation17 Oct
  2. 2024Unleashing Generalization of End-to-End Autonomous Driving with Controllable Long Video Generation3 Jun
  3. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
  4. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar
  5. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
  6. 2023ADriver-I: A General World Model for Autonomous Driving22 Nov
  7. 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion2 Nov
  8. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
  9. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving18 Sep

Other references · 42

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2022Scalable Diffusion Models with Transformerscited by 6,054
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  7. 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
  8. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
  9. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
  10. 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
  11. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  12. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
30 more
  1. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  2. 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
  3. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
  4. 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
  5. 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
  6. 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 350
  7. 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
  8. 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 233
  9. 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
  10. 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 180
  11. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 175
  12. 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 171
  13. 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
  14. 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 139
  15. 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 132
  16. 2021DriveGAN: Towards a Controllable High-Quality Neural Simulationcited by 125
  17. 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 103
  18. 2024Loong: Generating Minute-level Long Videos with Autoregressive Language Modelscited by 99
  19. 2023WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generationcited by 93
  20. 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequencecited by 89
  21. 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 89
  22. 2024Video as the New Language for Real-World Decision Makingcited by 87
  23. 2020Learning to Simulate Dynamic Environments with GameGANcited by 86
  24. 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 76
  25. 2023DrivingDiffusion: Layout-Guided multi-view driving scene video generation with latent diffusion modelcited by 75
  26. 2024Embodied Understanding of Driving Scenarioscited by 63
  27. 2023LivePhoto: Real Image Animation with Text-guided Motion Controlcited by 44
  28. 2024ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generationcited by 41
  29. 2016Learning a Driving Simulatorcited by 33
  30. 2022The Quest for a Common Model of the Intelligent Decision Makercited by 16

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 12; 2026: 8.

21 papers.

Sort:

By area:

  1. 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
  2. 20253D and 4D World Modeling: A Surveycited by 67
  3. 2025A Survey of World Models for Autonomous Drivingcited by 60
  4. 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 51
  5. 2025VaViM and VaVAM: Autonomous Driving through Video Generative Modelingcited by 35
  6. 2025From Forecasting to Planning: Policy World Model for Collaborative State-Action Predictioncited by 33
  7. 2025ImagiDrive: A Unified Imagination-and-Planning Framework for Autonomous Drivingcited by 25
  8. 2025UniFuture: A 4D Driving World Model for Future Generation and Perceptioncited by 22
  9. 2025DriVerse: Navigation World Model for Driving Simulation via Multimodal Trajectory Prompting and Motion Alignmentcited by 16
  10. 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
  11. 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 15
  12. 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Modelcited by 14
9 more
  1. 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Drivingcited by 13
  2. 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representationcited by 13
  3. 2025WorldPack: Dynamic Frame Compression for Long-context Video World Modelingcited by 8
  4. 2026InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generationcited by 8
  5. 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
  6. 2026Composing Driving Worlds through Disentangled Control for Adversarial Scenario Generationcited by 2
  7. 2026OpenLongTail: Generative Scaling of Long-Tail Driving Datacited by 2
  8. 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
  9. 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025The Role of World Models in Shaping Autonomous Driving: A Comprehensive Survey
  2. 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving
  3. 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT
  4. 2024Exploring the Interplay Between Video Generation and World Models in Autonomous Driving: A Survey
  5. 2025ProphetDWM: A Driving World Model for Rolling Out Future Actions and Videos
  6. 2024DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World Model
  7. 2025HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Driving
  8. 2026HelloWorld: Towards Practical Applications of Generative Driving World Models