InfinityDrive: Breaking Time Limits in Driving World Models
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Autonomous driving systems struggle with complex scenarios due to limited access to diverse, extensive, and out-of-distribution driving data which are critical for safe navigation. World models offer a promising solution to this challenge; however, current driving world models are constrained by short time windows and limited scenario diversity. To bridge this gap, we introduce InfinityDrive, the first driving world model with exceptional generalization capabilities, delivering state-of-the-art performance in high fidelity, consistency, and diversity with minute-scale video generation. InfinityDrive introduces an efficient spatio-temporal co-modeling module paired with an extended temporal training strategy, enabling high-resolution (576×1024) video generation with consistent spatial and temporal coherence. By incorporating memory injection and retention mechanisms alongside an adaptive memory curve loss to minimize cumulative errors, achieving consistent video generation lasting over 1500 frames (more than 2 minutes). Comprehensive experiments in multiple datasets validate InfinityDrive's ability to generate complex and varied scenarios, highlighting its potential as a next-generation driving world model built for the evolving demands of autonomous driving. Our project homepage: https://metadrivescape.github.io/papersproject/InfinityDrive/page.html
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 51 of its 56 references that are in the map. First posted on arXiv 2 Dec 2024.
Builds on
51 of 56 references.
Closest ancestors · 9
Same direction, newest first
- 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representation17 Oct
- 2024Unleashing Generalization of End-to-End Autonomous Driving with Controllable Long Video Generation3 Jun
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar
- 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
- 2023ADriver-I: A General World Model for Autonomous Driving22 Nov
- 2023Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion2 Nov
- 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
- 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving18 Sep
Other references · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,778
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,742
- 2019Dream to Control: Learning Behaviors by Latent Imaginationcited by 1,653
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,433
30 more
- 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
- 2021VideoGPT: Video Generation using VQ-VAE and Transformerscited by 658
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2023VideoComposer: Compositional Video Synthesis with Motion Controllabilitycited by 464
- 2022Latent Video Diffusion Models for High-Fidelity Long Video Generationcited by 388
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 350
- 2023Emu Video: Factorizing Text-to-Video Generation by Explicit Image Conditioningcited by 255
- 2023SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Predictioncited by 233
- 2024InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Outputcited by 195
- 2023FreeNoise: Tuning-Free Longer Video Diffusion via Noise Reschedulingcited by 180
- 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 175
- 2023NUWA-XL: Diffusion over Diffusion for eXtremely Long Video Generationcited by 171
- 2024Direct-a-Video: Customized Video Generation with User-Directed Camera Movement and Object Motioncited by 167
- 2023Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoisingcited by 139
- 2024ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generationcited by 132
- 2021DriveGAN: Towards a Controllable High-Quality Neural Simulationcited by 125
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 103
- 2024Loong: Generating Minute-level Long Videos with Autoregressive Language Modelscited by 99
- 2023WoVoGen: World Volume-aware Diffusion for Controllable Multi-camera Driving Scene Generationcited by 93
- 2024MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequencecited by 89
- 2024FreeLong: Training-Free Long Video Generation with SpectralBlend Temporal Attentioncited by 89
- 2024Video as the New Language for Real-World Decision Makingcited by 87
- 2020Learning to Simulate Dynamic Environments with GameGANcited by 86
- 2023ARTboldsymbol·V: Auto-Regressive Text-to-Video Generation with Diffusion Modelscited by 76
- 2023DrivingDiffusion: Layout-Guided multi-view driving scene video generation with latent diffusion modelcited by 75
- 2024Embodied Understanding of Driving Scenarioscited by 63
- 2023LivePhoto: Real Image Animation with Text-guided Motion Controlcited by 44
- 2024ARLON: Boosting Diffusion Transformers with Autoregressive Models for Long Video Generationcited by 41
- 2016Learning a Driving Simulatorcited by 33
- 2022The Quest for a Common Model of the Intelligent Decision Makercited by 16
Built on by
Citing papers per year: 2024: 1; 2025: 12; 2026: 8.
21 papers.
Sort:
By area:
- 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
- 20253D and 4D World Modeling: A Surveycited by 67
- 2025A Survey of World Models for Autonomous Drivingcited by 60
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 51
- 2025VaViM and VaVAM: Autonomous Driving through Video Generative Modelingcited by 35
- 2025From Forecasting to Planning: Policy World Model for Collaborative State-Action Predictioncited by 33
- 2025ImagiDrive: A Unified Imagination-and-Planning Framework for Autonomous Drivingcited by 25
- 2025UniFuture: A 4D Driving World Model for Future Generation and Perceptioncited by 22
- 2025DriVerse: Navigation World Model for Driving Simulation via Multimodal Trajectory Prompting and Motion Alignmentcited by 16
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
- 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memoriescited by 15
- 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Modelcited by 14
9 more
- 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Drivingcited by 13
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representationcited by 13
- 2025WorldPack: Dynamic Frame Compression for Long-context Video World Modelingcited by 8
- 2026InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generationcited by 8
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithmscited by 5
- 2026Composing Driving Worlds through Disentangled Control for Adversarial Scenario Generationcited by 2
- 2026OpenLongTail: Generative Scaling of Long-Tail Driving Datacited by 2
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
- 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulationcited by 0
- 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation18 Sep 2026
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026OpenLongTail: Generative Scaling of Long-Tail Driving Data10 Jul 2026
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithms30 Mar 2026
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation16 Mar 2026
- 2026Composing Driving Worlds through Disentangled Control for Adversarial Scenario Generation13 Mar 2026
- 2026AnchorWeave: World-Consistent Video Generation with Retrieved Local Spatial Memories16 Feb 2026
- 2026InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generation3 Feb 2026
- 2025WorldPack: Dynamic Frame Compression for Long-context Video World Modeling2 Dec 2025
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap11 Nov 2025
- 2025From Forecasting to Planning: Policy World Model for Collaborative State-Action Prediction22 Oct 2025
- 2025A Comprehensive Survey on World Models for Embodied AI19 Oct 2025
9 more
- 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Driving27 Sep 2025
- 20253D and 4D World Modeling: A Survey4 Sep 2025
- 2025ImagiDrive: A Unified Imagination-and-Planning Framework for Autonomous Driving15 Aug 2025
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models1 Jul 2025
- 2025DriVerse: Navigation World Model for Driving Simulation via Multimodal Trajectory Prompting and Motion Alignment22 Apr 2025
- 2025UniFuture: A 4D Driving World Model for Future Generation and Perception17 Mar 2025
- 2025VaViM and VaVAM: Autonomous Driving through Video Generative Modeling21 Feb 2025
- 2025A Survey of World Models for Autonomous Driving20 Jan 2025
- 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Model11 Dec 2024
- 2025A Comprehensive Survey on World Models for Embodied AIcited by 68
- 20253D and 4D World Modeling: A Surveycited by 67
- 2025A Survey of World Models for Autonomous Drivingcited by 60
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Modelscited by 51
- 2025VaViM and VaVAM: Autonomous Driving through Video Generative Modelingcited by 35
- 2025From Forecasting to Planning: Policy World Model for Collaborative State-Action Predictioncited by 33
- 2025UniFuture: A 4D Driving World Model for Future Generation and Perceptioncited by 22
- 2025DriVerse: Navigation World Model for Driving Simulation via Multimodal Trajectory Prompting and Motion Alignmentcited by 16
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmapcited by 15
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representationcited by 13
- 2025WorldPack: Dynamic Frame Compression for Long-context Video World Modelingcited by 8
- 2026InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generationcited by 8
12 most cited of 16 All 16 (JSON)
- 2026ZYT-World: A Real-Time Controllable World Model for Closed-Loop Autonomous-Driving Simulation18 Sep 2026
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026OpenLongTail: Generative Scaling of Long-Tail Driving Data10 Jul 2026
- 2026Video Generation Models as World Models: Efficient Paradigms, Architectures and Algorithms30 Mar 2026
- 2026Bridging Scene Generation and Planning: Driving with World Model via Unifying Vision and Motion Representation16 Mar 2026
- 2026InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generation3 Feb 2026
- 2025WorldPack: Dynamic Frame Compression for Long-context Video World Modeling2 Dec 2025
- 2025Simulating the Visual World with Artificial Intelligence: A Roadmap11 Nov 2025
- 2025From Forecasting to Planning: Policy World Model for Collaborative State-Action Prediction22 Oct 2025
- 2025A Comprehensive Survey on World Models for Embodied AI19 Oct 2025
- 20253D and 4D World Modeling: A Survey4 Sep 2025
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models1 Jul 2025
12 newest of 16 All 16 (JSON)
- 2025ImagiDrive: A Unified Imagination-and-Planning Framework for Autonomous Drivingcited by 25
- 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Modelcited by 14
- 2026Composing Driving Worlds through Disentangled Control for Adversarial Scenario Generationcited by 2
- 2026Composing Driving Worlds through Disentangled Control for Adversarial Scenario Generation13 Mar 2026
- 2025ImagiDrive: A Unified Imagination-and-Planning Framework for Autonomous Driving15 Aug 2025
- 2024Bench2Drive-R: Turning Real World Data into Reactive Closed-Loop Autonomous Driving Benchmark by Generative Model11 Dec 2024
Similar, not cited
Close in wording, no citation either way
- 2025The Role of World Models in Shaping Autonomous Driving: A Comprehensive Survey
- 2026DrivingGen: A Comprehensive Benchmark for Generative Video World Models in Autonomous Driving
- 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT
- 2024Exploring the Interplay Between Video Generation and World Models in Autonomous Driving: A Survey
- 2025ProphetDWM: A Driving World Model for Rolling Out Future Actions and Videos
- 2024DrivingDojo Dataset: Advancing Interactive and Knowledge-Enriched Driving World Model
- 2025HybridWorldSim: A Scalable and Controllable High-fidelity Simulator for Autonomous Driving
- 2026HelloWorld: Towards Practical Applications of Generative Driving World Models