ConsisDrive: Identity-Preserving Driving World Models for Video Generation by Instance Mask
On the map: World models → World models for autonomous driving
also in 1 more
Abstract (arXiv)
Autonomous driving relies on robust models trained on large-scale, high-quality multi-view driving videos. Although world models provide a cost-effective solution for generating realistic driving data, they often suffer from identity drift, where the same object changes its appearance or category across frames due to the absence of instance-level temporal constraints. We introduce ConsisDrive, an identity-preserving driving world model designed to enforce temporal consistency at the instance level. Our framework incorporates two key components: (1) Instance-Masked Attention, which applies instance identity masks and trajectory masks within attention blocks to ensure that visual tokens interact only with their corresponding instance features across spatial and temporal dimensions, thereby preserving object identity consistency; and (2) Instance-Masked Loss, which adaptively emphasizes foreground regions with probabilistic instance masking, reducing background noise while maintaining overall scene fidelity. By integrating these mechanisms, ConsisDrive achieves state-of-the-art driving video generation quality and demonstrates significant improvements in downstream autonomous driving tasks on the nuScenes dataset. Our project page is https://shanpoyang654.github.io/ConsisDrive/page.html.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 38 of its 47 references that are in the map. First posted on arXiv 3 Feb 2026.
Builds on
38 of 47 references.
Closest ancestors · 5
Same direction, newest first
- 2024DriveScape: Towards High-Resolution Controllable Multi-View Driving Video Generation9 Sep
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar
- 2024GenAD: Generative End-to-End Autonomous Driving18 Feb
- 2023ADriver-I: A General World Model for Autonomous Driving22 Nov
- 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving18 Sep
Other references · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2022Video Diffusion Modelscited by 2,305
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2023Animate Anyone: Consistent and Controllable Image-to-Video Synthesis for Character Animationcited by 688
- 2023ModelScope Text-to-Video Technical Reportcited by 658
- 2024Open-Sora: Democratizing Efficient Video Production for Allcited by 652
21 more
- 2023VAD: Vectorized Scene Representation for Efficient Autonomous Drivingcited by 622
- 2024LTX-Video: Realtime Video Latent Diffusioncited by 581
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 490
- 2024Lumiere: A Space-Time Diffusion Model for Video Generationcited by 455
- 2020Virtual KITTI 2cited by 353
- 2023Exploring Object-Centric Temporal Modeling for Efficient Multi-View 3D Object Detectioncited by 315
- 2023Photorealistic Video Generation with Diffusion Modelscited by 306
- 2016Learning from Simulated and Unsupervised Images through Adversarial Trainingcited by 288
- 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
- 2025Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsitycited by 217
- 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 168
- 2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
- 2023BEVControl: Accurately Controlling Street-view Elements with Multi-perspective Consistency via BEV Sketch Layoutcited by 102
- 2024MagicDrive-V2: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Controlcited by 92
- 2023DrivingDiffusion: Layout-Guided multi-view driving scene video generation with latent diffusion modelcited by 75
- 2023PyramidFlow: High-Resolution Defect Contrastive Localization using Pyramid Normalizing Flowcited by 74
- 2024Ca2-VDM: Efficient Autoregressive Video Diffusion Model with Causal Generation and Cache Sharingcited by 74
- 2024Allegro: Open the Black Box of Commercial-Level Video Generation Modelcited by 70
- 2024DrivingSphere: Building a High-fidelity 4D World for Closed-loop Simulationcited by 34
- 2024UniMLVG: Unified Framework for Multi-view Long Video Generation with Comprehensive Control Capabilities for Autonomous Drivingcited by 27
- 2024Qihoo-T2X: An Efficient Proxy-Tokenized Diffusion Transformer for Text-to-Any-Taskcited by 9
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026InstaDrive: Instance-Aware Driving World Models for Realistic and Consistent Video Generation
- 2025MaskGWM: A Generalizable Driving World Model with Video Mask Reconstruction
- 2024Unleashing Generalization of End-to-End Autonomous Driving with Controllable Long Video Generation
- 2025Seeing Clearly, Forgetting Deeply: Revisiting Fine-Tuned Video Generators for Driving Simulation
- 2024InfinityDrive: Breaking Time Limits in Driving World Models
- 2024Physical Informed Driving World Model
- 2024DreamDrive: Generative 4D Scene Modeling from Street View Images
- 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT