Mirage: One-Step Video Diffusion for Photorealistic and Coherent Asset Editing in Driving Scenes
On the map: Diffusion models → Diffusion and flow policies for robotics
Abstract (arXiv)
Vision-centric autonomous driving systems rely on diverse and scalable training data to achieve robust performance. While video object editing offers a promising path for data augmentation, existing methods often struggle to maintain both high visual fidelity and temporal coherence. In this work, we propose Mirage, a one-step video diffusion model for photorealistic and coherent asset editing in driving scenes. Mirage builds upon a text-to-video diffusion prior to ensure temporal consistency across frames. However, 3D causal variational autoencoders often suffer from degraded spatial fidelity due to compression, and directly passing 3D encoder features to decoder layers breaks temporal causality. To address this, we inject temporally agnostic latents from a pretrained 2D encoder into the 3D decoder to restore detail while preserving causal structures. Furthermore, because scene objects and inserted assets are optimized under different objectives, their Gaussians exhibit a distribution mismatch that leads to pose misalignment. To mitigate this, we introduce a two-stage data alignment strategy combining coarse 3D alignment and fine 2D refinement, thereby improving alignment and providing cleaner supervision. Extensive experiments demonstrate that Mirage achieves high realism and temporal consistency across diverse editing scenarios. Beyond asset editing, Mirage can also generalize to other video-to-video translation tasks, serving as a reliable baseline for future research. Our code is available at https://github.com/wm-research/mirage.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 35 of its 40 references that are in the map. First posted on arXiv 30 Dec 2025.
Builds on
35 of 40 references.
References · 35
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
23 more
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
- 2018Video-to-Video Synthesiscited by 390
- 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
- 2023Pix2Video: Video Editing using Image Diffusioncited by 320
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2018Learning Blind Video Temporal Consistencycited by 253
- 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
- 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 191
- 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 168
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 2022FILM: Frame Interpolation for Large Motioncited by 153
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 151
- 2024One-Step Image Translation with Text-to-Image Modelscited by 116
- 2024SplatAD: Real-Time Lidar and Camera Rendering with 3D Gaussian Splatting for Autonomous Drivingcited by 69
- 2024SF-V: Single Forward Video Generation Modelcited by 40
- 2025DOVE: Efficient One-Step Diffusion Model for Real-World Video Super-Resolutioncited by 31
- 2024Photorealistic Object Insertion with Diffusion-Guided Inverse Renderingcited by 27
- 2025R3D2: Realistic 3D Asset Insertion via Diffusion for Autonomous Driving Simulationcited by 18
- 2024DriveEditor: A Unified 3D Information-Guided Framework for Controllable Object Editing in Driving Scenescited by 17
- 2025One-Step Diffusion for Detail-Rich and Temporally Consistent Video Super-Resolutioncited by 15
- 2024GenMM: Geometrically and Temporally Consistent Multimodal Data Generation for Video and LiDARcited by 12
- 2025Realistic and Controllable 3D Gaussian-Guided Object Editing for Driving Video Generationcited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Composing Driving Worlds through Disentangled Control for Adversarial Scenario Generationcited by 2
- 2026ChopGrad: Pixel-Wise Losses for Latent Video Diffusion via Truncated Backpropagationcited by 1
- 2026Point as Skeleton: Accumulated Point Cloud Enhanced Autoregressive Generation for Closed-Loop Autonomous Driving Simulationcited by 1
- 2026Point as Skeleton: Accumulated Point Cloud Enhanced Autoregressive Generation for Closed-Loop Autonomous Driving Simulation7 Jul 2026
- 2026ChopGrad: Pixel-Wise Losses for Latent Video Diffusion via Truncated Backpropagation18 Mar 2026
- 2026Composing Driving Worlds through Disentangled Control for Adversarial Scenario Generation13 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehicles
- 2026OneFixer: High-Quality and Consistent One-Step Autoregressive 3DGS Refinement for Driving Scenes
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Rendering
- 2026DriveFix: Spatio-Temporally Coherent Driving Scene Restoration
- 2025DrivingGaussian++: Towards Realistic Reconstruction and Editable Simulation for Surrounding Dynamic Driving Scenes
- 2025MultiEditor: Controllable Multimodal Object Editing for Driving Scenarios Using 3D Gaussian Splatting Priors
- 2025SceneCrafter: Controllable Multi-View Driving Scene Editing
- 2024Drive-1-to-3: Enriching Diffusion Priors for Novel View Synthesis of Real Vehicles