mlsanityData to 14 Oct 2026

Mirage: One-Step Video Diffusion for Photorealistic and Coherent Asset Editing in Driving Scenes

arXiv 2512.24227 ↗First posted 30 Dec 2025cs.CVcited by 3

On the map: Diffusion models → Diffusion and flow policies for robotics

Abstract (arXiv)

Vision-centric autonomous driving systems rely on diverse and scalable training data to achieve robust performance. While video object editing offers a promising path for data augmentation, existing methods often struggle to maintain both high visual fidelity and temporal coherence. In this work, we propose Mirage, a one-step video diffusion model for photorealistic and coherent asset editing in driving scenes. Mirage builds upon a text-to-video diffusion prior to ensure temporal consistency across frames. However, 3D causal variational autoencoders often suffer from degraded spatial fidelity due to compression, and directly passing 3D encoder features to decoder layers breaks temporal causality. To address this, we inject temporally agnostic latents from a pretrained 2D encoder into the 3D decoder to restore detail while preserving causal structures. Furthermore, because scene objects and inserted assets are optimized under different objectives, their Gaussians exhibit a distribution mismatch that leads to pose misalignment. To mitigate this, we introduce a two-stage data alignment strategy combining coarse 3D alignment and fine 2D refinement, thereby improving alignment and providing cleaner supervision. Extensive experiments demonstrate that Mirage achieves high realism and temporal consistency across diverse editing scenarios. Beyond asset editing, Mirage can also generalize to other video-to-video translation tasks, serving as a reliable baseline for future research. Our code is available at https://github.com/wm-research/mirage.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 35 of its 40 references that are in the map. First posted on arXiv 30 Dec 2025.

Builds on

35 of 40 references.

References · 35

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  4. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  5. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  6. 2017Decoupled Weight Decay Regularizationcited by 1,831
  7. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  8. 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
  9. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  10. 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
  11. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 770
  12. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 640
23 more
  1. 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
  2. 2018Video-to-Video Synthesiscited by 390
  3. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllabilitycited by 347
  4. 2023Pix2Video: Video Editing using Image Diffusioncited by 320
  5. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  6. 2018Learning Blind Video Temporal Consistencycited by 253
  7. 2024Score identity Distillation: Exponentially Fast Distillation of Pretrained Diffusion Models for One-Step Generationcited by 214
  8. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generationcited by 191
  9. 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 168
  10. 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
  11. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
  12. 2022FILM: Frame Interpolation for Large Motioncited by 153
  13. 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 151
  14. 2024One-Step Image Translation with Text-to-Image Modelscited by 116
  15. 2024SplatAD: Real-Time Lidar and Camera Rendering with 3D Gaussian Splatting for Autonomous Drivingcited by 69
  16. 2024SF-V: Single Forward Video Generation Modelcited by 40
  17. 2025DOVE: Efficient One-Step Diffusion Model for Real-World Video Super-Resolutioncited by 31
  18. 2024Photorealistic Object Insertion with Diffusion-Guided Inverse Renderingcited by 27
  19. 2025R3D2: Realistic 3D Asset Insertion via Diffusion for Autonomous Driving Simulationcited by 18
  20. 2024DriveEditor: A Unified 3D Information-Guided Framework for Controllable Object Editing in Driving Scenescited by 17
  21. 2025One-Step Diffusion for Detail-Rich and Temporally Consistent Video Super-Resolutioncited by 15
  22. 2024GenMM: Geometrically and Temporally Consistent Multimodal Data Generation for Video and LiDARcited by 12
  23. 2025Realistic and Controllable 3D Gaussian-Guided Object Editing for Driving Video Generationcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehicles
  2. 2026OneFixer: High-Quality and Consistent One-Step Autoregressive 3DGS Refinement for Driving Scenes
  3. 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Rendering
  4. 2026DriveFix: Spatio-Temporally Coherent Driving Scene Restoration
  5. 2025DrivingGaussian++: Towards Realistic Reconstruction and Editable Simulation for Surrounding Dynamic Driving Scenes
  6. 2025MultiEditor: Controllable Multimodal Object Editing for Driving Scenarios Using 3D Gaussian Splatting Priors
  7. 2025SceneCrafter: Controllable Multi-View Driving Scene Editing
  8. 2024Drive-1-to-3: Enriching Diffusion Priors for Novel View Synthesis of Real Vehicles