mlsanityData to 7 Oct 2026

DriveFix: Spatio-Temporally Coherent Driving Scene Restoration

arXiv 2603.16306 ↗First posted 17 Mar 2026cs.CVcited by 0

On the map: Diffusion models → Diffusion and flow policies for robotics

also in 1 more
Abstract (arXiv)

Recent advancements in 4D scene reconstruction, particularly those leveraging diffusion priors, have shown promise for novel view synthesis in autonomous driving. However, these methods often process frames independently or in a view-by-view manner, leading to a critical lack of spatio-temporal synergy. This results in spatial misalignment across cameras and temporal drift in sequences. We propose DriveFix, a novel multi-view restoration framework that ensures spatio-temporal coherence for driving scenes. Our approach employs an interleaved diffusion transformer architecture with specialized blocks to explicitly model both temporal dependencies and cross-camera spatial consistency. By conditioning the generation on historical context and integrating geometry-aware training losses, DriveFix enforces that the restored views adhere to a unified 3D geometry. This enables the consistent propagation of high-fidelity textures and significantly reduces artifacts. Extensive evaluations on the Waymo, nuScenes, and PandaSet datasets demonstrate that DriveFix achieves state-of-the-art performance in both reconstruction and novel view synthesis, marking a substantial step toward robust 4D world modeling for real-world deployment.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 52 of its 56 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

52 of 56 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025DiVE: Efficient Multi-View Driving Scenes Generation Based on Video Diffusion Transformer28 Apr
  2. 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Models17 Dec
  3. 2024DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenes6 Sep

Other references · 49

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  6. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  7. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
  8. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  9. 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
  10. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  11. 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
  12. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
37 more
  1. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
  2. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
  3. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
  4. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
  5. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
  6. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
  7. 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 216
  8. 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 186
  9. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
  10. 2024OmniRe: Omni Urban Scene Reconstructioncited by 159
  11. 2023SUDS: Scalable Urban Dynamic Scenescited by 151
  12. 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 146
  13. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  14. 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 140
  15. 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
  16. 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 137
  17. 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representationcited by 123
  18. 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
  19. 2023S-NeRF: Neural Radiance Fields for Street Viewscited by 116
  20. 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
  21. 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
  22. 2024DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Drivingcited by 98
  23. 2024ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restorationcited by 89
  24. 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 86
  25. 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Drivingcited by 84
  26. 2024SplatAD: Real-Time Lidar and Camera Rendering with 3D Gaussian Splatting for Autonomous Drivingcited by 66
  27. 2024FreeVS: Generative View Synthesis on Free Driving Trajectorycited by 52
  28. 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Modelcited by 45
  29. 2024DeSiRe-GS: 4D Street Gaussians for Static-Dynamic Decomposition and Surface Reconstruction for Urban Driving Scenescited by 45
  30. 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Modelcited by 40
  31. 2025ReconDreamer++: Harmonizing Generative and Reconstructive Models for Driving Scene Representationcited by 36
  32. 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
  33. 2023MarS3D: A Plug-and-Play Motion-Aware Model for Semantic Segmentation on Multi-Scan 3D Point Cloudscited by 19
  34. 2025VideoPanda: Video Panoramic Diffusion with Multi-view Attentioncited by 13
  35. 2024EGSRAL: An Enhanced 3D Gaussian Splatting based Renderer with Automated Labeling for Large-Scale Driving Scenecited by 3
  36. 2025IDSplat: Instance-Decomposed 3D Gaussian Splatting for Driving Scenescited by 3
  37. 2025SymDrive: Realistic and Controllable Driving Simulator via Symmetric Auto-regressive Online Restorationcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025DriveGen3D: Boosting Feed-Forward Driving Scene Generation with Efficient Video Diffusion
  2. 2024DreamDrive: Generative 4D Scene Modeling from Street View Images
  3. 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes
  4. 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Driving
  5. 2025DriveExplorer: Images-Only Decoupled 4D Reconstruction with Progressive Restoration for Driving View Extrapolation
  6. 2026USR-Drive: Unified Driving Scene Representation via Joint Denoising of 3D Gaussians and Boxes
  7. 2024Driving View Synthesis on Free-form Trajectories with Generative Prior
  8. 2025DrivingScene: A Multi-Task Online Feed-Forward 3D Gaussian Splatting Method for Dynamic Driving Scenes