DriveFix: Spatio-Temporally Coherent Driving Scene Restoration
On the map: Diffusion models → Diffusion and flow policies for robotics
also in 1 more
Abstract (arXiv)
Recent advancements in 4D scene reconstruction, particularly those leveraging diffusion priors, have shown promise for novel view synthesis in autonomous driving. However, these methods often process frames independently or in a view-by-view manner, leading to a critical lack of spatio-temporal synergy. This results in spatial misalignment across cameras and temporal drift in sequences. We propose DriveFix, a novel multi-view restoration framework that ensures spatio-temporal coherence for driving scenes. Our approach employs an interleaved diffusion transformer architecture with specialized blocks to explicitly model both temporal dependencies and cross-camera spatial consistency. By conditioning the generation on historical context and integrating geometry-aware training losses, DriveFix enforces that the restored views adhere to a unified 3D geometry. This enables the consistent propagation of high-fidelity textures and significantly reduces artifacts. Extensive evaluations on the Waymo, nuScenes, and PandaSet datasets demonstrate that DriveFix achieves state-of-the-art performance in both reconstruction and novel view synthesis, marking a substantial step toward robust 4D world modeling for real-world deployment.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 52 of its 56 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
52 of 56 references.
Closest ancestors · 3
Same direction, newest first
- 2025DiVE: Efficient Multi-View Driving Scenes Generation Based on Video Diffusion Transformer28 Apr
- 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Models17 Dec
- 2024DreamForge: Motion-Aware Autoregressive Video Generation for Multi-View Driving Scenes6 Sep
Other references · 49
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,436
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2023Wonder3D: Single Image to 3D using Cross-Domain Diffusioncited by 682
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
37 more
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 661
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 294
- 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 234
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
- 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 216
- 2021PandaSet: Advanced Sensor Suite Dataset for Autonomous Drivingcited by 186
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 159
- 2023SUDS: Scalable Urban Dynamic Scenescited by 151
- 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 146
- 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
- 2024MeshAnything: Artist-Created Mesh Generation with Autoregressive Transformerscited by 140
- 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
- 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 137
- 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representationcited by 123
- 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
- 2023S-NeRF: Neural Radiance Fields for Street Viewscited by 116
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Drivingcited by 105
- 20244Diffusion: Multi-view Video Diffusion Model for 4D Generationcited by 104
- 2024DriveArena: A Closed-loop Generative Simulation Platform for Autonomous Drivingcited by 98
- 2024ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restorationcited by 89
- 2025Geometry Forcing: Marrying Video Diffusion and 3D Representation for Consistent World Modelingcited by 86
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Drivingcited by 84
- 2024SplatAD: Real-Time Lidar and Camera Rendering with 3D Gaussian Splatting for Autonomous Drivingcited by 66
- 2024FreeVS: Generative View Synthesis on Free Driving Trajectorycited by 52
- 2024VideoMV: Consistent Multi-View Generation Based on Large Video Generative Modelcited by 45
- 2024DeSiRe-GS: 4D Street Gaussians for Static-Dynamic Decomposition and Surface Reconstruction for Urban Driving Scenescited by 45
- 2024Vivid-ZOO: Multi-View Video Generation with Diffusion Modelcited by 40
- 2025ReconDreamer++: Harmonizing Generative and Reconstructive Models for Driving Scene Representationcited by 36
- 2025Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Surveycited by 23
- 2023MarS3D: A Plug-and-Play Motion-Aware Model for Semantic Segmentation on Multi-Scan 3D Point Cloudscited by 19
- 2025VideoPanda: Video Panoramic Diffusion with Multi-view Attentioncited by 13
- 2024EGSRAL: An Enhanced 3D Gaussian Splatting based Renderer with Automated Labeling for Large-Scale Driving Scenecited by 3
- 2025IDSplat: Instance-Decomposed 3D Gaussian Splatting for Driving Scenescited by 3
- 2025SymDrive: Realistic and Controllable Driving Simulator via Symmetric Auto-regressive Online Restorationcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025DriveGen3D: Boosting Feed-Forward Driving Scene Generation with Efficient Video Diffusion
- 2024DreamDrive: Generative 4D Scene Modeling from Street View Images
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes
- 2025WorldSplat: Gaussian-Centric Feed-Forward 4D Scene Generation for Autonomous Driving
- 2025DriveExplorer: Images-Only Decoupled 4D Reconstruction with Progressive Restoration for Driving View Extrapolation
- 2026USR-Drive: Unified Driving Scene Representation via Joint Denoising of 3D Gaussians and Boxes
- 2024Driving View Synthesis on Free-form Trajectories with Generative Prior
- 2025DrivingScene: A Multi-Task Online Feed-Forward 3D Gaussian Splatting Method for Dynamic Driving Scenes