mlsanityData to 13 Oct 2026

Instant NuRec: Feed-Forward 3D Gaussian Reconstruction for Driving Scene Simulation

arXiv 2607.14203 ↗First posted 15 Jul 2026cs.GR cs.AI cs.CVcited by 2

On the map: End-to-end autonomous driving → Generative simulation for driving

Abstract (arXiv)

3D simulation platforms are critical for autonomous driving because they enable end-to-end policy evaluation, thereby reducing development costs and improving safety. In recent years, neural simulation has become predominant, with methods such as NuRec playing a central role; however, these methods remain relatively slow and typically require per-scene tuning. In this work, we present Instant NuRec, a feed-forward neural reconstruction model that turns a short multi-view driving log into a fully simulatable 3D Gaussian Splatting (3DGS) world in a single forward pass. The model accepts multi-view input from a calibrated camera rig and emits a layered output consisting of static and dynamic 3DGS layers, a sky cubemap, and per-camera ISP corrections, while providing native support for non-pinhole camera models via 3DGUT. It reconstructs a 10-20-second multi-camera scene in roughly 1.5 seconds and achieves a PSNR on the Waymo Open Dataset that is 2.01 dB above the strongest evaluated baseline. Instant NuRec is deeply integrated into NuRec and is compatible with AlpaSim for closed-loop simulation.

Key facts. Cited by 2 papers in the map (data through 13 Oct 2026). Placed in Generative simulation for driving, one of 9 directions in End-to-end autonomous driving. Builds on 69 of its 71 references that are in the map. First posted on arXiv 15 Jul 2026.

Builds on

69 of 71 references.

Closest ancestors · 13

Same direction, newest first

  1. 2026ReconDrive: Fast Feed-Forward 4D Gaussian Splatting for Autonomous Driving Scene Reconstruction8 Mar
  2. 2025Epona: Autoregressive Diffusion World Model for Autonomous Driving30 Jun
  3. 2025Cosmos-Drive-Dreams: Scalable Synthetic Driving Data Generation with World Foundation Models10 Jun
  4. 2025GAIA-2: A Controllable Multi-View Generative World Model for Autonomous Driving26 Mar
  5. 2025VaViM and VaVAM: Autonomous Driving through Video Generative Modeling21 Feb
  6. 2024DrivingWorld: Constructing World Model for Autonomous Driving via Video GPT27 Dec
  7. 2024ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restoration29 Nov
  8. 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representation17 Oct
  9. 2024Vista: A Generalizable Driving World Model with High Fidelity and Versatile Controllability27 May
  10. 2024DriveDreamer-2: LLM-Enhanced World Models for Diverse Driving Video Generation11 Mar
  11. 2023Driving into the Future: Multiview Visual Forecasting and Planning with World Model for Autonomous Driving29 Nov
  12. 2023GAIA-1: A Generative World Model for Autonomous Driving29 Sep
1 more
  1. 2023DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving18 Sep

Other references · 56

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  2. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,082
  3. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,857
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,170
  5. 2022Scalable Diffusion Models with Transformerscited by 5,973
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,440
  7. 2021Vision Transformers for Dense Predictioncited by 1,795
  8. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,539
  9. 2023Zero-1-to-3: Zero-shot One Image to 3D Objectcited by 1,486
  10. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,231
  11. 2023MVDream: Multi-view Diffusion for 3D Generationcited by 931
  12. 2025Cosmos World Foundation Model Platform for Physical AIcited by 848
38 more
  1. 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 753
  2. 2024LGM: Large Multi-View Gaussian Model for High-Resolution 3D Content Creationcited by 732
  3. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 721
  4. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 673
  5. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 663
  6. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 658
  7. 2024MVSplat: Efficient 3D Gaussian Splatting from Sparse Multi-View Imagescited by 557
  8. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 359
  9. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 349
  10. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 345
  11. 2020Neural Scene Graphs for Dynamic Scenescited by 298
  12. 2024DepthSplat: Connecting Gaussian Splatting and Depthcited by 277
  13. 2021Urban Radiance Fieldscited by 263
  14. 2023ImageDream: Image-Prompt Multi-view Diffusion for 3D Generationcited by 256
  15. 2023MagicDrive: Street View Generation with Diverse 3D Geometry Controlcited by 252
  16. 2024No Pose, No Problem: Surprisingly Simple 3D Gaussian Splats from Sparse Unposed Imagescited by 243
  17. 2025AnySplat: Feed-forward 3D Gaussian Splatting from Unconstrained Viewscited by 238
  18. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 218
  19. 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 217
  20. 2023Panacea: Panoramic and Controllable Video Generation for Autonomous Drivingcited by 166
  21. 2025Native and Compact Structured Latents for 3D Generationcited by 164
  22. 2024OmniRe: Omni Urban Scene Reconstructioncited by 160
  23. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
  24. 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 147
  25. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  26. 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 141
  27. 20243D Gaussian Ray Tracing: Fast Tracing of Particle Scenescited by 138
  28. 20243DGUT: Enabling Distorted Cameras and Secondary Rays in Gaussian Splattingcited by 88
  29. 2024GEM: A Generalizable Ego-Vision Multimodal World Model for Fine-Grained Ego-Motion, Object Dynamics, and Scene Composition Controlcited by 77
  30. 2024DrivingForward: Feed-forward 3D Gaussian Splatting for Driving Scene Reconstruction from Flexible Surround-view Inputcited by 53
  31. 2024FreeVS: Generative View Synthesis on Free Driving Trajectorycited by 53
  32. 2024STORM: Spatio-Temporal Reconstruction Model for Large-Scale Outdoor Scenescited by 53
  33. 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
  34. 2024DreamDrive: Generative 4D Scene Modeling from Street View Imagescited by 35
  35. 2026V-DPM: 4D Video Reconstruction with Dynamic Point Mapscited by 31
  36. 2025DGGT: Feedforward 4D Reconstruction of Dynamic Driving Scenes using Unposed Imagescited by 22
  37. 20264RC: 4D Reconstruction via Conditional Querying Anytime and Anywherecited by 19
  38. 2026TokenGS: Decoupling 3D Gaussian Prediction from Pixels with Learnable Tokenscited by 12

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Cam2Sim: Neural Scenario Reconstruction for Closed-Loop Autonomous Driving Simulation
  2. 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testing
  3. 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Driving
  4. 2025DrivingScene: A Multi-Task Online Feed-Forward 3D Gaussian Splatting Method for Dynamic Driving Scenes
  5. 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey
  6. 2025Industrial-Grade Sensor Simulation via Gaussian Splatting: A Modular Framework for Scalable Editing and Full-Stack Validation
  7. 2025R3D2: Realistic 3D Asset Insertion via Diffusion for Autonomous Driving Simulation
  8. 2026Real2Sim: A Physics-driven and Editable Gaussian Splatting Framework for Autonomous Driving Scenes