mlsanityData to 14 Oct 2026

RealityBridge: Bridging Editable 3D Gaussian Splatting Driving Simulations and Real-World Videos

arXiv 2606.16278 ↗First posted 15 Jun 2026cs.CV cs.AIcited by 1

On the map: World models → World models for autonomous driving

Abstract (arXiv)

Long-tail hazardous scenarios are essential for safety-oriented autonomous driving, yet they are difficult to collect at scale. Editable 3D Gaussian Splatting (3DGS) simulation offers a scalable alternative through real-scene reconstruction and controllable editing. However, edited 3DGS-rendered videos often exhibit a significant Sim-to-Real gap, manifested as rendering artifacts, degraded foreground assets, illumination mismatch, and temporal flickering. Addressing these coupled defects requires jointly restoring local appearance, harmonizing edited content, and maintaining temporal consistency, whereas existing methods typically address only a subset of these requirements. To fill this gap, we propose RealityBridge, a video restoration and harmonization framework that converts edited 3DGS renderings into realistic driving footage while preserving simulator-defined structure, edits, and dynamics. RealityBridge conditions a video foundation model on complementary modality signals, with a lightweight GateNet adaptively controlling their injection across backbone blocks. We further develop a task-oriented curation pipeline to construct training data, and design a four-stage supervised training strategy followed by reward-guided post-training. Extensive experiments demonstrate that RealityBridge outperforms existing methods in restoration and harmonization while preserving strong temporal consistency.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 49 of its 60 references that are in the map. First posted on arXiv 15 Jun 2026.

Builds on

49 of 60 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving2 Dec
  2. 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun

Other references · 47

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  3. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  7. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  8. 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
  9. 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
  10. 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
  11. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  12. 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
35 more
  1. 2025VACE: All-in-One Video Creation and Editingcited by 479
  2. 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
  3. 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
  4. 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
  5. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
  6. 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
  7. 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
  8. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
  9. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
  10. 2025Improving Video Generation with Human Feedbackcited by 284
  11. 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 217
  12. 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
  13. 2025World Simulation with Video Foundation Models for Physical AIcited by 200
  14. 2023MARS: An Instance-aware, Modular and Realistic Simulator for Autonomous Drivingcited by 170
  15. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
  16. 2023SUDS: Scalable Urban Dynamic Scenescited by 151
  17. 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 150
  18. 2025Pseudo-Simulation for Autonomous Drivingcited by 150
  19. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
  20. 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous drivingcited by 104
  21. 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
  22. 2024SplatAD: Real-Time Lidar and Camera Rendering with 3D Gaussian Splatting for Autonomous Drivingcited by 69
  23. 2025GenFusion: Closing the Loop between Reconstruction and Generation via Videoscited by 41
  24. 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priorscited by 38
  25. 2021A Survey on Simulators for Testing Self-Driving Carscited by 27
  26. 2023GANeRF: Leveraging Discriminators to Optimize Neural Radiance Fieldscited by 26
  27. 2025NormalCrafter: Learning Temporally Consistent Normals from Video Diffusion Priorscited by 25
  28. 2025R3D2: Realistic 3D Asset Insertion via Diffusion for Autonomous Driving Simulationcited by 18
  29. 2025Lumen: Consistent Video Relighting and Harmonious Background Replacement with Video Generative Modelscited by 13
  30. 2026DiffusionHarmonizer: Bridging Neural Reconstruction and Photorealistic Simulation with Online Diffusion Enhancercited by 10
  31. 2026GaussFusion: Improving 3D Reconstruction in the Wild with A Geometry-Informed Video Generatorcited by 7
  32. 2025Diffusion Models are Secretly Zero-Shot 3DGS Harmonizerscited by 2
  33. 2026FreeFix: Boosting 3D Gaussian Splatting via Fine-Tuning-Free Diffusion Modelscited by 2
  34. 2026Unified Sensor Simulation for Autonomous Drivingcited by 1
  35. 2026LiDAR-EVS: Enhance Extrapolated View Synthesis for 3D Gaussian Splatting with Pseudo-LiDAR Supervisioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Real2Sim: A Physics-driven and Editable Gaussian Splatting Framework for Autonomous Driving Scenes
  2. 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testing
  3. 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Rendering
  4. 2026HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehicles
  5. 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes
  6. 2025Industrial-Grade Sensor Simulation via Gaussian Splatting: A Modular Framework for Scalable Editing and Full-Stack Validation
  7. 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Driving
  8. 2026ReconDrive: Fast Feed-Forward 4D Gaussian Splatting for Autonomous Driving Scene Reconstruction