RealityBridge: Bridging Editable 3D Gaussian Splatting Driving Simulations and Real-World Videos
On the map: World models → World models for autonomous driving
Abstract (arXiv)
Long-tail hazardous scenarios are essential for safety-oriented autonomous driving, yet they are difficult to collect at scale. Editable 3D Gaussian Splatting (3DGS) simulation offers a scalable alternative through real-scene reconstruction and controllable editing. However, edited 3DGS-rendered videos often exhibit a significant Sim-to-Real gap, manifested as rendering artifacts, degraded foreground assets, illumination mismatch, and temporal flickering. Addressing these coupled defects requires jointly restoring local appearance, harmonizing edited content, and maintaining temporal consistency, whereas existing methods typically address only a subset of these requirements. To fill this gap, we propose RealityBridge, a video restoration and harmonization framework that converts edited 3DGS renderings into realistic driving footage while preserving simulator-defined structure, edits, and dynamics. RealityBridge conditions a video foundation model on complementary modality signals, with a lightweight GateNet adaptively controlling their injection across backbone blocks. We further develop a task-oriented curation pipeline to construct training data, and design a four-stage supervised training strategy followed by reward-guided post-training. Extensive experiments demonstrate that RealityBridge outperforms existing methods in restoration and harmonization while preserving strong temporal consistency.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in World models for autonomous driving, one of 11 directions in World models. Builds on 49 of its 60 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
49 of 60 references.
Closest ancestors · 2
Same direction, newest first
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Driving2 Dec
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehicles22 Jun
Other references · 47
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023VBench: Comprehensive Benchmark Suite for Video Generative Modelscited by 1,822
- 2018Towards Accurate Generative Models of Video: A New Metric & Challengescited by 1,234
- 2022Building Normalizing Flows with Stochastic Interpolantscited by 995
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2023SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Renderingcited by 616
35 more
- 2025VACE: All-in-One Video Creation and Editingcited by 479
- 2024CAT3D: Create Anything in 3D with Multi-View Diffusion Modelscited by 432
- 2024YOLOv11: An Overview of the Key Architectural Enhancementscited by 425
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 403
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
- 2025Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generationcited by 356
- 2023GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splattingcited by 335
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
- 2025Improving Video Generation with Human Feedbackcited by 284
- 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 217
- 2022Splicing ViT Features for Semantic Appearance Transfercited by 209
- 2025World Simulation with Video Foundation Models for Physical AIcited by 200
- 2023MARS: An Instance-aware, Modular and Realistic Simulator for Autonomous Drivingcited by 170
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 2023SUDS: Scalable Urban Dynamic Scenescited by 151
- 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 150
- 2025Pseudo-Simulation for Autonomous Drivingcited by 150
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
- 2024Towards learning-based planning:The nuPlan benchmark for real-world autonomous drivingcited by 104
- 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
- 2024SplatAD: Real-Time Lidar and Camera Rendering with 3D Gaussian Splatting for Autonomous Drivingcited by 69
- 2025GenFusion: Closing the Loop between Reconstruction and Generation via Videoscited by 41
- 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priorscited by 38
- 2021A Survey on Simulators for Testing Self-Driving Carscited by 27
- 2023GANeRF: Leveraging Discriminators to Optimize Neural Radiance Fieldscited by 26
- 2025NormalCrafter: Learning Temporally Consistent Normals from Video Diffusion Priorscited by 25
- 2025R3D2: Realistic 3D Asset Insertion via Diffusion for Autonomous Driving Simulationcited by 18
- 2025Lumen: Consistent Video Relighting and Harmonious Background Replacement with Video Generative Modelscited by 13
- 2026DiffusionHarmonizer: Bridging Neural Reconstruction and Photorealistic Simulation with Online Diffusion Enhancercited by 10
- 2026GaussFusion: Improving 3D Reconstruction in the Wild with A Geometry-Informed Video Generatorcited by 7
- 2025Diffusion Models are Secretly Zero-Shot 3DGS Harmonizerscited by 2
- 2026FreeFix: Boosting 3D Gaussian Splatting via Fine-Tuning-Free Diffusion Modelscited by 2
- 2026Unified Sensor Simulation for Autonomous Drivingcited by 1
- 2026LiDAR-EVS: Enhance Extrapolated View Synthesis for 3D Gaussian Splatting with Pseudo-LiDAR Supervisioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Real2Sim: A Physics-driven and Editable Gaussian Splatting Framework for Autonomous Driving Scenes
- 2026DecoupleGS: Interactive 3D Gaussian Splatting for End-to-End Autonomous Driving Testing
- 2026SPVC: Structured and Panoptic Video Fixing for Cross-Dataset Driving Scene Rendering
- 2026HorizonForge: Driving Scene Editing with Any Trajectories and Any Vehicles
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes
- 2025Industrial-Grade Sensor Simulation via Gaussian Splatting: A Modular Framework for Scalable Editing and Full-Stack Validation
- 2024textitS3Gaussian: Self-Supervised Street Gaussians for Autonomous Driving
- 2026ReconDrive: Fast Feed-Forward 4D Gaussian Splatting for Autonomous Driving Scene Reconstruction