FaithFusion: Harmonizing Reconstruction and Generation via Pixel-wise Information Gain
Not on the map. Why?
Abstract (arXiv)
In controllable driving-scene reconstruction and 3D scene generation, maintaining geometric fidelity while synthesizing visually plausible appearance under large viewpoint shifts is crucial. However, effective fusion of geometry-based 3DGS and appearance-driven diffusion models faces inherent challenges, as the absence of pixel-wise, 3D-consistent editing criteria often leads to over-restoration and geometric drift. To address these issues, we introduce FaithFusion, a 3DGS-diffusion fusion framework driven by pixel-wise Expected Information Gain (EIG). EIG acts as a unified policy for coherent spatio-temporal synthesis: it guides diffusion as a spatial prior to refine high-uncertainty regions, while its pixel-level weighting distills the edits back into 3DGS. The resulting plug-and-play system is free from extra prior conditions and structural modifications.Extensive experiments on the Waymo dataset demonstrate that our approach attains SOTA performance across NTA-IoU, NTL-IoU, and FID, maintaining an FID of 107.47 even at 6 meters lane shift. Our code is available at https://github.com/wangyuanbiubiubiu/FaithFusion.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 58 of its 66 references that are in the map. First posted on arXiv 26 Nov 2025.
Builds on
58 of 66 references.
References · 58
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2022Video Diffusion Modelscited by 2,305
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2023Consistency Modelscited by 1,822
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
38 more
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2021Laplace Redux -- Effortless Bayesian Deep Learningcited by 365
- 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
- 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
- 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 217
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 173
- 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 2023SUDS: Scalable Urban Dynamic Scenescited by 151
- 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 150
- 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
- 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 127
- 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representationcited by 123
- 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 121
- 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
- 2023S-NeRF: Neural Radiance Fields for Street Viewscited by 116
- 2024RaDe-GS: Rasterizing Depth in Gaussian Splattingcited by 111
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
- 2023Bayes' Rays: Uncertainty Quantification for Neural Radiance Fieldscited by 91
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Drivingcited by 90
- 2024ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restorationcited by 89
- 2024FreeVS: Generative View Synthesis on Free Driving Trajectorycited by 53
- 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
- 2024SGD: Street View Synthesis with Gaussian Splatting and Diffusion Priorcited by 36
- 2025ReconDreamer++: Harmonizing Generative and Reconstructive Models for Driving Scene Representationcited by 36
- 2022Unifying Approaches in Active Learning and Active Sampling via Fisher Information and Information-Theoretic Quantitiescited by 28
- 2024VEGS: View Extrapolation of Urban Scenes in 3D Gaussian Splatting using Learned Priorscited by 25
- 2023UC-NeRF: Neural Radiance Field for Under-Calibrated Multi-view Cameras in Autonomous Drivingcited by 23
- 2023RoMe: Towards Large Scale Road Surface Reconstruction via Mesh Representationcited by 20
- 2024Modeling uncertainty for Gaussian Splattingcited by 19
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes
- 2023Generative Novel View Synthesis with 3D-Aware Diffusion Models
- 2026DriveFix: Spatio-Temporally Coherent Driving Scene Restoration
- 2024Coherent 3D Scene Diffusion From a Single RGB Image
- 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
- 2026Enhancing Novel View Synthesis via Geometry Grounded Set Diffusion
- 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis
- 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction