mlsanityData to 14 Oct 2026

FaithFusion: Harmonizing Reconstruction and Generation via Pixel-wise Information Gain

arXiv 2511.21113 ↗First posted 26 Nov 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

In controllable driving-scene reconstruction and 3D scene generation, maintaining geometric fidelity while synthesizing visually plausible appearance under large viewpoint shifts is crucial. However, effective fusion of geometry-based 3DGS and appearance-driven diffusion models faces inherent challenges, as the absence of pixel-wise, 3D-consistent editing criteria often leads to over-restoration and geometric drift. To address these issues, we introduce FaithFusion, a 3DGS-diffusion fusion framework driven by pixel-wise Expected Information Gain (EIG). EIG acts as a unified policy for coherent spatio-temporal synthesis: it guides diffusion as a spatial prior to refine high-uncertainty regions, while its pixel-level weighting distills the edits back into 3DGS. The resulting plug-and-play system is free from extra prior conditions and structural modifications.Extensive experiments on the Waymo dataset demonstrate that our approach attains SOTA performance across NTA-IoU, NTL-IoU, and FID, maintaining an FID of 107.47 even at 6 meters lane shift. Our code is available at https://github.com/wangyuanbiubiubiu/FaithFusion.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 58 of its 66 references that are in the map. First posted on arXiv 26 Nov 2025.

Builds on

58 of 66 references.

References · 58

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  6. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  7. 2022Video Diffusion Modelscited by 2,305
  8. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  9. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  10. 2023Consistency Modelscited by 1,822
  11. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  12. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
38 more
  1. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
  2. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 671
  3. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
  4. 2023Instruct-NeRF2NeRF: Editing 3D Scenes with Instructionscited by 484
  5. 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
  6. 2021Laplace Redux -- Effortless Bayesian Deep Learningcited by 365
  7. 2023DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenescited by 360
  8. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
  9. 2024PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstructioncited by 285
  10. 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 285
  11. 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
  12. 2024Street Gaussians: Modeling Dynamic Urban Scenes with Gaussian Splattingcited by 221
  13. 2023EmerNeRF: Emergent Spatial-Temporal Scene Decomposition via Self-Supervisioncited by 217
  14. 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 173
  15. 2024OmniRe: Omni Urban Scene Reconstructioncited by 161
  16. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
  17. 2023SUDS: Scalable Urban Dynamic Scenescited by 151
  18. 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 150
  19. 2023Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Renderingcited by 143
  20. 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 127
  21. 2024DriveDreamer4D: World Models Are Effective Data Machines for 4D Driving Scene Representationcited by 123
  22. 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 121
  23. 2023StreetSurf: Extending Multi-view Implicit Surface Reconstruction to Street Viewscited by 120
  24. 2023S-NeRF: Neural Radiance Fields for Street Viewscited by 116
  25. 2024RaDe-GS: Rasterizing Depth in Gaussian Splattingcited by 111
  26. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
  27. 2023Bayes' Rays: Uncertainty Quantification for Neural Radiance Fieldscited by 91
  28. 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Drivingcited by 90
  29. 2024ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restorationcited by 89
  30. 2024FreeVS: Generative View Synthesis on Free Driving Trajectorycited by 53
  31. 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
  32. 2024SGD: Street View Synthesis with Gaussian Splatting and Diffusion Priorcited by 36
  33. 2025ReconDreamer++: Harmonizing Generative and Reconstructive Models for Driving Scene Representationcited by 36
  34. 2022Unifying Approaches in Active Learning and Active Sampling via Fisher Information and Information-Theoretic Quantitiescited by 28
  35. 2024VEGS: View Extrapolation of Urban Scenes in 3D Gaussian Splatting using Learned Priorscited by 25
  36. 2023UC-NeRF: Neural Radiance Field for Under-Calibrated Multi-view Cameras in Autonomous Drivingcited by 23
  37. 2023RoMe: Towards Large Scale Road Surface Reconstruction via Mesh Representationcited by 20
  38. 2024Modeling uncertainty for Gaussian Splattingcited by 19

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026ConFixGS: Learning to Fix Feedforward 3D Gaussian Splatting with Confidence-Aware Diffusion Priors in Driving Scenes
  2. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Models
  3. 2026DriveFix: Spatio-Temporally Coherent Driving Scene Restoration
  4. 2024Coherent 3D Scene Diffusion From a Single RGB Image
  5. 2025G4Splat: Geometry-Guided Gaussian Splatting with Generative Prior
  6. 2026Enhancing Novel View Synthesis via Geometry Grounded Set Diffusion
  7. 2026GeoNVS: Geometry Grounded Video Diffusion for Novel View Synthesis
  8. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstruction