FreeFix: Boosting 3D Gaussian Splatting via Fine-Tuning-Free Diffusion Models
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
Neural Radiance Fields and 3D Gaussian Splatting have advanced novel view synthesis, yet still rely on dense inputs and often degrade at extrapolated views. Recent approaches leverage generative models, such as diffusion models, to provide additional supervision, but face a trade-off between generalization and fidelity: fine-tuning diffusion models for artifact removal improves fidelity but risks overfitting, while fine-tuning-free methods preserve generalization but often yield lower fidelity. We introduce FreeFix, a fine-tuning-free approach that pushes the boundary of this trade-off by enhancing extrapolated rendering with pretrained image diffusion models. We present an interleaved 2D-3D refinement strategy, showing that image diffusion models can be leveraged for consistent refinement without relying on costly video diffusion models. Furthermore, we take a closer look at the guidance signal for 2D refinement and propose a per-pixel confidence mask to identify uncertain regions for targeted improvement. Experiments across multiple datasets show that FreeFix improves multi-frame consistency and achieves performance comparable to or surpassing fine-tuning-based methods, while retaining strong generalization ability.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 46 of its 56 references that are in the map. First posted on arXiv 28 Jan 2026.
Builds on
46 of 56 references.
Closest ancestors · 7
Same direction, newest first
- 2025Stable Virtual Camera: Generative View Synthesis with Diffusion Models18 Mar
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Models3 Mar
- 2024Novel View Extrapolation with Video Diffusion Priors21 Nov
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesis3 Sep
- 2024NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer24 May
- 2024SGD: Street View Synthesis with Gaussian Splatting and Diffusion Prior29 Mar
- 2023ReconFusion: 3D Reconstruction with Diffusion Priors5 Dec
Other references · 39
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2024HunyuanVideo: A Systematic Framework For Large Video Generative Modelscited by 1,660
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2018Demystifying MMD GANscited by 1,293
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
27 more
- 2019Local Light Field Fusion: Practical View Synthesis with Prescriptive Sampling Guidelinescited by 672
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2022MonoSDF: Exploring Monocular Geometric Cues for Neural Implicit Surface Reconstructioncited by 470
- 2023Gaussian Splatting SLAMcited by 415
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 388
- 2024Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillationcited by 279
- 2023GS-SLAM: Dense Visual SLAM with 3D Gaussian Splattingcited by 278
- 2020Single-View View Synthesis with Multiplane Imagescited by 263
- 2018Stereo Magnification: Learning View Synthesis using Multiplane Imagescited by 211
- 2024WonderWorld: Interactive 3D Scene Generation from a Single Imagecited by 202
- 2024HUGS: Holistic Urban 3D Scene Understanding via Gaussian Splattingcited by 142
- 2024PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splattingcited by 95
- 2024HUGSIM: A Real-Time, Photo-Realistic and Closed-Loop Simulator for Autonomous Drivingcited by 90
- 2024ReconDreamer: Crafting World Models for Driving Scene Reconstruction via Online Restorationcited by 89
- 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restorationcited by 62
- 2024FreeVS: Generative View Synthesis on Free Driving Trajectorycited by 53
- 2024AutoSplat: Constrained Gaussian Splatting for Autonomous Driving Scene Reconstructioncited by 52
- 2024StreetCrafter: Street View Synthesis with Controllable Video Diffusion Modelscited by 49
- 2024G3R: Gradient Guided Generalizable Reconstructioncited by 31
- 2024GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyondcited by 25
- 2025FlowMo: Variance-Based Flow Guidance for Coherent Motion in Video Generationcited by 22
- 2024Stag-1: Towards Realistic 4D Driving Simulation with Video Generation Modelcited by 18
- 2025PINGS: Gaussian Splatting Meets Distance Fields within a Point-Based Implicit Neural Mapcited by 10
- 2021Unsupervised Novel View Synthesis from a Single Imagecited by 8
- 2023PlaNeRF: SVD Unsupervised 3D Plane Regularization for NeRF Large-Scale Scene Reconstructioncited by 8
- 2024Spurfies: Sparse Surface Reconstruction using Local Geometry Priorscited by 8
- 2024Oblique-MERF: Revisiting and Improving MERF for Oblique Photographycited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025GSFix3D: Diffusion-Guided Repair of Novel Views in Gaussian Splatting
- 2025Splatent: Splatting Diffusion Latents for Novel View Synthesis
- 2026Nix and Fix: Targeting 1000x Compression of 3D Gaussian Splatting with Diffusion Models
- 2025Diffusion-Guided Gaussian Splatting for Large-Scale Unconstrained 3D Reconstruction and Novel View Synthesis
- 2025FixingGS: Enhancing 3D Gaussian Splatting via Training-Free Score Distillation
- 2025ProSplat: Improved Feed-Forward 3D Gaussian Splatting for Wide-Baseline Sparse Views
- 2026GIFSplat: Generative Prior-Guided Iterative Feed-Forward 3D Gaussian Splatting from Sparse Views
- 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors