FixAnything: 3D-Consistent Rendering Refinement via Video Generative Priors
Not on the map. Why?
Abstract (arXiv)
Rendering views using 3D scene representations such as Gaussian Splatting (3DGS), Neural Radiance Fields (NeRF), meshes, or even point clouds produces artifacts when input views are sparse or target views lie far from the input. Recent work mitigates these artifacts using diffusion-based generative priors, but is specialized to individual representations and require custom architectures or extensive retraining. We present FixAnything, a single model for fixing a wide range of rendering artifacts. It does so by repurposing a pretrained video generative model, leveraging its implicit multi-view priors with only minimal modification and lightweight finetuning. Our key insight is that even noisily-rendered sequences preserve camera motion and coarse scene structure, allowing cleanup to be formulated as video-to-video translation. To control what scene structure should be preserved, we introduce a binary mask denoting the clean pixels, enabling the model to anchor its output to high-quality inputs (e.g. training views) while refining the rest. To encourage FixAnything to produce 3D-consistent renderings that support downstream reconstruction, we use camera pose accuracy (recovered via structure-from-motion) as a reward signal for direct preference optimization (DPO). Across four distinct 3D representations, FixAnything consistently improves rendering quality with lightweight finetuning, demonstrating that a single generalist video prior can replace multiple specialist refinement pipelines. The simplicity of the framework enables immediate adoption of stronger future video models without architectural redesign.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 42 of its 46 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
42 of 46 references.
References · 42
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 7,916
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,526
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,198
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
30 more
- 2017SuperPoint: Self-Supervised Interest Point Detection and Descriptioncited by 1,313
- 2023One-step Diffusion with Distribution Matching Distillationcited by 978
- 2025Cosmos World Foundation Model Platform for Physical AIcited by 833
- 2023Diffusion Model Alignment Using Direct Preference Optimizationcited by 767
- 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 732
- 2021RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputscited by 614
- 2023Nerfstudio: A Modular Framework for Neural Radiance Field Developmentcited by 596
- 2023LightGlue: Local Feature Matching at Light Speedcited by 583
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
- 2024ViewCrafter: Taming Video Diffusion Models for High-fidelity Novel View Synthesiscited by 392
- 2025GEN3C: 3D-Informed World-Consistent Video Generation with Precise Camera Controlcited by 325
- 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 317
- 2023FreeNeRF: Improving Few-shot Neural Rendering with Free Frequency Regularizationcited by 310
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 295
- 2024gsplat: An Open-Source Library for Gaussian Splattingcited by 279
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
- 2025Improving Video Generation with Human Feedbackcited by 267
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2023SparseNeRF: Distilling Depth Ranking for Few-shot Novel View Synthesiscited by 247
- 2020Image Matching across Wide Baselines: From Paper to Practicecited by 224
- 2025Diffusion as Shader: 3D-aware Video Diffusion for Versatile Video Generation Controlcited by 184
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 160
- 2024Cameras as Rays: Pose Estimation via Ray Diffusioncited by 129
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
- 2025Aether: Geometric-Aware Unified World Modelingcited by 94
- 2023Nerfbusters: Removing Ghostly Artifacts from Casually Captured NeRFscited by 76
- 2025FlowR: Flowing from Sparse to Dense 3D Reconstructionscited by 28
- 2025Epipolar Geometry Improves Video Generation Modelscited by 22
- 2026VideoGPA: Distilling Geometry Priors for 3D-Consistent Video Generationcited by 19
- 2025Novel View Synthesis from A Few Glimpses via Test-Time Natural Video Completioncited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ArtiFixer: Enhancing and Extending 3D Reconstruction with Auto-Regressive Diffusion Models
- 2026GIFSplat: Generative Prior-Guided Iterative Feed-Forward 3D Gaussian Splatting from Sparse Views
- 2026BetterScene: 3D Scene Synthesis with Representation-Aligned Generative Model
- 2026Rethinking 3D Noise: Learning 3D-Aware Video Priors via Optimization-Free Morphological Perturbations
- 2025GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting
- 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
- 2025OracleGS: Grounding Generative Priors for Sparse-View Gaussian Splatting
- 2025GenFusion: Closing the Loop between Reconstruction and Generation via Videos