ArtifactWorld: Scaling 3D Gaussian Splatting Artifact Restoration via Video Generation Models
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) delivers high-fidelity real-time rendering but suffers from geometric and photometric degradations under sparse-view constraints. Current generative restoration approaches are often limited by insufficient temporal coherence, a lack of explicit spatial constraints, and a lack of large-scale training data, resulting in multi-view inconsistencies, erroneous geometric hallucinations, and limited generalization to diverse real-world artifact distributions. In this paper, we present ArtifactWorld, a framework that resolves 3DGS artifact repair through systematic data expansion and a homogeneous dual-model paradigm. To address the data bottleneck, we establish a fine-grained phenomenological taxonomy of 3DGS artifacts and construct a comprehensive training set of 107.5K diverse paired video clips to enhance model robustness. Architecturally, we unify the restoration process within a video diffusion backbone, utilizing an isomorphic predictor to localize structural defects via an artifact heatmap. This heatmap then guides the restoration through an Artifact-Aware Triplet Fusion mechanism, enabling precise, intensity-guided spatio-temporal repair within native self-attention. Extensive experiments demonstrate that ArtifactWorld achieves state-of-the-art performance in sparse novel view synthesis and robust 3D reconstruction. Code available at: https://github.com/fyting/ArtifactWorld.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 34 of its 55 references that are in the map. First posted on arXiv 14 Apr 2026.
Builds on
34 of 55 references.
References · 34
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 687
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2023TokenFlow: Consistent Diffusion Features for Consistent Video Editingcited by 442
22 more
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 279
- 2023Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Imagescited by 173
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 121
- 2023ZeroNVS: Zero-Shot 360-Degree View Synthesis from a Single Imagecited by 111
- 2024FreGS: 3D Gaussian Splatting with Progressive Frequency Regularizationcited by 105
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
- 2024DiTCtrl: Exploring Attention Control in Multi-Modal Diffusion Transformer for Tuning-Free Multi-Prompt Longer Video Generationcited by 74
- 2024ViT-CoMer: Vision Transformer with Convolutional Multi-scale Feature Interaction for Dense Predictionscited by 66
- 2025DropGaussian: Structural Regularization for Sparse-view Gaussian Splattingcited by 65
- 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Trainingcited by 50
- 2023SimpleNeRF: Regularizing Sparse Input Neural Radiance Fields with Simpler Solutionscited by 44
- 2025GenFusion: Closing the Loop between Reconstruction and Generation via Videoscited by 41
- 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priorscited by 38
- 2025DropoutGS: Dropping Out Gaussians for Better Sparse-view Renderingcited by 29
- 2025Mask2DiT: Dual Mask-based Diffusion Transformer for Multi-Scene Long Video Generationcited by 25
- 2023DUSA: Decoupled Unsupervised Sim2Real Adaptation for Vehicle-to-Everything Collaborative Perceptioncited by 17
- 2023Open-TransMind: A New Baseline and Benchmark for 1st Foundation Model Challenge of Intelligent Transportationcited by 14
- 2025CRUISE: Cooperative Reconstruction and Editing in V2X Scenarios using Gaussian Splattingcited by 11
- 2025LLaVA-SP: Enhancing Visual Representation with Visual Spatial Tokens for MLLMscited by 8
- 2025Sat2RealCity: Geometry-Aware and Appearance-Controllable 3D Urban Generation from Satellite Imagerycited by 7
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026You Only Gaussian Once: Controllable 3D Gaussian Splatting for Ultra-Densely Sampled Scenescited by 4
- 2026Pano2World: End-to-End 3D Generation via Unified Multi-View Sequencescited by 2
- 2026AdaptSplat: Adapting Vision Foundation Models for Feed-Forward 3D Gaussian Splattingcited by 1
- 2026STAR: A Spatial-Topology Aware Routing Framework for Generalizable 3D Scene Understandingcited by 0
- 2026Bi-FlowGS: Bridging Generative View Completion and Gaussian Geometry through Bidirectional Flow Co-Refinementcited by 0
- 2026Bi-FlowGS: Bridging Generative View Completion and Gaussian Geometry through Bidirectional Flow Co-Refinement15 Sep 2026
- 2026STAR: A Spatial-Topology Aware Routing Framework for Generalizable 3D Scene Understanding12 Aug 2026
- 2026Pano2World: End-to-End 3D Generation via Unified Multi-View Sequences1 Jul 2026
- 2026AdaptSplat: Adapting Vision Foundation Models for Feed-Forward 3D Gaussian Splatting11 May 2026
- 2026You Only Gaussian Once: Controllable 3D Gaussian Splatting for Ultra-Densely Sampled Scenes23 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026GaussVid: Sparse-View Gaussian Splatting with 3D-Aware Video Diffusion Priors
- 2026Nix and Fix: Targeting 1000x Compression of 3D Gaussian Splatting with Diffusion Models
- 2025FixingGS: Enhancing 3D Gaussian Splatting via Training-Free Score Distillation
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priors
- 2025RI3D: Few-Shot Gaussian Splatting With Repair and Inpainting Diffusion Priors
- 2026VidSplat: Gaussian Splatting Reconstruction with Geometry-Guided Video Diffusion Priors
- 2025ExploreGS: Explorable 3D Scene Reconstruction with Virtual Camera Samplings and Diffusion Priors
- 2025Breaking the Vicious Cycle: Coherent 3D Gaussian Splatting from Sparse and Motion-Blurred Views