2D Gaussian Splatting with Semantic Alignment for Image Inpainting
Not on the map. Why?
Abstract (arXiv)
Gaussian Splatting (GS), a recent technique for converting discrete points into continuous spatial representations, has shown promising results in 3D scene modeling and 2D image super-resolution. In this paper, we explore its untapped potential for image inpainting, which demands both locally coherent pixel synthesis and globally consistent semantic restoration. We propose the first image inpainting framework based on 2D Gaussian Splatting, which encodes incomplete images into a continuous field of 2D Gaussian splat coefficients and reconstructs the final image via a differentiable rasterization process. The continuous rendering paradigm of GS inherently promotes pixel-level coherence in the inpainted results. To improve efficiency and scalability, we introduce a patch-wise rasterization strategy that reduces memory overhead and accelerates inference. For global semantic consistency, we incorporate features from a pretrained DINO model. We observe that DINO's global features are naturally robust to small missing regions and can be effectively adapted to guide semantic alignment in large-mask scenarios, ensuring that the inpainted content remains contextually consistent with the surrounding scene. Extensive experiments on standard benchmarks demonstrate that our method achieves competitive performance in both quantitative metrics and perceptual quality, establishing a new direction for applying Gaussian Splatting to 2D image processing.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 35 of its 47 references that are in the map. First posted on arXiv 2 Sep 2025.
Builds on
35 of 47 references.
References · 35
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
- 2018Generative Image Inpainting with Contextual Attentioncited by 578
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
23 more
- 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
- 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2023Text-to-3D using Gaussian Splattingcited by 299
- 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
- 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
- 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
- 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
- 2019Pluralistic Image Completioncited by 162
- 2021Image Inpainting via Conditional Texture and Structure Dual Generationcited by 66
- 2025UniToken: Harmonizing Multimodal Understanding and Generation through Unified Visual Encodingcited by 49
- 2025Pixel to Gaussian: Ultra-Fast Continuous Super-Resolution with 2D Gaussian Modelingcited by 47
- 2024Paint by Inpaint: Learning to Add Image Objects by Removing Them Firstcited by 39
- 2023CoordFill: Efficient High-Resolution Image Inpainting via Parameterized Coordinate Queryingcited by 34
- 2025Generalized and Efficient 2D Gaussian Splatting for Arbitrary-scale Super-Resolutioncited by 21
- 2023ADDP: Learning General Representations for Image Recognition and Generation with Alternating Denoising Diffusion Processcited by 19
- 2025GaussianToken: An Effective Image Tokenizer with 2D Gaussian Splattingcited by 9
- 2025Acquire and then Adapt: Squeezing out Text-to-Image Model for Image Restorationcited by 8
- 2022Adaptive Local Implicit Image Function for Arbitrary-scale Super-resolutioncited by 7
- 2023T-former: An Efficient Transformer for Image Inpaintingcited by 7
- 2024Don't Look into the Dark: Latent Codes for Pluralistic Image Inpaintingcited by 6
- 2024Anywhere: A Multi-Agent Framework for User-Guided, Reliable, and Diverse Foreground-Conditioned Image Generationcited by 6
- 2024Diffusion Models with Anisotropic Gaussian Splatting for Image Inpaintingcited by 1
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Forecasting as Rendering: A 2D Gaussian Splatting Framework for Time Series Forecastingcited by 1
- 2026MarkCleaner: High-Fidelity Watermark Removal via Imperceptible Micro-Geometric Perturbationcited by 0
- 2026Learning Video Dynamics with Predictive Differentiable Renderingcited by 0
- 2026Gaussian Density Splatting Networkcited by 0
- 2026Gaussian Density Splatting Network7 Oct 2026
- 2026Learning Video Dynamics with Predictive Differentiable Rendering30 Jun 2026
- 2026Forecasting as Rendering: A 2D Gaussian Splatting Framework for Time Series Forecasting10 Feb 2026
- 2026MarkCleaner: High-Fidelity Watermark Removal via Imperceptible Micro-Geometric Perturbation2 Feb 2026