mlsanityData to 7 Oct 2026

2D Gaussian Splatting with Semantic Alignment for Image Inpainting

arXiv 2509.01964 ↗First posted 2 Sep 2025cs.CV cs.AIcited by 4

Not on the map. Why?

Abstract (arXiv)

Gaussian Splatting (GS), a recent technique for converting discrete points into continuous spatial representations, has shown promising results in 3D scene modeling and 2D image super-resolution. In this paper, we explore its untapped potential for image inpainting, which demands both locally coherent pixel synthesis and globally consistent semantic restoration. We propose the first image inpainting framework based on 2D Gaussian Splatting, which encodes incomplete images into a continuous field of 2D Gaussian splat coefficients and reconstructs the final image via a differentiable rasterization process. The continuous rendering paradigm of GS inherently promotes pixel-level coherence in the inpainted results. To improve efficiency and scalability, we introduce a patch-wise rasterization strategy that reduces memory overhead and accelerates inference. For global semantic consistency, we incorporate features from a pretrained DINO model. We observe that DINO's global features are naturally robust to small missing regions and can be effectively adapted to guide semantic alignment in large-mask scenarios, ensuring that the inpainted content remains contextually consistent with the surrounding scene. Extensive experiments on standard benchmarks demonstrate that our method achieves competitive performance in both quantitative metrics and perceptual quality, establishing a new direction for applying Gaussian Splatting to 2D image processing.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 35 of its 47 references that are in the map. First posted on arXiv 2 Sep 2025.

Builds on

35 of 47 references.

References · 35

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  4. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  5. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  6. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,967
  7. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  8. 2016Context Encoders: Feature Learning by Inpaintingcited by 1,424
  9. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  10. 2018Free-Form Image Inpainting with Gated Convolutioncited by 594
  11. 2018Generative Image Inpainting with Contextual Attentioncited by 578
  12. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
23 more
  1. 2018Image Inpainting for Irregular Holes Using Partial Convolutionscited by 505
  2. 2023SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAMcited by 386
  3. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
  4. 2023Text-to-3D using Gaussian Splattingcited by 299
  5. 2022SmartBrush: Text and Shape Guided Object Inpainting with Diffusion Modelcited by 276
  6. 2023Inpaint Anything: Segment Anything Meets Image Inpaintingcited by 233
  7. 2022MAT: Mask-Aware Transformer for Large Hole Image Inpaintingcited by 216
  8. 2024BrushNet: A Plug-and-Play Image Inpainting Model with Decomposed Dual-Branch Diffusioncited by 200
  9. 2019Pluralistic Image Completioncited by 162
  10. 2021Image Inpainting via Conditional Texture and Structure Dual Generationcited by 66
  11. 2025UniToken: Harmonizing Multimodal Understanding and Generation through Unified Visual Encodingcited by 49
  12. 2025Pixel to Gaussian: Ultra-Fast Continuous Super-Resolution with 2D Gaussian Modelingcited by 47
  13. 2024Paint by Inpaint: Learning to Add Image Objects by Removing Them Firstcited by 39
  14. 2023CoordFill: Efficient High-Resolution Image Inpainting via Parameterized Coordinate Queryingcited by 34
  15. 2025Generalized and Efficient 2D Gaussian Splatting for Arbitrary-scale Super-Resolutioncited by 21
  16. 2023ADDP: Learning General Representations for Image Recognition and Generation with Alternating Denoising Diffusion Processcited by 19
  17. 2025GaussianToken: An Effective Image Tokenizer with 2D Gaussian Splattingcited by 9
  18. 2025Acquire and then Adapt: Squeezing out Text-to-Image Model for Image Restorationcited by 8
  19. 2022Adaptive Local Implicit Image Function for Arbitrary-scale Super-resolutioncited by 7
  20. 2023T-former: An Efficient Transformer for Image Inpaintingcited by 7
  21. 2024Don't Look into the Dark: Latent Codes for Pluralistic Image Inpaintingcited by 6
  22. 2024Anywhere: A Multi-Agent Framework for User-Guided, Reliable, and Diverse Foreground-Conditioned Image Generationcited by 6
  23. 2024Diffusion Models with Anisotropic Gaussian Splatting for Image Inpaintingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.