mlsanityData to 14 Oct 2026

GAP: Gaussianize Any Point Clouds with Text Guidance

arXiv 2508.05631 ↗First posted 7 Aug 2025cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

3D Gaussian Splatting (3DGS) has demonstrated its advantages in achieving fast and high-quality rendering. As point clouds serve as a widely-used and easily accessible form of 3D representation, bridging the gap between point clouds and Gaussians becomes increasingly important. Recent studies have explored how to convert the colored points into Gaussians, but directly generating Gaussians from colorless 3D point clouds remains an unsolved challenge. In this paper, we propose GAP, a novel approach that gaussianizes raw point clouds into high-fidelity 3D Gaussians with text guidance. Our key idea is to design a multi-view optimization framework that leverages a depth-aware image diffusion model to synthesize consistent appearances across different viewpoints. To ensure geometric accuracy, we introduce a surface-anchoring mechanism that effectively constrains Gaussians to lie on the surfaces of 3D shapes during optimization. Furthermore, GAP incorporates a diffuse-based inpainting strategy that specifically targets at completing hard-to-observe regions. We evaluate GAP on the Point-to-Gaussian generation task across varying complexity levels, from synthetic point clouds to challenging real-world scans, and even large-scale scenes. Project Page: https://weiqi-zhang.github.io/GAP.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 67 of its 82 references that are in the map. First posted on arXiv 7 Aug 2025.

Builds on

67 of 82 references.

References · 67

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  6. 2022Generative Adversarial Networkscited by 5,627
  7. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  8. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  9. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  10. 2014Conditional Generative Adversarial Netscited by 2,162
  11. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  12. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
38 more
  1. 2018Demystifying MMD GANscited by 1,293
  2. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  3. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  4. 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
  5. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  6. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
  7. 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
  8. 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
  9. 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
  10. 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
  11. 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
  12. 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
  13. 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
  14. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  15. 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
  16. 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
  17. 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 237
  18. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
  19. 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 123
  20. 2018Deep Geometric Prior for Surface Reconstructioncited by 110
  21. 2020Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Imagescited by 103
  22. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 87
  23. 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
  24. 2023Texture Generation on 3D Meshes with Point-UV Diffusioncited by 63
  25. 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusioncited by 52
  26. 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
  27. 2024DiffGS: Functional Gaussian Splatting Diffusioncited by 51
  28. 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 49
  29. 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimizationcited by 47
  30. 20223D Shape Reconstruction from 2D Images with Disentangled Attribute Flowcited by 45
  31. 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priorscited by 43
  32. 2024Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesiscited by 41
  33. 2023Towards Better Gradient Consistency for Neural Signed Distance Functions via Level Set Alignmentcited by 39
  34. 2022Fast Learning Radiance Fields by Shooting Much Fewer Rayscited by 38
  35. 2022NeAF: Learning Neural Angle Fields for Point Normal Estimationcited by 38
  36. 2023Differentiable Registration of Images and LiDAR Point Clouds with VoxelPoint-to-Pixel Matchingcited by 37
  37. 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Viewscited by 37
  38. 2023Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projectioncited by 36

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 5.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025EA-3DGS: Efficient and Adaptive 3D Gaussians with Highly Enhanced Quality for outdoor scenes
  2. 2023Text-to-3D using Gaussian Splatting
  3. 2024ComPC: Completing a 3D Point Cloud with 2D Diffusion Priors
  4. 2025Distilled-3DGS:Distilled 3D Gaussian Splatting
  5. 2025Sketch and Patch: Efficient 3D Gaussian Representation for Man-Made Scenes
  6. 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
  7. 2024Compact 3D Gaussian Splatting for Static and Dynamic Radiance Fields
  8. 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting