GAP: Gaussianize Any Point Clouds with Text Guidance
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has demonstrated its advantages in achieving fast and high-quality rendering. As point clouds serve as a widely-used and easily accessible form of 3D representation, bridging the gap between point clouds and Gaussians becomes increasingly important. Recent studies have explored how to convert the colored points into Gaussians, but directly generating Gaussians from colorless 3D point clouds remains an unsolved challenge. In this paper, we propose GAP, a novel approach that gaussianizes raw point clouds into high-fidelity 3D Gaussians with text guidance. Our key idea is to design a multi-view optimization framework that leverages a depth-aware image diffusion model to synthesize consistent appearances across different viewpoints. To ensure geometric accuracy, we introduce a surface-anchoring mechanism that effectively constrains Gaussians to lie on the surfaces of 3D shapes during optimization. Furthermore, GAP incorporates a diffuse-based inpainting strategy that specifically targets at completing hard-to-observe regions. We evaluate GAP on the Point-to-Gaussian generation task across varying complexity levels, from synthetic point clouds to challenging real-world scans, and even large-scale scenes. Project Page: https://weiqi-zhang.github.io/GAP.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 67 of its 82 references that are in the map. First posted on arXiv 7 Aug 2025.
Builds on
67 of 82 references.
References · 67
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2014Conditional Generative Adversarial Netscited by 2,162
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
38 more
- 2018Demystifying MMD GANscited by 1,293
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2023LRM: Large Reconstruction Model for Single Image to 3Dcited by 849
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 687
- 2023Mip-Splatting: Alias-free 3D Gaussian Splattingcited by 667
- 2022Latent-NeRF for Shape-Guided Generation of 3D Shapes and Texturescited by 506
- 20203D-FRONT: 3D Furnished Rooms with layOuts and semaNTicscited by 380
- 2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 349
- 2023TEXTure: Text-Guided Texturing of 3D Shapescited by 304
- 2024GRM: Large Gaussian Reconstruction Model for Efficient 3D Reconstruction and Generationcited by 301
- 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2024DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalizationcited by 256
- 2023GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Modelscited by 255
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 237
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
- 2023Paint3D: Paint Anything 3D with Lighting-Less Texture Diffusion Modelscited by 123
- 2018Deep Geometric Prior for Surface Reconstructioncited by 110
- 2020Deep Fashion3D: A Dataset and Benchmark for 3D Garment Reconstruction from Single Imagescited by 103
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 87
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
- 2023Texture Generation on 3D Meshes with Point-UV Diffusioncited by 63
- 2024TextureDreamer: Image-guided Texture Synthesis through Geometry-aware Diffusioncited by 52
- 2024Meta 3D TextureGen: Fast and Consistent Texture Generation for 3D Objectscited by 52
- 2024DiffGS: Functional Gaussian Splatting Diffusioncited by 51
- 2024Neural Signed Distance Function Inference through Splatting 3D Gaussians Pulled on Zero-Level Setcited by 49
- 2022CAP-UDF: Learning Unsigned Distance Functions Progressively from Raw Point Clouds with Consistency-Aware Field Optimizationcited by 47
- 20223D Shape Reconstruction from 2D Images with Disentangled Attribute Flowcited by 45
- 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priorscited by 43
- 2024Binocular-Guided 3D Gaussian Splatting with View Consistency for Sparse View Synthesiscited by 41
- 2023Towards Better Gradient Consistency for Neural Signed Distance Functions via Level Set Alignmentcited by 39
- 2022Fast Learning Radiance Fields by Shooting Much Fewer Rayscited by 38
- 2022NeAF: Learning Neural Angle Fields for Point Normal Estimationcited by 38
- 2023Differentiable Registration of Images and LiDAR Point Clouds with VoxelPoint-to-Pixel Matchingcited by 37
- 2023NeuSurf: On-Surface Priors for Neural Surface Reconstruction from Sparse Input Viewscited by 37
- 2023Learning a More Continuous Zero Level Set in Unsigned Distance Fields through Level Set Projectioncited by 36
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 5.
7 papers.
- 2025MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inferencecited by 23
- 2026MoRe: Motion-aware Feed-forward 4D Reconstruction Transformercited by 9
- 20264C4D: 4 Camera 4D Gaussian Splattingcited by 4
- 2025U-CAN: Unsupervised Point Cloud Denoising with Consistency-Aware Noise2Noise Matchingcited by 3
- 2026GaussianGrow: Geometry-aware Gaussian Growing from 3D Point Clouds with Text Guidancecited by 1
- 2026WildGHand: Learning Anti-Perturbation Gaussian Hand Avatars from Monocular In-the-Wild Videoscited by 0
- 2026AnchorSplat: Fast and Structure Consistent Detail Synthesis for Gaussian Splattingcited by 0
- 2026AnchorSplat: Fast and Structure Consistent Detail Synthesis for Gaussian Splatting1 Jul 2026
- 2026GaussianGrow: Geometry-aware Gaussian Growing from 3D Point Clouds with Text Guidance7 Apr 2026
- 20264C4D: 4 Camera 4D Gaussian Splatting5 Apr 2026
- 2026MoRe: Motion-aware Feed-forward 4D Reconstruction Transformer5 Mar 2026
- 2026WildGHand: Learning Anti-Perturbation Gaussian Hand Avatars from Monocular In-the-Wild Videos24 Feb 2026
- 2025U-CAN: Unsupervised Point Cloud Denoising with Consistency-Aware Noise2Noise Matching29 Oct 2025
- 2025MaterialRefGS: Reflective Gaussian Splatting with Multi-view Consistent Material Inference13 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025EA-3DGS: Efficient and Adaptive 3D Gaussians with Highly Enhanced Quality for outdoor scenes
- 2023Text-to-3D using Gaussian Splatting
- 2024ComPC: Completing a 3D Point Cloud with 2D Diffusion Priors
- 2025Distilled-3DGS:Distilled 3D Gaussian Splatting
- 2025Sketch and Patch: Efficient 3D Gaussian Representation for Man-Made Scenes
- 2025Generative Gaussian Splatting: Generating 3D Scenes with Video Diffusion Priors
- 2024Compact 3D Gaussian Splatting for Static and Dynamic Radiance Fields
- 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting