mlsanityData to 14 Oct 2026

Unified Geometry and Color Compression Framework for Point Clouds via Generative Diffusion Priors

arXiv 2503.18083 ↗First posted 23 Mar 2025cs.CVcited by 0

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

With the growth of 3D applications and the rapid increase in sensor-collected 3D point cloud data, there is a rising demand for efficient compression algorithms. Most existing learning-based compression methods handle geometry and color attributes separately, treating them as distinct tasks, making these methods challenging to apply directly to point clouds with colors. Besides, the limited capacities of training datasets also limit their generalizability across points with different distributions. In this work, we introduce a test-time unified geometry and color compression framework of 3D point clouds. Instead of training a compression model based on specific datasets, we adapt a pre-trained generative diffusion model to compress original colored point clouds into sparse sets, termed 'seeds', using prompt tuning. Decompression is then achieved through multiple denoising steps with separate sampling processes. Experiments on objects and indoor scenes demonstrate that our method has superior performances compared to existing baselines for the compression of geometry and color.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 38 of its 59 references that are in the map. First posted on arXiv 23 Mar 2025.

Builds on

38 of 59 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024X-Ray: A Sequential 3D Representation For Generation22 Apr
  2. 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
  3. 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
  4. 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
  5. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep

Other references · 33

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  4. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  5. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  6. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  7. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  8. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  9. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  10. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  11. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  12. 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
21 more
  1. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  2. 2017Mixed Precision Trainingcited by 1,156
  3. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  4. 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
  5. 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 411
  6. 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
  7. 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
  8. 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
  9. 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
  10. 2020Multiscale Point Cloud Geometry Compressioncited by 74
  11. 2021Sparse Tensor-based Multiscale Representation for Point Cloud Geometry Compressioncited by 70
  12. 2019Learned Point Cloud Geometry Compressioncited by 58
  13. 2021Perceptual Quality Assessment of Colored 3D Point Cloudscited by 49
  14. 2020Improved Deep Point Cloud Geometry Compressioncited by 43
  15. 2022Density-preserving Deep Point Cloud Compressioncited by 39
  16. 2020Learning-based lossless compression of 3D point cloud geometrycited by 26
  17. 2022Sparse Tensor-based Point Cloud Attribute Compressioncited by 25
  18. 2023Lossless Point Cloud Geometry and Attribute Compression Using a Learned Conditional Probability Modelcited by 25
  19. 2022Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfacescited by 19
  20. 2024PCAC-GAN: A Sparse-Tensor-Based Generative Adversarial Network for 3D Point Cloud Attribute Compressioncited by 5
  21. 2024Learned Compression of Point Cloud Geometry and Attributes in a Single Model through Multimodal Rate-Controlcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Diff-PCC: Diffusion-based Neural Compression for 3D Point Clouds
  2. 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstruction
  3. 2022Deep Geometry Post-Processing for Decompressed Point Clouds
  4. 2024Point Cloud Compression with Implicit Neural Representations: A Unified Framework
  5. 2023GECCO: Geometrically-Conditioned Point Diffusion Models
  6. 2024DiffCom: Decoupled Sparse Priors Guided Diffusion Compression for Point Clouds
  7. 2024Point Cloud Resampling with Learnable Heat Diffusion
  8. 2023Point Cloud Pre-training with Diffusion Models