Unified Geometry and Color Compression Framework for Point Clouds via Generative Diffusion Priors
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
With the growth of 3D applications and the rapid increase in sensor-collected 3D point cloud data, there is a rising demand for efficient compression algorithms. Most existing learning-based compression methods handle geometry and color attributes separately, treating them as distinct tasks, making these methods challenging to apply directly to point clouds with colors. Besides, the limited capacities of training datasets also limit their generalizability across points with different distributions. In this work, we introduce a test-time unified geometry and color compression framework of 3D point clouds. Instead of training a compression model based on specific datasets, we adapt a pre-trained generative diffusion model to compress original colored point clouds into sparse sets, termed 'seeds', using prompt tuning. Decompression is then achieved through multiple denoising steps with separate sampling processes. Experiments on objects and indoor scenes demonstrate that our method has superior performances compared to existing baselines for the compression of geometry and color.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 38 of its 59 references that are in the map. First posted on arXiv 23 Mar 2025.
Builds on
38 of 59 references.
Closest ancestors · 5
Same direction, newest first
- 2024X-Ray: A Sequential 3D Representation For Generation22 Apr
- 2023Zero-1-to-3: Zero-shot One Image to 3D Object20 Mar
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Prompts16 Dec
- 2022Score Jacobian Chaining: Lifting Pretrained 2D Diffusion Models for 3D Generation1 Dec
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
Other references · 33
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2022Objaverse: A Universe of Annotated 3D Objectscited by 1,540
21 more
- 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
- 2017Mixed Precision Trainingcited by 1,156
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2023DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creationcited by 843
- 2016Past, Present, and Future of Simultaneous Localization And Mapping: Towards the Robust-Perception Agecited by 411
- 2023Shap-E: Generating Conditional 3D Implicit Functionscited by 385
- 2021Text2Mesh: Text-Driven Neural Stylization for Meshescited by 334
- 2022CLIP-Mesh: Generating textured meshes from text using pretrained image-text modelscited by 281
- 2024TripoSR: Fast 3D Object Reconstruction from a Single Imagecited by 232
- 2020Multiscale Point Cloud Geometry Compressioncited by 74
- 2021Sparse Tensor-based Multiscale Representation for Point Cloud Geometry Compressioncited by 70
- 2019Learned Point Cloud Geometry Compressioncited by 58
- 2021Perceptual Quality Assessment of Colored 3D Point Cloudscited by 49
- 2020Improved Deep Point Cloud Geometry Compressioncited by 43
- 2022Density-preserving Deep Point Cloud Compressioncited by 39
- 2020Learning-based lossless compression of 3D point cloud geometrycited by 26
- 2022Sparse Tensor-based Point Cloud Attribute Compressioncited by 25
- 2023Lossless Point Cloud Geometry and Attribute Compression Using a Learned Conditional Probability Modelcited by 25
- 2022Augmented Reality and Robotics: A Survey and Taxonomy for AR-enhanced Human-Robot Interaction and Robotic Interfacescited by 19
- 2024PCAC-GAN: A Sparse-Tensor-Based Generative Adversarial Network for 3D Point Cloud Attribute Compressioncited by 5
- 2024Learned Compression of Point Cloud Geometry and Attributes in a Single Model through Multimodal Rate-Controlcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Diff-PCC: Diffusion-based Neural Compression for 3D Point Clouds
- 2023PC2: Projection-Conditioned Point Cloud Diffusion for Single-Image 3D Reconstruction
- 2022Deep Geometry Post-Processing for Decompressed Point Clouds
- 2024Point Cloud Compression with Implicit Neural Representations: A Unified Framework
- 2023GECCO: Geometrically-Conditioned Point Diffusion Models
- 2024DiffCom: Decoupled Sparse Priors Guided Diffusion Compression for Point Clouds
- 2024Point Cloud Resampling with Learnable Heat Diffusion
- 2023Point Cloud Pre-training with Diffusion Models