mlsanityData to 14 Oct 2026

FrePolad: Frequency-Rectified Point Latent Diffusion for Point Cloud Generation

arXiv 2311.12090 ↗First posted 20 Nov 2023cs.CVcited by 9

On the map: Diffusion models → 3D, point cloud and scene generation

Abstract (arXiv)

We propose FrePolad: frequency-rectified point latent diffusion, a point cloud generation pipeline integrating a variational autoencoder (VAE) with a denoising diffusion probabilistic model (DDPM) for the latent distribution. FrePolad simultaneously achieves high quality, diversity, and flexibility in point cloud cardinality for generation tasks while maintaining high computational efficiency. The improvement in generation quality and diversity is achieved through (1) a novel frequency rectification via spherical harmonics designed to retain high-frequency content while learning the point cloud distribution; and (2) a latent DDPM to learn the regularized yet complex latent distribution. In addition, FrePolad supports variable point cloud cardinality by formulating the sampling of points as conditional distributions over a latent shape distribution. Finally, the low-dimensional latent space encoded by the VAE contributes to FrePolad's fast and scalable sampling. Our quantitative and qualitative results demonstrate FrePolad's state-of-the-art performance in terms of quality, diversity, and computational efficiency. Project page: https://chenliang-zhou.github.io/FrePolad/.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 82 of its 103 references that are in the map. First posted on arXiv 20 Nov 2023.

Builds on

82 of 103 references.

Closest ancestors · 5

Same direction, newest first

  1. 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generation4 Jul
  2. 2022Fast Point Cloud Generation with Straight Flows4 Dec
  3. 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
  4. 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
  5. 2021Diffusion Probabilistic Models for 3D Point Cloud Generation2 Mar

Other references · 77

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  6. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  7. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  8. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  9. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  10. 2013Auto-Encoding Variational Bayescited by 4,053
  11. 2018Neural Ordinary Differential Equationscited by 3,779
  12. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
38 more
  1. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  2. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
  3. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  4. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  5. 2015Variational Inference with Normalizing Flowscited by 2,170
  6. 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
  7. 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
  8. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  9. 2018On the Spectral Bias of Neural Networkscited by 1,341
  10. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
  11. 2021Variational Diffusion Modelscited by 1,153
  12. 2014NICE: Non-linear Independent Components Estimationcited by 1,058
  13. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
  14. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  15. 2021Score-based Generative Modeling in Latent Spacecited by 636
  16. 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
  17. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
  18. 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
  19. 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
  20. 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
  21. 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 488
  22. 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
  23. 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 449
  24. 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
  25. 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
  26. 2020A Survey on Neural Network Interpretabilitycited by 291
  27. 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
  28. 2016Revisiting Classifier Two-Sample Testscited by 268
  29. 2017VAE with a VampPriorcited by 248
  30. 2020Learning Gradient Fields for Shape Generationcited by 245
  31. 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 233
  32. 2016Generating Images with Perceptual Similarity Metrics based on Deep Networkscited by 222
  33. 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
  34. 2016Variational Lossy Autoencodercited by 176
  35. 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
  36. 2019PU-GAN: a Point Cloud Upsampling Adversarial Networkcited by 164
  37. 2021Diff-TTS: A Denoising Diffusion Model for Text-to-Speechcited by 157
  38. 2021Symbolic Music Generation with Diffusion Modelscited by 154

50 most cited of 77 All 77 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 4.

9 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Enhancing Diffusion-based Point Cloud Generation with Smoothness Constraint
  2. 2025InJecteD: Analyzing Trajectories and Drift Dynamics in Denoising Diffusion Probabilistic Models for 2D Point Cloud Generation
  3. 2024PointInfinity: Resolution-Invariant Point Diffusion Models
  4. 2024Point Cloud Resampling with Learnable Heat Diffusion
  5. 2023Point Cloud Pre-training with Diffusion Models
  6. 2023PCRDiffusion: Diffusion Probabilistic Models for Point Cloud Registration
  7. 2021A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completion
  8. 2026Learning to Tessellate: Point Cloud Generation via Recursive Spectral Partitioning