FrePolad: Frequency-Rectified Point Latent Diffusion for Point Cloud Generation
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We propose FrePolad: frequency-rectified point latent diffusion, a point cloud generation pipeline integrating a variational autoencoder (VAE) with a denoising diffusion probabilistic model (DDPM) for the latent distribution. FrePolad simultaneously achieves high quality, diversity, and flexibility in point cloud cardinality for generation tasks while maintaining high computational efficiency. The improvement in generation quality and diversity is achieved through (1) a novel frequency rectification via spherical harmonics designed to retain high-frequency content while learning the point cloud distribution; and (2) a latent DDPM to learn the regularized yet complex latent distribution. In addition, FrePolad supports variable point cloud cardinality by formulating the sampling of points as conditional distributions over a latent shape distribution. Finally, the low-dimensional latent space encoded by the VAE contributes to FrePolad's fast and scalable sampling. Our quantitative and qualitative results demonstrate FrePolad's state-of-the-art performance in terms of quality, diversity, and computational efficiency. Project page: https://chenliang-zhou.github.io/FrePolad/.
Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 82 of its 103 references that are in the map. First posted on arXiv 20 Nov 2023.
Builds on
82 of 103 references.
Closest ancestors · 5
Same direction, newest first
- 2023DiT-3D: Exploring Plain Diffusion Transformers for 3D Shape Generation4 Jul
- 2022Fast Point Cloud Generation with Straight Flows4 Dec
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct
- 2022DreamFusion: Text-to-3D using 2D Diffusion29 Sep
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generation2 Mar
Other references · 77
- 2017Attention Is All You Needcited by 60,361
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
38 more
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2018Glow: Generative Flow with Invertible 1x1 Convolutionscited by 1,545
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,476
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,163
- 2021Variational Diffusion Modelscited by 1,153
- 2014NICE: Non-linear Independent Components Estimationcited by 1,058
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2021Score-based Generative Modeling in Latent Spacecited by 636
- 2020WaveGrad: Estimating Gradients for Waveform Generationcited by 622
- 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 488
- 2022MagicVideo: Efficient Video Generation With Latent Diffusion Modelscited by 465
- 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 449
- 2019Frequency Principle: Fourier Analysis Sheds Light on Deep Neural Networkscited by 368
- 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
- 2020A Survey on Neural Network Interpretabilitycited by 291
- 2020Watch your Up-Convolution: CNN Based Generative Deep Neural Networks are Failing to Reproduce Spectral Distributionscited by 280
- 2016Revisiting Classifier Two-Sample Testscited by 268
- 2017VAE with a VampPriorcited by 248
- 2020Learning Gradient Fields for Shape Generationcited by 245
- 2023Spherical Fourier Neural Operators: Learning Stable Dynamics on the Spherecited by 233
- 2016Generating Images with Perceptual Similarity Metrics based on Deep Networkscited by 222
- 2020Focal Frequency Loss for Image Reconstruction and Synthesiscited by 206
- 2016Variational Lossy Autoencodercited by 176
- 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
- 2019PU-GAN: a Point Cloud Upsampling Adversarial Networkcited by 164
- 2021Diff-TTS: A Denoising Diffusion Model for Text-to-Speechcited by 157
- 2021Symbolic Music Generation with Diffusion Modelscited by 154
50 most cited of 77 All 77 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 4.
9 papers.
- 2024Efficient and Scalable Point Cloud Generation with Sparse Point-Voxel Diffusion Modelscited by 7
- 2025Terra: Explorable Native 3D World Model with Point Latentscited by 4
- 2025MFM-point: Multi-scale Flow Matching for Point Cloud Generationcited by 3
- 2026Trajectory Consistency for One-Step Generation on Euler Mean Flowscited by 2
- 2026BrickAnything: Geometry-Conditioned Buildable Brick Generation with Structure-Aware Tokenizationcited by 2
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidancecited by 1
- 2025TFDM: Time-Variant Frequency-Based Point Cloud Diffusion with Mambacited by 0
- 2025FreNBRDF: A Frequency-Rectified Neural Material Representationcited by 0
- 2026PrintAnything: Learning an Intermediate Representation for 3D printing G-code Generationcited by 0
- 2026PrintAnything: Learning an Intermediate Representation for 3D printing G-code Generation30 Jul 2026
- 2026BrickAnything: Geometry-Conditioned Buildable Brick Generation with Structure-Aware Tokenization25 May 2026
- 2026Trajectory Consistency for One-Step Generation on Euler Mean Flows31 Jan 2026
- 2026Quartet of Diffusions: Structure-Aware Point Cloud Generation through Part and Symmetry Guidance28 Jan 2026
- 2025MFM-point: Multi-scale Flow Matching for Point Cloud Generation25 Nov 2025
- 2025Terra: Explorable Native 3D World Model with Point Latents16 Oct 2025
- 2025FreNBRDF: A Frequency-Rectified Neural Material Representation1 Jul 2025
- 2025TFDM: Time-Variant Frequency-Based Point Cloud Diffusion with Mamba17 Mar 2025
- 2024Efficient and Scalable Point Cloud Generation with Sparse Point-Voxel Diffusion Models12 Aug 2024
Similar, not cited
Close in wording, no citation either way
- 2024Enhancing Diffusion-based Point Cloud Generation with Smoothness Constraint
- 2025InJecteD: Analyzing Trajectories and Drift Dynamics in Denoising Diffusion Probabilistic Models for 2D Point Cloud Generation
- 2024PointInfinity: Resolution-Invariant Point Diffusion Models
- 2024Point Cloud Resampling with Learnable Heat Diffusion
- 2023Point Cloud Pre-training with Diffusion Models
- 2023PCRDiffusion: Diffusion Probabilistic Models for Point Cloud Registration
- 2021A Conditional Point Diffusion-Refinement Paradigm for 3D Point Cloud Completion
- 2026Learning to Tessellate: Point Cloud Generation via Recursive Spectral Partitioning