Point Cloud Generation with Continuous Conditioning
Not on the map. Why?
Abstract (arXiv)
Generative models can be used to synthesize 3D objects of high quality and diversity. However, there is typically no control over the properties of the generated object.This paper proposes a novel generative adversarial network (GAN) setup that generates 3D point cloud shapes conditioned on a continuous parameter. In an exemplary application, we use this to guide the generative process to create a 3D object with a custom-fit shape. We formulate this generation process in a multi-task setting by using the concept of auxiliary classifier GANs. Further, we propose to sample the generator label input for training from a kernel density estimation (KDE) of the dataset. Our ablations show that this leads to significant performance increase in regions with few samples. Extensive quantitative and qualitative experiments show that we gain explicit control over the object dimensions while maintaining good generation quality and diversity.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 43 of its 55 references that are in the map. First posted on arXiv 17 Feb 2022.
Builds on
43 of 55 references.
References · 43
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2014Conditional Generative Adversarial Netscited by 2,162
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
- 2018PointPillars: Fast Encoders for Object Detection from Point Cloudscited by 1,715
31 more
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
- 2017VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detectioncited by 1,323
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,082
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 979
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 735
- 2020PCT: Point cloud transformercited by 732
- 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 657
- 2017Wasserstein GANcited by 639
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
- 2016Conditional Image Synthesis With Auxiliary Classifier GANscited by 565
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 488
- 2018cGANs with Projection Discriminatorcited by 254
- 2017AttGAN: Facial Attribute Editing by Only Changing What You Wantcited by 242
- 2018FlowNet3D: Learning Scene Flow in 3D Point Cloudscited by 242
- 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
- 2018Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddingscited by 169
- 2016Unsupervised Cross-Domain Image Generationcited by 125
- 2016Invertible Conditional GANs for image editingcited by 118
- 2018PointGrow: Autoregressively Learned Point Cloud Generation with Self-Attentioncited by 105
- 2021GAN-Control: Explicitly Controllable GANscited by 91
- 2021EfficientLPS: Efficient LiDAR Panoptic Segmentationcited by 76
- 2019Deep Level Sets: Implicit Surface Representations for 3D Shape Inferencecited by 53
- 2017Contextual-based Image Inpainting: Infer, Match, and Translatecited by 50
- 2015Text to 3D Scene Generation with Rich Lexical Groundingcited by 36
- 2020PT2PC: Learning to Generate 3D Point Cloud Shapes from Part Tree Conditionscited by 20
- 2019Quality-aware Unpaired Image-to-Image Translationcited by 9
- 2020Rethinking Sampling in 3D Point Cloud Generative Adversarial Networkscited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 1; 2025: 1; 2026: 1.
4 papers.
- 2024CCDM: Continuous Conditional Diffusion Models for Image Generationcited by 8
- 2023Turning Waste into Wealth: Leveraging Low-Quality Samples for Enhancing Continuous Conditional Generative Adversarial Networkscited by 3
- 2025Imbalance-Robust and Sampling-Efficient Continuous Conditional GANs via Adaptive Vicinal Learning and Auxiliary Regularizationcited by 0
- 2026Enhancing Diffusion-Based Quantitatively Controllable Image Generation via Matrix-Form EDM and Adaptive Vicinal Trainingcited by 0
- 2026Enhancing Diffusion-Based Quantitatively Controllable Image Generation via Matrix-Form EDM and Adaptive Vicinal Training2 Feb 2026
- 2025Imbalance-Robust and Sampling-Efficient Continuous Conditional GANs via Adaptive Vicinal Learning and Auxiliary Regularization3 Aug 2025
- 2024CCDM: Continuous Conditional Diffusion Models for Image Generation6 May 2024
- 2023Turning Waste into Wealth: Leveraging Low-Quality Samples for Enhancing Continuous Conditional Generative Adversarial Networks20 Aug 2023