SurfGen: Adversarial 3D Shape Synthesis with Explicit Surface Discriminators
Not on the map. Why?
Abstract (arXiv)
Recent advances in deep generative models have led to immense progress in 3D shape synthesis. While existing models are able to synthesize shapes represented as voxels, point-clouds, or implicit functions, these methods only indirectly enforce the plausibility of the final 3D shape surface. Here we present a 3D shape synthesis framework (SurfGen) that directly applies adversarial training to the object surface. Our approach uses a differentiable spherical projection layer to capture and represent the explicit zero isosurface of an implicit 3D generator as functions defined on the unit sphere. By processing the spherical representation of 3D object surfaces with a spherical CNN in an adversarial setting, our generator can better learn the statistics of natural shape surfaces. We evaluate our model on large-scale shape datasets, and demonstrate that the end-to-end trained model is capable of generating high fidelity 3D shapes with diverse topology.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 49 of its 70 references that are in the map. First posted on arXiv 1 Jan 2022.
Builds on
49 of 70 references.
References · 49
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2016Improved Techniques for Training GANscited by 2,938
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
- 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
37 more
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 2017Neural 3D Mesh Renderercited by 437
- 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
- 2015Adversarial Autoencoderscited by 359
- 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 332
- 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
- 2017Geometric GANcited by 232
- 2019Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderercited by 221
- 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
- 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 179
- 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
- 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
- 2020Points2Surf: Learning Implicit Surfaces from Point Cloud Patchescited by 122
- 2020MeshSDF: Differentiable Iso-Surface Extractioncited by 112
- 2018Deep Geometric Prior for Surface Reconstructioncited by 110
- 2017MarrNet: 3D Shape Reconstruction via 2.5D Sketchescited by 108
- 2016Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervisioncited by 106
- 2017Self-supervised Multi-level Face Model Learning for Monocular Reconstruction at over 250 Hzcited by 91
- 2018Multiresolution Tree Networks for 3D Point Cloud Processingcited by 91
- 2017Hierarchical Surface Prediction for 3D Object Reconstructioncited by 89
- 2020DualSDF: Semantic Shape Manipulation using a Two-Level Representationcited by 82
- 2018Point Cloud GANcited by 79
- 2020DeepSphere: a graph-based spherical CNNcited by 65
- 2018Learning to Reconstruct Shapes from Unseen Classescited by 60
- 2014Category-Specific Object Reconstruction from a Single Imagecited by 56
- 2020End-to-End Optimization of Scene Layoutcited by 52
- 2020Adversarial Generation of Continuous Implicit Shape Representationscited by 46
- 2019GEOMetrics: Exploiting Geometric Structure for Graph-Encoded Objectscited by 27
- 2020Meshlet Priors for 3D Mesh Reconstructioncited by 23
- 2018MVPNet: Multi-View Point Regression Networks for 3D Object Reconstruction from A Single Imagecited by 17
- 2017Hierarchical Implicit Models and Likelihood-Free Variational Inferencecited by 13
- 2018Learning to Generate and Reconstruct 3D Meshes with only 2D Supervisioncited by 12
- 2019Variational Auto-Decoder: A Method for Neural Generative Modeling from Incomplete Datacited by 10
- 20173D Object Classification via Spherical Projectionscited by 9
Built on by
Citing papers per year: 2022: 7; 2023: 14; 2024: 2; 2025: 2; 2026: 1.
26 papers.
Sort:
By area:
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
- 2024Advances in 3D Generation: A Surveycited by 62
14 more
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulationcited by 27
- 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wildcited by 25
- 2022RangeUDF: Semantic Surface Reconstruction from 3D Point Cloudscited by 16
- 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapescited by 14
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformerscited by 14
- 2023Pushing the Limits of 3D Shape Generation at Scalecited by 11
- 2026HY3D-Bench: Generation of 3D Assetscited by 11
- 2023Progressive Text-to-3D Generation for Automatic 3D Prototypingcited by 8
- 2023Text-guided 3D Human Generation from 2D Collectionscited by 4
- 2023Does resistance to style-transfer equal Global Shape Bias? Measuring network sensitivity to global shape configurationcited by 3
- 2022Deep Generative Models on 3D Representations: A Surveycited by 1
- 2023Few-shot 3D Shape Generationcited by 1
- 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Frameworkcited by 1
- 20253D Shape Generation: A Surveycited by 0
- 2026HY3D-Bench: Generation of 3D Assets3 Feb 2026
- 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Framework2 Sep 2025
- 20253D Shape Generation: A Survey27 Jun 2025
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformers18 Jul 2024
- 2024Advances in 3D Generation: A Survey31 Jan 2024
- 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapes7 Dec 2023
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchies6 Dec 2023
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov 2023
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models20 Oct 2023
- 2023Does resistance to style-transfer equal Global Shape Bias? Measuring network sensitivity to global shape configuration11 Oct 2023
- 2023Progressive Text-to-3D Generation for Automatic 3D Prototyping26 Sep 2023
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representation29 Jun 2023
14 more
- 2023Pushing the Limits of 3D Shape Generation at Scale20 Jun 2023
- 2023Text-guided 3D Human Generation from 2D Collections23 May 2023
- 2023Few-shot 3D Shape Generation19 May 2023
- 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wild4 Apr 2023
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation14 Mar 2023
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulation1 Feb 2023
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generation18 Jan 2023
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models28 Dec 2022
- 2022Deep Generative Models on 3D Representations: A Survey27 Oct 2022
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct 2022
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Images22 Sep 2022
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generation19 Sep 2022
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generation24 Jun 2022
- 2022RangeUDF: Semantic Surface Reconstruction from 3D Point Clouds19 Apr 2022
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov 2023
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models20 Oct 2023
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation14 Mar 2023
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models28 Dec 2022
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct 2022
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 2024Advances in 3D Generation: A Surveycited by 62
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulationcited by 27
- 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wildcited by 25
- 2022RangeUDF: Semantic Surface Reconstruction from 3D Point Cloudscited by 16
- 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapescited by 14
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformerscited by 14
12 most cited of 21 All 21 (JSON)
- 2026HY3D-Bench: Generation of 3D Assets3 Feb 2026
- 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Framework2 Sep 2025
- 20253D Shape Generation: A Survey27 Jun 2025
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformers18 Jul 2024
- 2024Advances in 3D Generation: A Survey31 Jan 2024
- 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapes7 Dec 2023
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchies6 Dec 2023
- 2023Does resistance to style-transfer equal Global Shape Bias? Measuring network sensitivity to global shape configuration11 Oct 2023
- 2023Progressive Text-to-3D Generation for Automatic 3D Prototyping26 Sep 2023
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representation29 Jun 2023
- 2023Pushing the Limits of 3D Shape Generation at Scale20 Jun 2023
- 2023Text-guided 3D Human Generation from 2D Collections23 May 2023
12 newest of 21 All 21 (JSON)