mlsanityData to 7 Oct 2026

SurfGen: Adversarial 3D Shape Synthesis with Explicit Surface Discriminators

arXiv 2201.00112 ↗First posted 1 Jan 2022cs.CVcited by 26

Not on the map. Why?

Abstract (arXiv)

Recent advances in deep generative models have led to immense progress in 3D shape synthesis. While existing models are able to synthesize shapes represented as voxels, point-clouds, or implicit functions, these methods only indirectly enforce the plausibility of the final 3D shape surface. Here we present a 3D shape synthesis framework (SurfGen) that directly applies adversarial training to the object surface. Our approach uses a differentiable spherical projection layer to capture and represent the explicit zero isosurface of an implicit 3D generator as functions defined on the unit sphere. By processing the spherical representation of 3D object surfaces with a spherical CNN in an adversarial setting, our generator can better learn the statistics of natural shape surfaces. We evaluate our model on large-scale shape datasets, and demonstrate that the end-to-end trained model is capable of generating high fidelity 3D shapes with diverse topology.

Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 49 of its 70 references that are in the map. First posted on arXiv 1 Jan 2022.

Builds on

49 of 70 references.

References · 49

  1. 2013Auto-Encoding Variational Bayescited by 3,980
  2. 2016Improved Techniques for Training GANscited by 2,938
  3. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  5. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
  6. 2016Instance Normalization: The Missing Ingredient for Fast Stylizationcited by 1,187
  7. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  8. 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
  9. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  10. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  11. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 699
  12. 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
37 more
  1. 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
  2. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  3. 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
  4. 2017Neural 3D Mesh Renderercited by 437
  5. 2019Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoningcited by 420
  6. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
  7. 2015Adversarial Autoencoderscited by 359
  8. 2019DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstructioncited by 332
  9. 2018Learning Category-Specific Mesh Reconstruction from Image Collectionscited by 317
  10. 2017Geometric GANcited by 232
  11. 2019Learning to Predict 3D Objects with an Interpolation-based Differentiable Renderercited by 221
  12. 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
  13. 2019DIST: Rendering Deep Implicit Signed Distance Function with Differentiable Sphere Tracingcited by 179
  14. 2016Learning a Predictable and Generative Vector Representation for Objectscited by 173
  15. 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
  16. 2020Points2Surf: Learning Implicit Surfaces from Point Cloud Patchescited by 122
  17. 2020MeshSDF: Differentiable Iso-Surface Extractioncited by 112
  18. 2018Deep Geometric Prior for Surface Reconstructioncited by 110
  19. 2017MarrNet: 3D Shape Reconstruction via 2.5D Sketchescited by 108
  20. 2016Perspective Transformer Nets: Learning Single-View 3D Object Reconstruction without 3D Supervisioncited by 106
  21. 2017Self-supervised Multi-level Face Model Learning for Monocular Reconstruction at over 250 Hzcited by 91
  22. 2018Multiresolution Tree Networks for 3D Point Cloud Processingcited by 91
  23. 2017Hierarchical Surface Prediction for 3D Object Reconstructioncited by 89
  24. 2020DualSDF: Semantic Shape Manipulation using a Two-Level Representationcited by 82
  25. 2018Point Cloud GANcited by 79
  26. 2020DeepSphere: a graph-based spherical CNNcited by 65
  27. 2018Learning to Reconstruct Shapes from Unseen Classescited by 60
  28. 2014Category-Specific Object Reconstruction from a Single Imagecited by 56
  29. 2020End-to-End Optimization of Scene Layoutcited by 52
  30. 2020Adversarial Generation of Continuous Implicit Shape Representationscited by 46
  31. 2019GEOMetrics: Exploiting Geometric Structure for Graph-Encoded Objectscited by 27
  32. 2020Meshlet Priors for 3D Mesh Reconstructioncited by 23
  33. 2018MVPNet: Multi-View Point Regression Networks for 3D Object Reconstruction from A Single Imagecited by 17
  34. 2017Hierarchical Implicit Models and Likelihood-Free Variational Inferencecited by 13
  35. 2018Learning to Generate and Reconstruct 3D Meshes with only 2D Supervisioncited by 12
  36. 2019Variational Auto-Decoder: A Method for Neural Generative Modeling from Incomplete Datacited by 10
  37. 20173D Object Classification via Spherical Projectionscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 7; 2023: 14; 2024: 2; 2025: 2; 2026: 1.

26 papers.

Sort:

By area:

  1. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
  2. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  3. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
  4. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  5. 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
  6. 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
  7. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
  8. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
  9. 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
  10. 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
  11. 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
  12. 2024Advances in 3D Generation: A Surveycited by 62
14 more
  1. 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulationcited by 27
  2. 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wildcited by 25
  3. 2022RangeUDF: Semantic Surface Reconstruction from 3D Point Cloudscited by 16
  4. 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapescited by 14
  5. 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformerscited by 14
  6. 2023Pushing the Limits of 3D Shape Generation at Scalecited by 11
  7. 2026HY3D-Bench: Generation of 3D Assetscited by 11
  8. 2023Progressive Text-to-3D Generation for Automatic 3D Prototypingcited by 8
  9. 2023Text-guided 3D Human Generation from 2D Collectionscited by 4
  10. 2023Does resistance to style-transfer equal Global Shape Bias? Measuring network sensitivity to global shape configurationcited by 3
  11. 2022Deep Generative Models on 3D Representations: A Surveycited by 1
  12. 2023Few-shot 3D Shape Generationcited by 1
  13. 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Frameworkcited by 1
  14. 20253D Shape Generation: A Surveycited by 0