SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generation
Not on the map. Why?
Cited by 28 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We present a StyleGAN2-based deep learning approach for 3D shape generation, called SDF-StyleGAN, with the aim of reducing visual and geometric dissimilarity between generated shapes and a shape collection. We extend StyleGAN2 to 3D generation and utilize the implicit signed distance function (SDF) as the 3D shape representation, and introduce two novel global and local shape discriminators that distinguish real and fake SDF values and gradients to significantly improve shape geometry and visual quality. We further complement the evaluation metrics of 3D generative models with the shading-image-based Fr'echet inception distance (FID) scores to better assess visual quality and shape distribution of the generated shapes. Experiments on shape generation demonstrate the superior performance of SDF-StyleGAN over the state-of-the-art. We further demonstrate the efficacy of SDF-StyleGAN in various tasks based on GAN inversion, including shape reconstruction, shape completion from partial point clouds, single-view image-based shape generation, and shape style editing. Extensive ablation studies justify the efficacy of our framework design. Our code and trained models are available at https://github.com/Zhengxinyang/SDF-StyleGAN.
Key facts. Cited by 92 papers in the map (data through 7 Oct 2026). Builds on 65 of its 88 references that are in the map. First posted on arXiv 24 Jun 2022.
Builds on
65 of 88 references.
References · 65
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,037
38 more
- 2021Alias-Free Generative Adversarial Networkscited by 1,181
- 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
- 2016Pixel Recurrent Neural Networkscited by 814
- 2020Convolutional Occupancy Networkscited by 760
- 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2018Which Training Methods for GANs do actually Converge?cited by 672
- 2018Pixel2Mesh: Generating 3D Mesh Models from Single RGB Imagescited by 649
- 20163D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstructioncited by 587
- 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
- 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 487
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
- 2020Local Implicit Grid Representations for 3D Scenescited by 372
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2021PoinTr: Diverse Point Cloud Completion with Geometry-Aware Transformerscited by 284
- 2020PolyGen: An Autoregressive Generative Model of 3D Meshescited by 267
- 2020Learning Gradient Fields for Shape Generationcited by 245
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2016A Theory of Generative ConvNetcited by 174
- 20193D Point Cloud Generative Adversarial Network Based on Tree Structured Graph Convolutionscited by 173
- 2019PQ-NET: A Generative Part Seq2Seq Network for 3D Shapescited by 118
- 2018PointGrow: Autoregressively Learned Point Cloud Generation with Self-Attentioncited by 105
- 2020SoftFlow: Probabilistic Framework for Normalizing Flow on Manifoldscited by 97
- 2020Discrete Point Flow Networks for Efficient Point Cloud Generationcited by 87
- 2018The Unusual Effectiveness of Averaging in GAN Trainingcited by 73
- 2022Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representationscited by 71
- 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67
- 2017Improved Adversarial Systems for 3D Object Generation and Reconstructioncited by 66
- 2019StructureNet: Hierarchical Graph Networks for 3D Shape Generationcited by 59
- 2020Generative PointNet: Deep Energy-Based Learning on Unordered Point Sets for 3D Generation, Reconstruction and Classificationcited by 57
- 2019C-Flow: Conditional Generative Flow Models for Images and 3D Point Cloudscited by 50
- 20213D Shape Generation with Grid-based Implicit Functionscited by 48
- 2020Adversarial Generation of Continuous Implicit Shape Representationscited by 46
- 2020Progressive Point Cloud Deconvolution Generation Networkcited by 46
- 2020DECOR-GAN: 3D Shape Detailization by Conditional Refinementcited by 45
- 2021Octree Transformer: Autoregressive 3D Shape Generation on Hierarchically Structured Sequencescited by 38
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2022: 5; 2023: 30; 2024: 26; 2025: 19; 2026: 12.
92 papers.
Sort:
By area:
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
- 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 181
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
- 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 76
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
38 more
- 2024Advances in 3D Generation: A Surveycited by 62
- 2023Mosaic-SDF for 3D Generative Modelscited by 48
- 2023Controllable Mesh Generation Through Sparse Latent Point Diffusion Modelscited by 40
- 2024OctFusion: Octree-based Diffusion Models for 3D Shape Generationcited by 40
- 2023DiffComplete: Diffusion-based Generative 3D Shape Completioncited by 35
- 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusioncited by 34
- 2025Gaussian Variation Field Diffusion for High-fidelity Video-to-4D Synthesiscited by 33
- 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 29
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulationcited by 27
- 2025OctGPT: Octree-based Multiscale Autoregressive Models for 3D Shape Generationcited by 27
- 2024Make-A-Shape: a Ten-Million-scale 3D Shape Modelcited by 25
- 2023Ghost on the Shell: An Expressive Representation of General 3D Shapescited by 24
- 2024PhysPart: Physically Plausible Part Completion for Interactable Objectscited by 24
- 2024MVD2: Efficient Multiview 3D Reconstruction for Multiview Diffusioncited by 22
- 2023Chupa: Carving 3D Clothed Humans from Skinned Shape Priors using 2D Diffusion Probabilistic Modelscited by 20
- 2023Get3DHuman: Lifting StyleGAN-Human into a 3D Generative Model using Pixel-aligned Reconstruction Priorscited by 19
- 2025LL3M: Large Language 3D Modelerscited by 18
- 2024Geometry Image Diffusion: Fast and Data-Efficient Text-to-3D with Image-Based Surface Representationcited by 17
- 20243D Mesh Editing using Masked LRMscited by 17
- 2024DDMI: Domain-Agnostic Latent Diffusion Models for Synthesizing High-Quality Implicit Neural Representationscited by 16
- 2024Atlas Gaussians Diffusion for 3D Generationcited by 15
- 2022TetraDiffusion: Tetrahedral Diffusion Models for 3D Shape Generationcited by 14
- 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapescited by 14
- 2024Topology-Aware Latent Diffusion for 3D Shape Generationcited by 13
- 2024Text-to-3D Shape Generationcited by 13
- 2024NeuSDFusion: A Spatial-Aware Generative Model for 3D Shape Completion, Reconstruction, and Generationcited by 13
- 2025iFlame: Interleaving Full and Linear Attention for Efficient Mesh Generationcited by 13
- 20233D VR Sketch Guided 3D Shape Prototyping and Explorationcited by 12
- 2023CLIPXPlore: Coupled CLIP and Shape Spaces for 3D Shape Explorationcited by 9
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Surveycited by 9
- 2023NaviNeRF: NeRF-based 3D Representation Disentanglement by Latent Semantic Navigationcited by 8
- 2023SENS: Part-Aware Sketch-based Implicit Neural Shape Modelingcited by 8
- 2023Progressive Text-to-3D Generation for Automatic 3D Prototypingcited by 8
- 2024GetMesh: A Controllable Model for High-quality Mesh Generation and Manipulationcited by 8
- 2024Assessing Sample Quality via the Latent Space of Generative Modelscited by 8
- 2024DetailGen3D: Generative 3D Geometry Enhancement via Data-Dependent Flowcited by 8
- 2024Coherent 3D Scene Diffusion From a Single RGB Imagecited by 8
- 2024LAM3D: Large Image-Point-Cloud Alignment Model for 3D Reconstruction from Single Imagecited by 7
50 most cited of 92 All 92 (JSON)
- 2026OrnaStyler: Ornament-Aware Latent Editing for Content-Preserving 3D Stylization30 Aug 2026
- 2026Fourier-Latent Diffusion for Constrained Generation of Triply Periodic Minimal Surfaces3 Aug 2026
- 2026AIMold: An Autonomous AI-based Pipeline for Complex Mold Design1 Aug 2026
- 2026Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers1 Jul 2026
- 2026DinoComplete: 3D Shape Completion with Distilled Semantic Priors and State Space Models26 May 2026
- 2026QuadLink: Autoregressive Quad-Dominant Mesh Generation via Point-Relation Learning16 May 2026
- 2026Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusion6 May 2026
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation5 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026Sculpt4D: Generating 4D Shapes via Sparse-Attention Diffusion Transformers23 Apr 2026
- 2026RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Space1 Apr 2026
- 2026DipGuava: Disentangling Personalized Gaussian Features for 3D Head Avatars from Monocular Video30 Mar 2026
38 more
- 2025Memorization in 3D Shape Generation: An Empirical Study29 Dec 2025
- 2025AnimaMimic: Imitating 3D Animation from Video Priors16 Dec 2025
- 2025Order Matters: 3D Shape Generation from Sequential VR Sketches4 Dec 2025
- 2025Evaluating Latent Generative Paradigms for High-Fidelity 3D Shape Completion from a Single Depth Image14 Nov 2025
- 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Masks16 Oct 2025
- 2025SPGen: Spherical Projection as Consistent and Flexible Representation for Single Image 3D Shape Generation16 Sep 2025
- 2025HierOctFusion: Multi-scale Octree-based 3D Shape Generation via Part-Whole-Hierarchy Message Passing14 Aug 2025
- 2025LL3M: Large Language 3D Modelers11 Aug 2025
- 2025Gaussian Variation Field Diffusion for High-fidelity Video-to-4D Synthesis31 Jul 2025
- 2025BridgeShape: Latent Diffusion Schr"odinger Bridge for 3D Shape Completion29 Jun 2025
- 20253D Shape Generation: A Survey27 Jun 2025
- 2025Implicit Neural-Representation Learning for Elastic Deformable-Object Manipulations1 May 2025
- 2025OctGPT: Octree-based Multiscale Autoregressive Models for 3D Shape Generation14 Apr 2025
- 2025QEMesh: Employing A Quadric Error Metrics-Based Representation for Mesh Generation8 Apr 2025
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modeling27 Mar 2025
- 2025iFlame: Interleaving Full and Linear Attention for Efficient Mesh Generation20 Mar 2025
- 2025Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey17 Mar 2025
- 2025NF-SLAM: Effective, Normalizing Flow-supported Neural Field representations for object-level visual SLAM in automotive applications14 Mar 2025
- 2025Representing 3D Shapes With 64 Latent Vectors for 3D Diffusion Models11 Mar 2025
- 2024Coherent 3D Scene Diffusion From a Single RGB Image13 Dec 2024
- 20243D Mesh Editing using Masked LRMs11 Dec 2024
- 2024Structured 3D Latents for Scalable and Versatile 3D Generation2 Dec 2024
- 2024DetailGen3D: Generative 3D Geometry Enhancement via Data-Dependent Flow25 Nov 2024
- 2024GenUDC: High Quality 3D Mesh Generation with Unsigned Dual Contouring Representation23 Oct 2024
- 2024PGCS: Physical Law embedded Generative Cloud Synthesis in Remote Sensing Images22 Oct 2024
- 2024AssemblyComplete: 3D Combinatorial Construction with Deep Reinforcement Learning20 Oct 2024
- 20243D Representation Methods: A Survey9 Oct 2024
- 2024Geometry Image Diffusion: Fast and Data-Efficient Text-to-3D with Image-Based Surface Representation5 Sep 2024
- 2024OctFusion: Octree-based Diffusion Models for 3D Shape Generation27 Aug 2024
- 2024PhysPart: Physically Plausible Part Completion for Interactable Objects25 Aug 2024
- 2024Atlas Gaussians Diffusion for 3D Generation23 Aug 2024
- 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion6 Aug 2024
- 2024Assessing Sample Quality via the Latent Space of Generative Models21 Jul 2024
- 2024Masked Generative Extractor for Synergistic Representation and 3D Generation of Point Clouds25 Jun 2024
- 2024LAM3D: Large Image-Point-Cloud Alignment Model for 3D Reconstruction from Single Image24 May 2024
- 2024PT43D: A Probabilistic Transformer for Generating 3D Shapes from Single Highly-Ambiguous RGB Images20 May 2024
- 2024Multi-view X-ray Image Synthesis with Multiple Domain Disentanglement from CT Scans18 Apr 2024
- 2024NeuSDFusion: A Spatial-Aware Generative Model for 3D Shape Completion, Reconstruction, and Generation27 Mar 2024
50 newest of 92 All 92 (JSON)
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 20223D Neural Field Generation using Triplane Diffusioncited by 274
- 20233DGen: Triplane Latent Diffusion for Textured Mesh Generationcited by 181
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2023SALAD: Part-Level Latent Diffusion for 3D Shape Generation and Manipulationcited by 66
- 2023Mosaic-SDF for 3D Generative Modelscited by 48
- 2023Controllable Mesh Generation Through Sparse Latent Point Diffusion Modelscited by 40
- 2024OctFusion: Octree-based Diffusion Models for 3D Shape Generationcited by 40
- 2023DiffComplete: Diffusion-based Generative 3D Shape Completioncited by 35
- 2025Gaussian Variation Field Diffusion for High-fidelity Video-to-4D Synthesiscited by 33
- 2025OctGPT: Octree-based Multiscale Autoregressive Models for 3D Shape Generationcited by 27
12 most cited of 28 All 28 (JSON)
- 2026Fourier-Latent Diffusion for Constrained Generation of Triply Periodic Minimal Surfaces3 Aug 2026
- 2026Vitality-Aware Compression for Efficient Image-to-Shape Diffusion Transformers1 Jul 2026
- 2026Sculpt4D: Generating 4D Shapes via Sparse-Attention Diffusion Transformers23 Apr 2026
- 2025AnimaMimic: Imitating 3D Animation from Video Priors16 Dec 2025
- 2025Evaluating Latent Generative Paradigms for High-Fidelity 3D Shape Completion from a Single Depth Image14 Nov 2025
- 2025SPGen: Spherical Projection as Consistent and Flexible Representation for Single Image 3D Shape Generation16 Sep 2025
- 2025HierOctFusion: Multi-scale Octree-based 3D Shape Generation via Part-Whole-Hierarchy Message Passing14 Aug 2025
- 2025Gaussian Variation Field Diffusion for High-fidelity Video-to-4D Synthesis31 Jul 2025
- 2025BridgeShape: Latent Diffusion Schr"odinger Bridge for 3D Shape Completion29 Jun 2025
- 2025OctGPT: Octree-based Multiscale Autoregressive Models for 3D Shape Generation14 Apr 2025
- 2025QEMesh: Employing A Quadric Error Metrics-Based Representation for Mesh Generation8 Apr 2025
- 2025Representing 3D Shapes With 64 Latent Vectors for 3D Diffusion Models11 Mar 2025
12 newest of 28 All 28 (JSON)
- 2024Structured 3D Latents for Scalable and Versatile 3D Generationcited by 742
- 2023MeshDiffusion: Score-based Generative 3D Mesh Modelingcited by 198
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 129
- 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
- 2025SparseFlex: High-Resolution and Arbitrary-Topology 3D Shape Modelingcited by 76
- 2024Advances in 3D Generation: A Surveycited by 62
- 2024An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusioncited by 34
- 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Maskscited by 29
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulationcited by 27
- 2024Make-A-Shape: a Ten-Million-scale 3D Shape Modelcited by 25
- 2023Ghost on the Shell: An Expressive Representation of General 3D Shapescited by 24
12 most cited of 62 All 62 (JSON)
- 2026OrnaStyler: Ornament-Aware Latent Editing for Content-Preserving 3D Stylization30 Aug 2026
- 2026AIMold: An Autonomous AI-based Pipeline for Complex Mold Design1 Aug 2026
- 2026DinoComplete: 3D Shape Completion with Distilled Semantic Priors and State Space Models26 May 2026
- 2026QuadLink: Autoregressive Quad-Dominant Mesh Generation via Point-Relation Learning16 May 2026
- 2026Structured 3D Latents Are Surprisingly Powerful: Unleashing Generalizable Style with 2D Diffusion6 May 2026
- 2026Mix3R: Mixing Feed-forward Reconstruction and Generative 3D Priors for Joint Multi-view Aligned 3D Reconstruction and Pose Estimation5 May 2026
- 20263D Generation for Embodied AI and Robotic Simulation: A Survey29 Apr 2026
- 2026RecGen3D: Reconstruction-Guided 3D Generation in a Shared Canonical Space1 Apr 2026
- 2026DipGuava: Disentangling Personalized Gaussian Features for 3D Head Avatars from Monocular Video30 Mar 2026
- 2025Memorization in 3D Shape Generation: An Empirical Study29 Dec 2025
- 2025Order Matters: 3D Shape Generation from Sequential VR Sketches4 Dec 2025
- 2025NANO3D: A Training-Free Approach for Efficient 3D Editing Without Masks16 Oct 2025
12 newest of 62 All 62 (JSON)