mlsanityData to 14 Oct 2026

StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generation

arXiv 2112.11427 ↗First posted 21 Dec 2021cs.CV cs.AI cs.GRcited by 289

Not on the map. Why?

Cited by 43 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We introduce a high resolution, 3D-consistent image and shape generation technique which we call StyleSDF. Our method is trained on single-view RGB data only, and stands on the shoulders of StyleGAN2 for image generation, while solving two main challenges in 3D-aware GANs: 1) high-resolution, view-consistent generation of the RGB images, and 2) detailed 3D shape. We achieve this by merging a SDF-based 3D representation with a style-based 2D generator. Our 3D implicit network renders low-resolution feature maps, from which the style-based network generates view-consistent, 1024x1024 images. Notably, our SDF-based 3D modeling defines detailed 3D surfaces, leading to consistent volume rendering. Our method shows higher quality results compared to state of the art in terms of visual and geometric quality.

Key facts. Cited by 289 papers in the map (data through 14 Oct 2026). Builds on 64 of its 81 references that are in the map. First posted on arXiv 21 Dec 2021.

Builds on

64 of 81 references.

References · 64

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  3. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
  4. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  5. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  6. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  7. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  8. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  9. 2018Demystifying MMD GANscited by 1,293
  10. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  11. 2021Alias-Free Generative Adversarial Networkscited by 1,184
  12. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,098
38 more
  1. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  2. 2021Volume Rendering of Neural Implicit Surfacescited by 996
  3. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  4. 2020NeRF++: Analyzing and Improving Neural Radiance Fieldscited by 861
  5. 2019CNN-generated images are surprisingly easy to spot... for nowcited by 847
  6. 2019PIFu: Pixel-Aligned Implicit Function for High-Resolution Clothed Human Digitizationcited by 818
  7. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 785
  8. 2020Convolutional Occupancy Networkscited by 761
  9. 2021Depth-supervised NeRF: Fewer Views and Faster Training for Freecited by 735
  10. 2020Implicit Geometric Regularization for Learning Shapescited by 710
  11. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  12. 2019Differentiable Volumetric Rendering: Learning Implicit 3D Representations without 3D Supervisioncited by 700
  13. 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
  14. 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 689
  15. 2018Which Training Methods for GANs do actually Converge?cited by 679
  16. 2019Image2StyleGAN: How to Embed Images Into the StyleGAN Latent Space?cited by 675
  17. 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
  18. 2016Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modelingcited by 558
  19. 2018AtlasNet: A Papier-Mach'e Approach to Learning 3D Surface Generationcited by 539
  20. 2020PIFuHD: Multi-Level Pixel-Aligned Implicit Function for High-Resolution 3D Human Digitizationcited by 521
  21. 2019PointFlow: 3D Point Cloud Generation with Continuous Normalizing Flowscited by 488
  22. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  23. 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
  24. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 390
  25. 2020Local Implicit Grid Representations for 3D Scenescited by 373
  26. 2021Advances in Neural Renderingcited by 365
  27. 2019Image2StyleGAN++: How to Edit the Embedded Images?cited by 356
  28. 2020StyleFlow: Attribute-conditioned Exploration of StyleGAN-Generated Images using Conditional Continuous Normalizing Flowscited by 349
  29. 2020Implicit Functions in Feature Space for 3D Shape Reconstruction and Completioncited by 343
  30. 2020Deep Local Shapes: Learning Local SDF Priors for Detailed 3D Reconstructioncited by 321
  31. 2020State of the Art on Neural Renderingcited by 278
  32. 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 268
  33. 2018Deep Video Portraitscited by 267
  34. 2020Neural Unsigned Distance Fields for Implicit Function Learningcited by 265
  35. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  36. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  37. 2019Texture Fields: Learning Texture Representations in Function Spacecited by 210
  38. 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 68; 2023: 133; 2024: 66; 2025: 16; 2026: 6.

289 papers.

Sort:

By area:

  1. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  2. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  3. 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 699
  4. 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 553
  5. 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
  6. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  7. 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 378
  8. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
  9. 20223D Neural Field Generation using Triplane Diffusioncited by 274
  10. 2023Generative Novel View Synthesis with 3D-Aware Diffusion Modelscited by 274
  11. 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 250
  12. 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 235
38 more
  1. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generationcited by 162
  2. 2023SceneScape: Text-Driven Consistent Scene Generationcited by 160
  3. 2022ESLAM: Efficient Dense SLAM System Based on Hybrid Representation of Signed Distance Fieldscited by 158
  4. 2023WonderJourney: Going from Anywhere to Everywherecited by 158
  5. 2024VD3D: Taming Large Video Diffusion Transformers for 3D Camera Controlcited by 156
  6. 2024AC3D: Analyzing and Improving 3D Camera Control in Video Diffusion Transformerscited by 154
  7. 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
  8. 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 144
  9. 2022VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Gridscited by 133
  10. 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
  11. 2023Locally Attentional SDF Diffusion for Controllable 3D Shape Generationcited by 130
  12. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  13. 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
  14. 2022EpiGRAF: Rethinking training of 3D GANscited by 108
  15. 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Imagescited by 106
  16. 2022Generative Neural Articulated Radiance Fieldscited by 101
  17. 2023Compositional 3D Scene Generation using Locally Conditioned Diffusioncited by 101
  18. 2024Era3D: High-Resolution Multiview Diffusion using Efficient Row-wise Attentioncited by 100
  19. 2023PanoHead: Geometry-Aware 3D Full-Head Synthesis in 360circcited by 93
  20. 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
  21. 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
  22. 2023MonoHuman: Animatable Human Neural Field from Monocular Videocited by 85
  23. 2022BAD-NeRF: Bundle Adjusted Deblur Neural Radiance Fieldscited by 80
  24. 2024TC4D: Trajectory-Conditioned Text-to-4D Generationcited by 77
  25. 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 76
  26. 2022GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifoldscited by 73
  27. 2023SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collectionscited by 72
  28. 20233D-aware Image Generation using 2D Diffusion Modelscited by 69
  29. 2022Unifying Diffusion Models' Latent Space, with Applications to CycleDiffusion and Guidancecited by 67
  30. 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
  31. 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
  32. 2023Real-Time Radiance Fields for Single-Image Portrait View Synthesiscited by 64
  33. 2024MIMO: Controllable Character Video Synthesis with Spatial Decomposed Modelingcited by 64
  34. 2024Advances in 3D Generation: A Surveycited by 63
  35. 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
  36. 2023Gaussian Shell Maps for Efficient 3D Human Generationcited by 61
  37. 2022AvatarGen: A 3D Generative Model for Animatable Human Avatarscited by 59
  38. 2024ComboVerse: Compositional 3D Assets Creation Using Spatially-Aware Diffusion Guidancecited by 59

50 most cited of 289 All 289 (JSON)