mlsanityData to 14 Oct 2026

Escaping Plato's Cave: 3D Shape From Adversarial Rendering

arXiv 1811.11606 ↗First posted 28 Nov 2018cs.CV cs.GRcited by 170

Not on the map. Why?

Cited by 31 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We introduce PlatonicGAN to discover the 3D structure of an object class from an unstructured collection of 2D images, i.e., where no relation between photos is known, except that they are showing instances of the same category. The key idea is to train a deep neural network to generate 3D shapes which, when rendered to images, are indistinguishable from ground truth images (for a discriminator) under various camera poses. Discriminating 2D images instead of 3D shapes allows tapping into unstructured 2D photo collections instead of relying on curated (e.g., aligned, annotated, etc.) 3D data sets. To establish constraints between 2D image observation and their 3D interpretation, we suggest a family of rendering layers that are effectively differentiable. This family includes visual hull, absorption-only (akin to x-ray), and emission-absorption. We can successfully reconstruct 3D shapes from unstructured 2D images and extensively evaluate PlatonicGAN on a range of synthetic and real data sets achieving consistent improvements over baseline methods. We further show that PlatonicGAN can be combined with 3D supervision to improve on and in some cases even surpass the quality of 3D-supervised methods.

Key facts. Cited by 170 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Nov 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 23; 2022: 46; 2023: 56; 2024: 30; 2025: 10; 2026: 5.

170 papers.

Sort:

By area:

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  3. 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,290
  4. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,205
  5. 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
  6. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  7. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 326
  8. 2023ReconFusion: 3D Reconstruction with Diffusion Priorscited by 318
  9. 2023Holodeck: Language Guided Generation of 3D Embodied AI Environmentscited by 268
  10. 2024A Survey on 3D Gaussian Splattingcited by 224
  11. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  12. 2022SparseFusion: Distilling View-conditioned Diffusion for 3D Reconstructioncited by 216
38 more
  1. 2022DiffRF: Rendering-Guided 3D Radiance Field Diffusioncited by 204
  2. 2023RichDreamer: A Generalizable Normal-Depth Diffusion Model for Detail Richness in Text-to-3Dcited by 168
  3. 2023GauHuman: Articulated Gaussian Splatting from Monocular Human Videoscited by 168
  4. 2022RenderDiffusion: Image Diffusion for 3D Reconstruction, Inpainting and Generationcited by 162
  5. 2023DreamAvatar: Text-and-Shape Guided 3D Human Avatar Generation via Diffusion Modelscited by 154
  6. 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
  7. 2021CIPS-3D: A 3D-Aware Generator of GANs Based on Conditionally-Independent Pixel Synthesiscited by 149
  8. 2022SPIn-NeRF: Multiview Segmentation and Perceptual Inpainting with Neural Radiance Fieldscited by 144
  9. 2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 139
  10. 2023NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidancecited by 138
  11. 2022VoxGRAF: Fast 3D-Aware Image Synthesis with Sparse Voxel Gridscited by 133
  12. 2021Unconstrained Scene Generation with Locally Conditioned Radiance Fieldscited by 130
  13. 2023CompGS: Smaller and Faster Gaussian Splatting with Vector Quantizationcited by 130
  14. 2022Next3D: Generative Neural Texture Rasterization for 3D-Aware Head Avatarscited by 124
  15. 2023Text2NeRF: Text-Driven 3D Scene Generation with Neural Radiance Fieldscited by 123
  16. 2022EVA3D: Compositional 3D Human Generation from 2D Image Collectionscited by 111
  17. 2023HoloDiffusion: Training a 3D Diffusion Model using 2D Imagescited by 106
  18. 2024FreGS: 3D Gaussian Splatting with Progressive Frequency Regularizationcited by 105
  19. 2023ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Renderingcited by 104
  20. 2022Generative Neural Articulated Radiance Fieldscited by 101
  21. 2021GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worldscited by 98
  22. 2024LN3DIFF++: Scalable Latent Neural Fields Diffusion for Speedy 3D Generationcited by 92
  23. 2024V3D: Video Diffusion Models are Effective 3D Generatorscited by 89
  24. 2022ReLU Fields: The Little Non-linearity That Couldcited by 87
  25. 2022GIRAFFE HD: A High-Resolution 3D-aware Generative Modelcited by 86
  26. 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 78
  27. 2021A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesiscited by 72
  28. 2021Shelf-Supervised Mesh Prediction in the Wildcited by 65
  29. 2021ACORN: Adaptive Coordinate Networks for Neural Scene Representationcited by 65
  30. 2022Texturify: Generating Textures on 3D Shape Surfacescited by 65
  31. 2022Unsupervised Learning of Efficient Geometry-Aware Neural Articulated Representationscited by 65
  32. 2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
  33. 2024Advances in 3D Generation: A Surveycited by 63
  34. 2025Bolt3D: Generating 3D Scenes in Secondscited by 59
  35. 2022Generative Multiplane Images: Making a 2D GAN 3D-Awarecited by 57
  36. 2021CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fieldscited by 55
  37. 2023Cross-Ray Neural Radiance Fields for Novel-view Synthesis from Unconstrained Image Collectionscited by 54
  38. 20223D GAN Inversion for Controllable Portrait Image Animationcited by 53

50 most cited of 170 All 170 (JSON)