Improved Adversarial Systems for 3D Object Generation and Reconstruction
Not on the map. Why?
Abstract (arXiv)
This paper describes a new approach for training generative adversarial networks (GAN) to understand the detailed 3D shape of objects. While GANs have been used in this domain previously, they are notoriously hard to train, especially for the complex joint data distribution over 3D objects of many categories and orientations. Our method extends previous work by employing the Wasserstein distance normalized with gradient penalization as a training objective. This enables improved generation from the joint object shape distribution. Our system can also reconstruct 3D shape from 2D images and perform shape completion from occluded 2.5D range scans. We achieve notable quantitative improvements in comparison to existing baselines
Key facts. Cited by 66 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Jul 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 13; 2023: 21; 2024: 15; 2025: 2; 2026: 5.
66 papers.
Sort:
By area:
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2021Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completioncited by 111
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 109
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
38 more
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 76
- 20213D Semantic Scene Completion: a Surveycited by 74
- 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Modelscited by 64
- 2021Learning Generative Models of Textured 3D Meshes from Real-World Imagescited by 44
- 2023DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Modelcited by 43
- 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priorscited by 43
- 2023DiffComplete: Diffusion-based Generative 3D Shape Completioncited by 35
- 2021Active 3D Shape Reconstruction from Vision and Touchcited by 34
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulationcited by 27
- 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wildcited by 25
- 2024PhysPart: Physically Plausible Part Completion for Interactable Objectscited by 24
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusioncited by 23
- 2021Learning to Generate 3D Shapes with Generative Cellular Automatacited by 22
- 2021SP-GAN: Sphere-Guided 3D Shape Generation and Manipulationcited by 21
- 2024Interactive3D: Create What You Want by Interactive 3D Generationcited by 21
- 2021Building-GAN: Graph-Conditioned Architectural Volumetric Design Generationcited by 20
- 2022PUFA-GAN: A Frequency-Aware Generative Adversarial Network for 3D Point Cloud Upsamplingcited by 18
- 2024AToM: Amortized Text-to-Mesh using 2D Diffusioncited by 18
- 20213DRIMR: 3D Reconstruction and Imaging via mmWave Radar based on Deep Learningcited by 16
- 2023EXIM: A Hybrid Explicit-Implicit Representation for Text-Guided 3D Shape Generationcited by 16
- 2023Adversarial Score Distillation: When score distillation meets GANcited by 15
- 20233D Copy-Paste: Physically Plausible Object Insertion for Monocular 3D Detectioncited by 15
- 2023CLIPXPlore: Coupled CLIP and Shape Spaces for 3D Shape Explorationcited by 9
- 2021Unsupervised Shape Completion via Deep Prior in the Neural Tangent Kernel Perspectivecited by 8
- 2022Probabilistic Implicit Scene Completioncited by 8
- 2022Monocular 3D Object Reconstruction with GAN Inversioncited by 8
- 2022GARNet: Global-Aware Multi-View 3D Reconstruction Network and the Cost-Performance Tradeoffcited by 8
- 2023Vision + Language Applications: A Surveycited by 8
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Modelscited by 8
- 2024CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimizationcited by 8
- 2024DreamDissector: Learning Disentangled Text-to-3D Generation from 2D Diffusion Priorscited by 8
- 2022R2P: A Deep Learning Model from mmWave Radar to Point Cloudcited by 7
- 2023UMIFormer: Mining the Correlations between Similar Tokens for Multi-View 3D Reconstructioncited by 7
- 2022DeepMend: Learning Occupancy Functions to Represent Shape for Repaircited by 6
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assetscited by 6
- 2021DeepPoint: A Deep Learning Model for 3D Reconstruction in Point Clouds via mmWave Radarcited by 5
- 2022DeepJoin: Learning a Joint Occupancy, Signed Distance, and Normal Field Function for Shape Repaircited by 5
50 most cited of 66 All 66 (JSON)
- 2026SceneHI: High-Resolution 3D-Consistent Scene Texturing with Controllable Illumination9 Sep 2026
- 2026CNS-Edit++: Category-Agnostic 3D Editing with Coupled Neural Shape Representation18 Jul 2026
- 2026Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignment5 Jun 2026
- 2026AnySurf: Any Surface Generation with Directed Edge23 May 2026
- 2026CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customization19 Mar 2026
- 2025BridgeShape: Latent Diffusion Schr"odinger Bridge for 3D Shape Completion29 Jun 2025
- 2025PASTA: Part-Aware Sketch-to-3D Shape Generation with Text-Aligned Prior17 Mar 2025
- 20243D-WAG: Hierarchical Wavelet-Guided Autoregressive Generation for High-Fidelity 3D Shapes28 Nov 2024
- 2024Generative Aerodynamic Design with Diffusion Probabilistic Models20 Sep 2024
- 2024Pixel-Aligned Multi-View Generation with Depth Guided Decoder26 Aug 2024
- 2024PhysPart: Physically Plausible Part Completion for Interactable Objects25 Aug 2024
- 2024DreamDissector: Learning Disentangled Text-to-3D Generation from 2D Diffusion Priors23 Jul 2024
38 more
- 2024CSI4Free: GAN-Augmented mmWave CSI for Improved Pose Classification26 Jun 2024
- 2024C3DAG: Controlled 3D Animal Generation using 3D pose guidance11 Jun 2024
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models11 Jun 2024
- 2024Flow Score Distillation for Diverse Text-to-3D Generation16 May 2024
- 2024Interactive3D: Create What You Want by Interactive 3D Generation25 Apr 2024
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assets22 Apr 2024
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusion10 Apr 2024
- 2024Learning Coherent Matrixized Representation in Latent Space for Volumetric 4D Generation20 Mar 2024
- 2024CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization4 Feb 2024
- 2024AToM: Amortized Text-to-Mesh using 2D Diffusion1 Feb 2024
- 20233D Copy-Paste: Physically Plausible Object Insertion for Monocular 3D Detection8 Dec 2023
- 2023Adversarial Score Distillation: When score distillation meets GAN1 Dec 2023
- 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors28 Nov 2023
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Models28 Nov 2023
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusion21 Nov 2023
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov 2023
- 2023EXIM: A Hybrid Explicit-Implicit Representation for Text-Guided 3D Shape Generation3 Nov 2023
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generation2 Nov 2023
- 2023DiffComplete: Diffusion-based Generative 3D Shape Completion28 Jun 2023
- 2023CLIPXPlore: Coupled CLIP and Shape Spaces for 3D Shape Exploration14 Jun 2023
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidance30 May 2023
- 2023Vision + Language Applications: A Survey24 May 2023
- 2023Few-shot 3D Shape Generation19 May 2023
- 20233D GANs and Latent Space: A comprehensive survey8 Apr 2023
- 2023DITTO-NeRF: Diffusion-based Iterative Text To Omni-directional 3D Model6 Apr 2023
- 2023GINA-3D: Learning to Generate Implicit Neural Assets in the Wild4 Apr 2023
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Models20 Mar 2023
- 2023UMIFormer: Mining the Correlations between Similar Tokens for Multi-View 3D Reconstruction27 Feb 2023
- 2023Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulation1 Feb 2023
- 2023InfiniCity: Infinite-Scale City Synthesis23 Jan 2023
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generation18 Jan 2023
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generation8 Dec 2022
- 2022DeepJoin: Learning a Joint Occupancy, Signed Distance, and Normal Field Function for Shape Repair22 Nov 2022
- 2022Magic3D: High-Resolution Text-to-3D Content Creation18 Nov 2022
- 2022GARNet: Global-Aware Multi-View 3D Reconstruction Network and the Cost-Performance Tradeoff4 Nov 2022
- 2022DeepMend: Learning Occupancy Functions to Represent Shape for Repair11 Oct 2022
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Images22 Sep 2022
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generation19 Sep 2022
50 newest of 66 All 66 (JSON)
- 2022Magic3D: High-Resolution Text-to-3D Content Creationcited by 1,285
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Modelcited by 376
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 109
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Modelscited by 64
- 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priorscited by 43
- 2023DiffComplete: Diffusion-based Generative 3D Shape Completioncited by 35
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusioncited by 23
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Modelscited by 8
- 2024DreamDissector: Learning Disentangled Text-to-3D Generation from 2D Diffusion Priorscited by 8
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assetscited by 6
- 2024Flow Score Distillation for Diverse Text-to-3D Generationcited by 4
12 most cited of 16 All 16 (JSON)
- 2026SceneHI: High-Resolution 3D-Consistent Scene Texturing with Controllable Illumination9 Sep 2026
- 2025BridgeShape: Latent Diffusion Schr"odinger Bridge for 3D Shape Completion29 Jun 2025
- 2024Generative Aerodynamic Design with Diffusion Probabilistic Models20 Sep 2024
- 2024Pixel-Aligned Multi-View Generation with Depth Guided Decoder26 Aug 2024
- 2024DreamDissector: Learning Disentangled Text-to-3D Generation from 2D Diffusion Priors23 Jul 2024
- 20244Real: Towards Photorealistic 4D Scene Generation via Video Diffusion Models11 Jun 2024
- 2024Flow Score Distillation for Diverse Text-to-3D Generation16 May 2024
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assets22 Apr 2024
- 2024UDiFF: Generating Conditional Unsigned Distance Fields with Optimal Wavelet Diffusion10 Apr 2024
- 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors28 Nov 2023
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Models28 Nov 2023
- 2023Instant3D: Fast Text-to-3D with Sparse-View Generation and Large Reconstruction Model10 Nov 2023
12 newest of 16 All 16 (JSON)
- 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
- 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
- 2022GAUDI: A Neural Architect for Immersive 3D Scene Generationcited by 136
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2021Density-aware Chamfer Distance as a Comprehensive Metric for Point Cloud Completioncited by 111
- 2022SDF-StyleGAN: Implicit SDF-Based StyleGAN for 3D Shape Generationcited by 92
- 2023Text-Guided Texturing by Synchronized Multi-View Diffusioncited by 86
- 2023UltraLiDAR: Learning Compact Representations for LiDAR Completion and Generationcited by 76
- 20213D Semantic Scene Completion: a Surveycited by 74
- 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
- 2021Learning Generative Models of Textured 3D Meshes from Real-World Imagescited by 44
12 most cited of 49 All 49 (JSON)
- 2026CNS-Edit++: Category-Agnostic 3D Editing with Coupled Neural Shape Representation18 Jul 2026
- 2026Native3D: End-to-End 3D Scene Generation via Unified Mesh-Texture Modeling and Semantic Alignment5 Jun 2026
- 2026AnySurf: Any Surface Generation with Directed Edge23 May 2026
- 2026CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customization19 Mar 2026
- 2025PASTA: Part-Aware Sketch-to-3D Shape Generation with Text-Aligned Prior17 Mar 2025
- 20243D-WAG: Hierarchical Wavelet-Guided Autoregressive Generation for High-Fidelity 3D Shapes28 Nov 2024
- 2024PhysPart: Physically Plausible Part Completion for Interactable Objects25 Aug 2024
- 2024CSI4Free: GAN-Augmented mmWave CSI for Improved Pose Classification26 Jun 2024
- 2024C3DAG: Controlled 3D Animal Generation using 3D pose guidance11 Jun 2024
- 2024Interactive3D: Create What You Want by Interactive 3D Generation25 Apr 2024
- 2024Learning Coherent Matrixized Representation in Latent Space for Volumetric 4D Generation20 Mar 2024
- 2024CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization4 Feb 2024
12 newest of 49 All 49 (JSON)