Learning Descriptor Networks for 3D Shape Synthesis and Analysis
Not on the map. Why?
Abstract (arXiv)
This paper proposes a 3D shape descriptor network, which is a deep convolutional energy-based model, for modeling volumetric shape patterns. The maximum likelihood training of the model follows an "analysis by synthesis" scheme and can be interpreted as a mode seeking and mode shifting process. The model can synthesize 3D shape patterns by sampling from the probability distribution via MCMC such as Langevin dynamics. The model can be used to train a 3D generator network via MCMC teaching. The conditional version of the 3D shape descriptor net can be used for 3D object recovery and 3D object super-resolution. Experiments demonstrate that the proposed model can generate realistic 3D shape patterns and can be useful for 3D shape analysis.
Key facts. Cited by 56 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Apr 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 14; 2023: 17; 2024: 8; 2025: 3; 2026: 1.
56 papers.
Sort:
By area:
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 109
- 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 92
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
- 2021GraphEBM: Molecular Graph Generation with Energy-Based Modelscited by 85
- 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2021Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Predictioncited by 57
- 2022Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Surveycited by 54
38 more
- 2022Equivariant Descriptor Fields: SE(3)-Equivariant Energy-Based Models for End-to-End Visual Robotic Manipulation Learningcited by 54
- 2023Joint-MAE: 2D-3D Joint Masked Autoencoders for 3D Point Cloud Pre-trainingcited by 52
- 2021Learning Generative Models of Textured 3D Meshes from Real-World Imagescited by 44
- 2022A Tale of Two Flows: Cooperative Learning of Langevin Flow and Normalizing Flow Toward Energy-Based Modelcited by 44
- 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priorscited by 43
- 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generationcited by 23
- 2021Building-GAN: Graph-Conditioned Architectural Volumetric Design Generationcited by 20
- 2025Pippo: High-Resolution Multi-View Humans from a Single Imagecited by 20
- 2023Learning Energy-Based Models by Cooperative Diffusion Recovery Likelihoodcited by 19
- 2024AToM: Amortized Text-to-Mesh using 2D Diffusioncited by 18
- 2022Learning Probabilistic Models from Generator Latent Spaces with Hat EBMcited by 11
- 2023Pushing the Limits of 3D Shape Generation at Scalecited by 11
- 2021Bounds all around: training energy-based models with bidirectional boundscited by 10
- 2023Training Energy-Based Models with Diffusion Contrastive Divergencescited by 9
- 2021Learning Cycle-Consistent Cooperative Networks via Alternating MCMC Teaching for Unsupervised Cross-Domain Translationcited by 8
- 2021Energy-Based Generative Cooperative Saliency Predictioncited by 8
- 2022Monocular 3D Object Reconstruction with GAN Inversioncited by 8
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Modelscited by 8
- 2021Hierarchical View Predictor: Unsupervised 3D Global Feature Learning through Hierarchical Prediction among Unordered Viewscited by 7
- 2022Gradient-Guided Importance Sampling for Learning Binary Energy-Based Modelscited by 6
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assetscited by 6
- 2022IC3D: Image-Conditioned 3D Diffusion for Shape Generationcited by 5
- 2022PointCMC: Cross-Modal Multi-Scale Correspondences Learning for Point Cloud Understandingcited by 5
- 2023Context-Aware Transformer for 3D Point Cloud Automatic Annotationcited by 5
- 2021Staying in Shape: Learning Invariant Shape Representations using Contrastive Learningcited by 4
- 2022Combating Mode Collapse in GANs via Manifold Entropy Estimationcited by 4
- 2024Learning Coherent Matrixized Representation in Latent Space for Volumetric 4D Generationcited by 4
- 2024Flow Score Distillation for Diverse Text-to-3D Generationcited by 4
- 2021EBM-Fold: Fully-Differentiable Protein Folding Powered by Energy-based Modelscited by 3
- 2021Learning Proposals for Practical Energy-Based Regressioncited by 3
- 2022An Energy-Based Prior for Generative Saliencycited by 3
- 2024GenUDC: High Quality 3D Mesh Generation with Unsigned Dual Contouring Representationcited by 3
- 2021Energy Aligning for Biased Modelscited by 2
- 2023Likelihood-Based Generative Radiance Field with Latent Space Energy-Based Model for 3D-Aware Disentangled Image Representationcited by 2
- 2023Maximizing Discrimination Capability of Knowledge Distillation with Energy Functioncited by 2
- 2022CoopHash: Cooperative Learning of Multipurpose Descriptor and Contrastive Pair Generator via Variational MCMC Teaching for Supervised Image Hashingcited by 1
- 2024Can Shape-Infused Joint Embeddings Improve Image-Conditioned 3D Diffusion?cited by 1
- 2026CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customizationcited by 1
50 most cited of 56 All 56 (JSON)
- 2026CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customization19 Mar 2026
- 2025GauSSmart: Enhanced 3D Reconstruction through 2D Foundation Models and Geometric Filtering16 Oct 2025
- 2025Exploring bidirectional bounds for minimax-training of Energy-based models5 Jun 2025
- 2025Pippo: High-Resolution Multi-View Humans from a Single Image11 Feb 2025
- 2024GenUDC: High Quality 3D Mesh Generation with Unsigned Dual Contouring Representation23 Oct 2024
- 2024Flow Score Distillation for Diverse Text-to-3D Generation16 May 2024
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assets22 Apr 2024
- 2024A Hybrid Generative and Discriminative PointNet on Unordered Point Sets19 Apr 2024
- 2024Learning Coherent Matrixized Representation in Latent Space for Volumetric 4D Generation20 Mar 2024
- 2024SPAD : Spatially Aware Multiview Diffusers7 Feb 2024
- 2024Can Shape-Infused Joint Embeddings Improve Image-Conditioned 3D Diffusion?2 Feb 2024
- 2024AToM: Amortized Text-to-Mesh using 2D Diffusion1 Feb 2024
38 more
- 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors28 Nov 2023
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Models28 Nov 2023
- 2023Maximizing Discrimination Capability of Knowledge Distillation with Energy Function24 Nov 2023
- 2023IPVNet: Learning Implicit Point-Voxel Features for Open-Surface 3D Reconstruction5 Nov 2023
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models20 Oct 2023
- 2023STANLEY: Stochastic Gradient Anisotropic Langevin Dynamics for Learning Energy-Based Models19 Oct 2023
- 2023Learning Energy-Based Models by Cooperative Diffusion Recovery Likelihood10 Sep 2023
- 2023Training Energy-Based Models with Diffusion Contrastive Divergences4 Jul 2023
- 2023Pushing the Limits of 3D Shape Generation at Scale20 Jun 2023
- 2023DiffInDScene: Diffusion-based High-Quality 3D Indoor Scene Generation1 Jun 2023
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidance30 May 2023
- 2023Evaluating 3D Shape Analysis Methods for Robustness to Rotation Invariance29 May 2023
- 2023Likelihood-Based Generative Radiance Field with Latent Space Energy-Based Model for 3D-Aware Disentangled Image Representation16 Apr 2023
- 2023Context-Aware Transformer for 3D Point Cloud Automatic Annotation27 Mar 2023
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Models20 Mar 2023
- 2023Joint-MAE: 2D-3D Joint Masked Autoencoders for 3D Point Cloud Pre-training27 Feb 2023
- 2023InfiniCity: Infinite-Scale City Synthesis23 Jan 2023
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generation8 Dec 2022
- 2022PointCMC: Cross-Modal Multi-Scale Correspondences Learning for Point Cloud Understanding22 Nov 2022
- 2022IC3D: Image-Conditioned 3D Diffusion for Shape Generation20 Nov 2022
- 2022Learning Probabilistic Models from Generator Latent Spaces with Hat EBM29 Oct 2022
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct 2022
- 2022Gradient-Guided Importance Sampling for Learning Binary Energy-Based Models11 Oct 2022
- 2022CoopHash: Cooperative Learning of Multipurpose Descriptor and Contrastive Pair Generator via Variational MCMC Teaching for Supervised Image Hashing9 Oct 2022
- 2022Combating Mode Collapse in GANs via Manifold Entropy Estimation25 Aug 2022
- 2022Monocular 3D Object Reconstruction with GAN Inversion20 Jul 2022
- 2022Equivariant Descriptor Fields: SE(3)-Equivariant Energy-Based Models for End-to-End Visual Robotic Manipulation Learning16 Jun 2022
- 20223DILG: Irregular Latent Grids for 3D Generative Modeling27 May 2022
- 2022A Tale of Two Flows: Cooperative Learning of Langevin Flow and Normalizing Flow Toward Energy-Based Model13 May 2022
- 2022An Energy-Based Prior for Generative Saliency19 Apr 2022
- 2022Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Survey28 Feb 2022
- 2021Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Prediction27 Dec 2021
- 2021Bounds all around: training energy-based models with bidirectional bounds1 Nov 2021
- 2021Learning Proposals for Practical Energy-Based Regression22 Oct 2021
- 2021Hierarchical View Predictor: Unsupervised 3D Global Feature Learning through Hierarchical Prediction among Unordered Views8 Aug 2021
- 2021Staying in Shape: Learning Invariant Shape Representations using Contrastive Learning8 Jul 2021
- 2021Energy-Based Generative Cooperative Saliency Prediction25 Jun 2021
- 2021Energy Aligning for Biased Models7 Jun 2021
50 newest of 56 All 56 (JSON)
- 2022LION: Latent Point Diffusion Models for 3D Shape Generationcited by 552
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Modelscited by 234
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidancecited by 109
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Modelscited by 86
- 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priorscited by 43
- 2023Learning Energy-Based Models by Cooperative Diffusion Recovery Likelihoodcited by 19
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Modelscited by 8
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assetscited by 6
- 2022IC3D: Image-Conditioned 3D Diffusion for Shape Generationcited by 5
- 2024Flow Score Distillation for Diverse Text-to-3D Generationcited by 4
- 2024Can Shape-Infused Joint Embeddings Improve Image-Conditioned 3D Diffusion?cited by 1
- 2024Flow Score Distillation for Diverse Text-to-3D Generation16 May 2024
- 2024MaterialSeg3D: Segmenting Dense Materials from 2D Priors for 3D Assets22 Apr 2024
- 2024Can Shape-Infused Joint Embeddings Improve Image-Conditioned 3D Diffusion?2 Feb 2024
- 2023SceneTex: High-Quality Texture Synthesis for Indoor Scenes via Diffusion Priors28 Nov 2023
- 2023Surf-D: Generating High-Quality Surfaces of Arbitrary Topologies Using Diffusion Models28 Nov 2023
- 2023TexFusion: Synthesizing 3D Textures with Text-Guided Image Diffusion Models20 Oct 2023
- 2023Learning Energy-Based Models by Cooperative Diffusion Recovery Likelihood10 Sep 2023
- 2023HiFA: High-fidelity Text-to-3D Generation with Advanced Diffusion Guidance30 May 2023
- 2023Text2Tex: Text-driven Texture Synthesis via Diffusion Models20 Mar 2023
- 2022IC3D: Image-Conditioned 3D Diffusion for Shape Generation20 Nov 2022
- 2022LION: Latent Point Diffusion Models for 3D Shape Generation12 Oct 2022
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
- 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 92
- 2021GraphEBM: Molecular Graph Generation with Energy-Based Modelscited by 85
- 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
- 2024SPAD : Spatially Aware Multiview Diffuserscited by 62
- 2021Learning Generative Vision Transformer with Energy-Based Latent Space for Saliency Predictioncited by 57
- 2022Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Surveycited by 54
- 2022Equivariant Descriptor Fields: SE(3)-Equivariant Energy-Based Models for End-to-End Visual Robotic Manipulation Learningcited by 54
- 2023Joint-MAE: 2D-3D Joint Masked Autoencoders for 3D Point Cloud Pre-trainingcited by 52
- 2021Learning Generative Models of Textured 3D Meshes from Real-World Imagescited by 44
- 2022A Tale of Two Flows: Cooperative Learning of Langevin Flow and Normalizing Flow Toward Energy-Based Modelcited by 44
12 most cited of 45 All 45 (JSON)
- 2026CustomTex: High-fidelity Indoor Scene Texturing via Multi-Reference Customization19 Mar 2026
- 2025GauSSmart: Enhanced 3D Reconstruction through 2D Foundation Models and Geometric Filtering16 Oct 2025
- 2025Exploring bidirectional bounds for minimax-training of Energy-based models5 Jun 2025
- 2025Pippo: High-Resolution Multi-View Humans from a Single Image11 Feb 2025
- 2024GenUDC: High Quality 3D Mesh Generation with Unsigned Dual Contouring Representation23 Oct 2024
- 2024A Hybrid Generative and Discriminative PointNet on Unordered Point Sets19 Apr 2024
- 2024Learning Coherent Matrixized Representation in Latent Space for Volumetric 4D Generation20 Mar 2024
- 2024SPAD : Spatially Aware Multiview Diffusers7 Feb 2024
- 2024AToM: Amortized Text-to-Mesh using 2D Diffusion1 Feb 2024
- 2023Maximizing Discrimination Capability of Knowledge Distillation with Energy Function24 Nov 2023
- 2023IPVNet: Learning Implicit Point-Voxel Features for Open-Surface 3D Reconstruction5 Nov 2023
- 2023STANLEY: Stochastic Gradient Anisotropic Langevin Dynamics for Learning Energy-Based Models19 Oct 2023
12 newest of 45 All 45 (JSON)