Generative and Discriminative Voxel Modeling with Convolutional Neural Networks
Not on the map. Why?
Abstract (arXiv)
When working with three-dimensional data, choice of representation is key. We explore voxel-based models, and present evidence for the viability of voxellated representations in applications including shape modeling and object classification. Our key contributions are methods for training voxel-based variational autoencoders, a user interface for exploring the latent space learned by the autoencoder, and a deep convolutional neural network architecture for object classification. We address challenges unique to voxel-based representations, and empirically evaluate our models on the ModelNet benchmark, where we demonstrate a 51.5% relative improvement in the state of the art for object classification.
Key facts. Cited by 128 papers in the map (data through 7 Oct 2026). First posted on arXiv 15 Aug 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 22; 2022: 36; 2023: 28; 2024: 21; 2025: 14; 2026: 7.
128 papers.
Sort:
By area:
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
- 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 87
- 2022Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representationscited by 71
- 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67
38 more
- 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Modelscited by 67
- 2024Advances in 3D Generation: A Surveycited by 62
- 2022Fast Point Cloud Generation with Straight Flowscited by 56
- 2023Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversioncited by 47
- 2021Category-Level Metric Scale Object Shape and Pose Estimationcited by 40
- 2022Density-preserving Deep Point Cloud Compressioncited by 39
- 2021Octree Transformer: Autoregressive 3D Shape Generation on Hierarchically Structured Sequencescited by 38
- 2024RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Modelscited by 36
- 2021Neural Surface Mapscited by 34
- 2024TexPainter: Generative Mesh Texturing with Multi-view Consistencycited by 29
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splattingcited by 26
- 20223DAC: Learning Attribute Compression for Point Cloudscited by 22
- 2022Self-Supervised Representation Learning for CADcited by 22
- 2022ALTO: Alternating Latent Topologies for Implicit 3D Reconstructioncited by 21
- 2022NeuralVDB: High-resolution Sparse Volume Representation using Hierarchical Neural Networkscited by 20
- 2022NeuForm: Adaptive Overfitting for Neural Shape Editingcited by 18
- 2024Imagination Policy: Using Generative Point Cloud Models for Learning Manipulation Policiescited by 18
- 2025Nautilus: Locality-aware Autoencoder for Scalable Mesh Generationcited by 18
- 20213DIAS: 3D Shape Reconstruction with Implicit Algebraic Surfacescited by 17
- 20243D Mesh Editing using Masked LRMscited by 17
- 2021HandFoldingNet: A 3D Hand Pose Estimation Network Using Multiscale-Feature Guided Folding of a 2D Hand Skeletoncited by 16
- 2023Learning Object-Centric Neural Scattering Functions for Free-Viewpoint Relighting and Scene Compositioncited by 15
- 2024DIRECT-3D: Learning Direct Text-to-3D Generation on Massive Noisy 3D Datacited by 15
- 2025Eval3D: Interpretable and Fine-grained Evaluation for 3D Generationcited by 15
- 2021DeepMesh: Differentiable Iso-Surface Extractioncited by 14
- 2022TetraDiffusion: Tetrahedral Diffusion Models for 3D Shape Generationcited by 14
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformerscited by 14
- 2021Place recognition survey: An update on deep learning approachescited by 13
- 2021AIR-Nets: An Attention-Based Framework for Locally Conditioned Implicit Representationscited by 13
- 2022Volumetric Disentanglement for 3D Scene Manipulationcited by 13
- 2022Laplacian2Mesh: Laplacian-Based Mesh Understandingcited by 11
- 2022PointMCD: Boosting Deep Point Cloud Encoders via Multi-view Cross-modal Distillation for 3D Shape Recognitioncited by 10
- 2023Humans as Light Bulbs: 3D Human Reconstruction from Thermal Reflectioncited by 10
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtentscited by 10
- 2021PolyNet: Polynomial Neural Network for 3D Shape Recognition with PolyShape Representationcited by 9
- 2022Neural Convolutional Surfacescited by 9
- 2022Remote Sensing Novel View Synthesis with Implicit Multiplane Representationscited by 9
- 2022What's the Situation with Intelligent Mesh Generation: A Survey and Perspectivescited by 9
50 most cited of 128 All 128 (JSON)
- 2026VolCo: Volumetric Contact for High-Fidelity Human Grasp Generation7 Oct 2026
- 2026OptimusMesh: Compact Autoregressive Mesh Generation from Point Clouds via Sparse Latent Pivots1 Oct 2026
- 2026ReGDiff: Guided Diffusion in Regulated Latent Space for Exploring Metamaterial Voxel Geometry28 Sep 2026
- 2026Deep Learning Approaches for 3D Medical Scene Completion: From Geometric Modeling to Generative Paradigms23 Jun 2026
- 2026MeshFlow: Mesh Generation with Equivariant Flow Matching22 Jun 2026
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents6 Mar 2026
- 2026AssetFormer: Modular 3D Assets Generation with Autoregressive Transformer12 Feb 2026
- 2025A Survey of AI Methods for Geometry Preparation and Mesh Generation in Engineering Simulation16 Dec 2025
- 2025Mapping of Lesion Images to Somatic Mutations1 Dec 2025
- 2025ShapeGen: Towards High-Quality 3D Shape Synthesis25 Nov 2025
- 2025Comprehensive Assessment of LiDAR Evaluation Metrics: A Comparative Study Using Simulated and Real Data4 Nov 2025
- 2025TACO-Net: Topological Signatures Triumph in 3D Object Classification29 Sep 2025
38 more
- 2025Octree Diffusion for Semantic Scene Generation and Completion20 Sep 2025
- 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Framework2 Sep 2025
- 2025Can3Tok: Canonical 3D Tokenization and Latent Modeling of Scene-Level 3D Gaussians2 Aug 2025
- 20253D Shape Generation: A Survey27 Jun 2025
- 2025Vector Representations of Vessel Trees11 Jun 2025
- 2025Squeeze3D: Extreme Neural Compression with Latent Space Bridging9 Jun 2025
- 2025Eval3D: Interpretable and Fine-grained Evaluation for 3D Generation25 Apr 2025
- 2025MASH: Masked Anchored SpHerical Distances for 3D Shape Representation and Generation12 Apr 2025
- 2025Nautilus: Locality-aware Autoencoder for Scalable Mesh Generation24 Jan 2025
- 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scale12 Dec 2024
- 20243D Mesh Editing using Masked LRMs11 Dec 2024
- 2024Incremental Multi-Scene Modeling via Continual Neural Graphics Primitives29 Nov 2024
- 2024Don't Mesh with Me: Generating Constructive Solid Geometry Instead of Meshes by Fine-Tuning a Code-Generation LLM22 Nov 2024
- 2024DAGSM: Disentangled Avatar Generation with GS-enhanced Mesh20 Nov 2024
- 2024VSFormer: Mining Correlations in Flexible View Set for Multi-view 3D Shape Understanding14 Sep 2024
- 2024Learned Compression of Point Cloud Geometry and Attributes in a Single Model through Multimodal Rate-Control1 Aug 2024
- 2024PASTA: Controllable Part-Aware Shape Generation with Autoregressive Transformers18 Jul 2024
- 2024DiffuX2CT: Diffusion Learning to Reconstruct CT Images from Biplanar X-Rays18 Jul 2024
- 2024Differentiable Voxelization and Mesh Morphing15 Jul 2024
- 2024RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Models9 Jul 2024
- 2024Beyond Viewpoint: Robust 3D Object Recognition under Arbitrary Views through Joint Multi-Part Representation4 Jul 2024
- 2024Imagination Policy: Using Generative Point Cloud Models for Learning Manipulation Policies17 Jun 2024
- 2024DIRECT-3D: Learning Direct Text-to-3D Generation on Massive Noisy 3D Data6 Jun 2024
- 2024Steerable Transformers for Volumetric Data24 May 2024
- 2024TexPainter: Generative Mesh Texturing with Multi-view Consistency17 May 2024
- 2024COBRA -- COnfidence score Based on shape Regression Analysis for method-independent quality assessment of object pose estimation from single images25 Apr 2024
- 2024Encoding Urban Ecologies: Automated Building Archetype Generation through Self-Supervised Learning for Energy Modeling11 Apr 2024
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting15 Mar 2024
- 2024Can Shape-Infused Joint Embeddings Improve Image-Conditioned 3D Diffusion?2 Feb 2024
- 2024Advances in 3D Generation: A Survey31 Jan 2024
- 2023Group Multi-View Transformer for 3D Shape Analysis with Spatial Encoding27 Dec 2023
- 2023SLS4D: Sparse Latent Space for 4D Novel View Synthesis15 Dec 2023
- 2023ET3D: Efficient Text-to-3D Generation via Multi-View Distillation27 Nov 2023
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers27 Nov 2023
- 2023MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation24 Nov 2023
- 2023A Generative Neural Network Approach for 3D Multi-Criteria Design Generation and Optimization of an Engine Mount for an Unmanned Air Vehicle6 Nov 2023
- 2023Neural Network Reconstruction of the Left Atrium using Sparse Catheter Paths4 Nov 2023
- 2023Conformal Predictions Enhanced Expert-guided Meshing with Graph Neural Networks14 Aug 2023
50 newest of 128 All 128 (JSON)
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusioncited by 309
- 20223D-LDM: Neural Implicit 3D Shape Generation with Latent Diffusion Modelscited by 67
- 2022Fast Point Cloud Generation with Straight Flowscited by 56
- 2024RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Modelscited by 36
- 2024TexPainter: Generative Mesh Texturing with Multi-view Consistencycited by 29
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splattingcited by 26
- 2024DIRECT-3D: Learning Direct Text-to-3D Generation on Massive Noisy 3D Datacited by 15
- 2022TetraDiffusion: Tetrahedral Diffusion Models for 3D Shape Generationcited by 14
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtentscited by 10
- 2023MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generationcited by 8
- 2023ET3D: Efficient Text-to-3D Generation via Multi-View Distillationcited by 6
12 most cited of 16 All 16 (JSON)
- 2026ReGDiff: Guided Diffusion in Regulated Latent Space for Exploring Metamaterial Voxel Geometry28 Sep 2026
- 2026MeshFlow: Mesh Generation with Equivariant Flow Matching22 Jun 2026
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents6 Mar 2026
- 2024RodinHD: High-Fidelity 3D Avatar Generation with Diffusion Models9 Jul 2024
- 2024DIRECT-3D: Learning Direct Text-to-3D Generation on Massive Noisy 3D Data6 Jun 2024
- 2024TexPainter: Generative Mesh Texturing with Multi-view Consistency17 May 2024
- 2024Controllable Text-to-3D Generation via Surface-Aligned Gaussian Splatting15 Mar 2024
- 2024Can Shape-Infused Joint Embeddings Improve Image-Conditioned 3D Diffusion?2 Feb 2024
- 2023ET3D: Efficient Text-to-3D Generation via Multi-View Distillation27 Nov 2023
- 2023MVControl: Adding Conditional Control to Multi-view Diffusion for Controllable Text-to-3D Generation24 Nov 2023
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan 2023
- 2022Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion12 Dec 2022
12 newest of 16 All 16 (JSON)
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2021ShaRF: Shape-conditioned Radiance Fields from a Single Viewcited by 92
- 2024Meshtron: High-Fidelity, Artist-Like 3D Mesh Generation at Scalecited by 87
- 2022Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representationscited by 71
- 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67
- 2024Advances in 3D Generation: A Surveycited by 62
- 2023Instruct 3D-to-3D: Text Instruction Guided 3D-to-3D conversioncited by 47
12 most cited of 112 All 112 (JSON)
- 2026VolCo: Volumetric Contact for High-Fidelity Human Grasp Generation7 Oct 2026
- 2026OptimusMesh: Compact Autoregressive Mesh Generation from Point Clouds via Sparse Latent Pivots1 Oct 2026
- 2026Deep Learning Approaches for 3D Medical Scene Completion: From Geometric Modeling to Generative Paradigms23 Jun 2026
- 2026AssetFormer: Modular 3D Assets Generation with Autoregressive Transformer12 Feb 2026
- 2025A Survey of AI Methods for Geometry Preparation and Mesh Generation in Engineering Simulation16 Dec 2025
- 2025Mapping of Lesion Images to Somatic Mutations1 Dec 2025
- 2025ShapeGen: Towards High-Quality 3D Shape Synthesis25 Nov 2025
- 2025Comprehensive Assessment of LiDAR Evaluation Metrics: A Comparative Study Using Simulated and Real Data4 Nov 2025
- 2025TACO-Net: Topological Signatures Triumph in 3D Object Classification29 Sep 2025
- 2025Octree Diffusion for Semantic Scene Generation and Completion20 Sep 2025
- 2025Unifi3D: A Study on 3D Representations for Generation and Reconstruction in a Common Framework2 Sep 2025
- 2025Can3Tok: Canonical 3D Tokenization and Latent Modeling of Scene-Level 3D Gaussians2 Aug 2025
12 newest of 112 All 112 (JSON)