Octree Generating Networks: Efficient Convolutional Architectures for High-resolution 3D Outputs
Not on the map. Why?
Abstract (arXiv)
We present a deep convolutional decoder architecture that can generate volumetric 3D outputs in a compute- and memory-efficient manner by using an octree representation. The network learns to predict both the structure of the octree, and the occupancy values of individual cells. This makes it a particularly valuable technique for generating 3D shapes. In contrast to standard decoders acting on regular voxel grids, the architecture does not have cubic complexity. This allows representing much higher resolution outputs with a limited memory budget. We demonstrate this in several application domains, including 3D convolutional autoencoders, generation of objects and whole scenes from high-level representations, and shape from a single image.
Key facts. Cited by 189 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 72; 2022: 41; 2023: 36; 2024: 19; 2025: 14; 2026: 7.
189 papers.
Sort:
By area:
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 179
38 more
- 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2023NeRF-DS: Neural Radiance Fields for Dynamic Specular Objectscited by 110
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 101
- 2022POCO: Point Convolution for Surface Reconstructioncited by 91
- 2021A comprehensive survey on point cloud registrationcited by 84
- 2021DiGS : Divergence guided shape implicit neural representation for unoriented point cloudscited by 76
- 2022Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representationscited by 71
- 2022DM-NeRF: 3D Scene Geometry Decomposition and Manipulation from 2D Imagescited by 69
- 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67
- 2021ROCA: Robust CAD Model Retrieval and Alignment from a Single Imagecited by 66
- 2021SA-ConvONet: Sign-Agnostic Optimization of Convolutional Occupancy Networkscited by 59
- 2025Bolt3D: Generating 3D Scenes in Secondscited by 57
- 2023OctreeOcc: Efficient and Multi-Granularity Occupancy Prediction Using Octree Queriescited by 48
- 2021FiG-NeRF: Figure-Ground Neural Radiance Fields for 3D Object Category Modellingcited by 47
- 2022GIFS: Neural Implicit Function for General Shape Representationcited by 45
- 2021Learning Generative Models of Textured 3D Meshes from Real-World Imagescited by 44
- 2022Towards High-Fidelity Single-view Holistic Reconstruction of Indoor Scenescited by 43
- 2024L3DG: Latent 3D Gaussian Diffusioncited by 42
- 2021Cross-modal Learning for Domain Adaptation in 3D Semantic Segmentationcited by 40
- 2021ARAPReg: An As-Rigid-As Possible Regularization Loss for Learning Deformable Shape Generatorscited by 40
- 2021Patch2CAD: Patchwise Embedding Learning for In-the-Wild Shape Retrieval from a Single Imagecited by 39
- 2024LATTE3D: Large-scale Amortized Text-To-Enhanced3D Synthesiscited by 39
- 2021SAIL-VOS 3D: A Synthetic Dataset and Baselines for Object Detection and 3D Mesh Reconstruction from Video Datacited by 38
- 2021Octree Transformer: Autoregressive 3D Shape Generation on Hierarchically Structured Sequencescited by 38
- 2021Multiresolution Deep Implicit Functions for 3D Shape Representationcited by 35
- 2022Reconstructing Hand-Held Objects from Monocular Videocited by 35
- 2023Vision Transformers with Mixed-Resolution Tokenizationcited by 35
- 2022Neural Template: Topology-aware Reconstruction and Disentangled Generation of 3D Meshescited by 34
- 2021Learning Parallel Dense Correspondence from Spatio-Temporal Descriptors for Efficient and Robust 4D Reconstructioncited by 31
- 2022GenSDF: Two-Stage Learning of Generalizable Signed Distance Functionscited by 30
- 2023ZeroShape: Regression-based Zero-shot Shape Reconstructioncited by 30
- 2021RetrievalFuse: Neural 3D Scene Reconstruction with a Databasecited by 28
- 2021Fast and Explicit Neural View Synthesiscited by 28
- 2023NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videoscited by 28
- 20223PSDF: Three-Pole Signed Distance Function for Learning Surfaces with Arbitrary Topologiescited by 27
- 2021LegoFormer: Transformers for Block-by-Block Multi-view 3D Reconstructioncited by 25
50 most cited of 189 All 189 (JSON)
- 2026SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation1 Oct 2026
- 2026ASV3D: Adapting Diffusion-Based Single-View 3D Reconstruction with Extra Imagery8 Aug 2026
- 20263DMPE: 3D Multi-Perspective Embedding6 Jul 2026
- 2026AirfoilGen: A valid-by-construction and performance-aware latent diffusion model for airfoil generation19 May 2026
- 2026OCH3R: Object-Centric Holistic 3D Reconstruction13 May 2026
- 2026Training-free Spatially Grounded Geometric Shape Encoding (Technical Report)8 Apr 2026
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents6 Mar 2026
- 2025Evaluating Latent Generative Paradigms for High-Fidelity 3D Shape Completion from a Single Depth Image14 Nov 2025
- 2025A 3D Generation Framework from Cross Modality to Parameterized Primitive9 Oct 2025
- 2025StrucADT: Generating Structure-controlled 3D Point Clouds with Adjacency Diffusion Transformer28 Sep 2025
- 2025Multispectral-NeRF:a multispectral modeling approach based on neural radiance fields14 Sep 2025
- 2025RayletDF: Raylet Distance Fields for Generalizable 3D Surface Reconstruction from Point Clouds or Gaussians13 Aug 2025
38 more
- 20253D Shape Generation: A Survey27 Jun 2025
- 2025LEO-VL: Efficient Scene Representation for Scalable 3D Vision-Language Learning11 Jun 2025
- 2025Memory-Efficient Super-Resolution of 3D Micro-CT Images Using Octree-Based GANs: Enhancing Resolution and Segmentation Accuracy24 May 2025
- 2025Self-Balancing, Memory Efficient, Dynamic Metric Space Data Maintenance, for Rapid Multi-Kernel Estimation25 Apr 2025
- 2025Efficient Autoregressive Shape Generation via Octree-Based Adaptive Tokenization3 Apr 2025
- 2025Unified Cross-Scale 3D Generation and Understanding via Autoregressive Modeling20 Mar 2025
- 2025Bolt3D: Generating 3D Scenes in Seconds18 Mar 2025
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimization18 Feb 2025
- 2025NoKSR: Kernel-Free Neural Surface Reconstruction via Point Cloud Serialization18 Feb 2025
- 2024Don't Mesh with Me: Generating Constructive Solid Geometry Instead of Meshes by Fine-Tuning a Code-Generation LLM22 Nov 2024
- 2024PixelGaussian: Generalizable 3D Gaussian Reconstruction from Arbitrary Views24 Oct 2024
- 2024L3DG: Latent 3D Gaussian Diffusion17 Oct 2024
- 2024Optimizing 3D Geometry Reconstruction from Implicit Neural Representations16 Oct 2024
- 2024GALA: Geometry-Aware Local Adaptive Grids for Detailed 3D Generation13 Oct 2024
- 20243D Representation Methods: A Survey9 Oct 2024
- 2024Underground Mapping and Localization Based on Ground-Penetrating Radar24 Sep 2024
- 2024Deep Learning at the Intersection: Certified Robustness as a Tool for 3D Vision23 Aug 2024
- 2024TreeSBA: Tree-Transformer for Self-Supervised Sequential Brick Assembly22 Jul 2024
- 2024OSN: Infinite Representations of Dynamic 3D Scenes from Monocular Videos8 Jul 2024
- 2024Bayesian Mesh Optimization for Graph Neural Networks to Enhance Engineering Performance Prediction4 Jun 2024
- 2024Accurate Training Data for Occupancy Map Prediction in Automated Driving Using Evidence Theory17 May 2024
- 2024PointCompress3D: A Point Cloud Compression Framework for Roadside LiDARs in Intelligent Transportation Systems2 May 2024
- 2024Unsupervised Occupancy Learning from Sparse Point Cloud3 Apr 2024
- 2024APC2Mesh: Bridging the gap from occluded building faccades to full 3D models3 Apr 2024
- 2024CVT-xRF: Contrastive In-Voxel Transformer for 3D Consistent Radiance Fields from Sparse Inputs25 Mar 2024
- 2024LATTE3D: Large-scale Amortized Text-To-Enhanced3D Synthesis22 Mar 2024
- 20243D Reconstruction and New View Synthesis of Indoor Environments based on a Dual Neural Radiance Field26 Jan 2024
- 20243D Shape Completion on Unseen Categories:A Weakly-supervised Approach19 Jan 2024
- 2023ZeroShape: Regression-based Zero-shot Shape Reconstruction21 Dec 2023
- 2023DUSt3R: Geometric 3D Vision Made Easy21 Dec 2023
- 2023NVFi: Neural Velocity Fields for 3D Physics Learning from Dynamic Videos11 Dec 2023
- 2023Doodle Your 3D: From Abstract Freehand Sketches to Precise 3D Shapes7 Dec 2023
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchies6 Dec 2023
- 2023OctreeOcc: Efficient and Multi-Granularity Occupancy Prediction Using Octree Queries6 Dec 2023
- 2023Slice3D: Multi-Slice, Occlusion-Revealing, Single View 3D Reconstruction3 Dec 2023
- 2023Deeper into Self-Supervised Monocular Indoor Depth Estimation3 Dec 2023
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformers27 Nov 2023
- 2023Robustifying Generalizable Implicit Shape Networks with a Tunable Non-Parametric Model21 Nov 2023
50 newest of 189 All 189 (JSON)
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 449
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Modelscited by 151
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generationcited by 133
- 2025Bolt3D: Generating 3D Scenes in Secondscited by 57
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtentscited by 10
- 2022IC3D: Image-Conditioned 3D Diffusion for Shape Generationcited by 5
- 2025Evaluating Latent Generative Paradigms for High-Fidelity 3D Shape Completion from a Single Depth Imagecited by 1
- 2025StrucADT: Generating Structure-controlled 3D Point Clouds with Adjacency Diffusion Transformercited by 0
- 2026AirfoilGen: A valid-by-construction and performance-aware latent diffusion model for airfoil generationcited by 0
- 2026AirfoilGen: A valid-by-construction and performance-aware latent diffusion model for airfoil generation19 May 2026
- 2026LATO: 3D Mesh Flow Matching with Structured TOpology Preserving LAtents6 Mar 2026
- 2025Evaluating Latent Generative Paradigms for High-Fidelity 3D Shape Completion from a Single Depth Image14 Nov 2025
- 2025StrucADT: Generating Structure-controlled 3D Point Clouds with Adjacency Diffusion Transformer28 Sep 2025
- 2025Bolt3D: Generating 3D Scenes in Seconds18 Mar 2025
- 2023Let 2D Diffusion Model Know 3D-Consistency for Robust Text-to-3D Generation14 Mar 2023
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan 2023
- 2022Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models28 Dec 2022
- 2022IC3D: Image-Conditioned 3D Diffusion for Shape Generation20 Nov 2022
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,607
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,526
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 904
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 459
- 2023MeshGPT: Generating Triangle Meshes with Decoder-Only Transformerscited by 254
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2021NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereocited by 191
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2023NerfDiff: Single-image View Synthesis with NeRF-guided Distillation from 3D-aware Diffusioncited by 179
- 2021GNeRF: GAN-based Neural Radiance Field without Posed Cameracited by 153
12 most cited of 179 All 179 (JSON)
- 2026SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation1 Oct 2026
- 2026ASV3D: Adapting Diffusion-Based Single-View 3D Reconstruction with Extra Imagery8 Aug 2026
- 20263DMPE: 3D Multi-Perspective Embedding6 Jul 2026
- 2026OCH3R: Object-Centric Holistic 3D Reconstruction13 May 2026
- 2026Training-free Spatially Grounded Geometric Shape Encoding (Technical Report)8 Apr 2026
- 2025A 3D Generation Framework from Cross Modality to Parameterized Primitive9 Oct 2025
- 2025Multispectral-NeRF:a multispectral modeling approach based on neural radiance fields14 Sep 2025
- 2025RayletDF: Raylet Distance Fields for Generalizable 3D Surface Reconstruction from Point Clouds or Gaussians13 Aug 2025
- 20253D Shape Generation: A Survey27 Jun 2025
- 2025Memory-Efficient Super-Resolution of 3D Micro-CT Images Using Octree-Based GANs: Enhancing Resolution and Segmentation Accuracy24 May 2025
- 2025Self-Balancing, Memory Efficient, Dynamic Metric Space Data Maintenance, for Rapid Multi-Kernel Estimation25 Apr 2025
- 2025Efficient Autoregressive Shape Generation via Octree-Based Adaptive Tokenization3 Apr 2025
12 newest of 179 All 179 (JSON)