OctNet: Learning Deep 3D Representations at High Resolutions
Not on the map. Why?
Abstract (arXiv)
We present OctNet, a representation for deep learning with sparse 3D data. In contrast to existing models, our representation enables 3D convolutional networks which are both deep and high resolution. Towards this goal, we exploit the sparsity in the input data to hierarchically partition the space using a set of unbalanced octrees where each leaf node stores a pooled feature representation. This allows to focus memory allocation and computation to the relevant dense regions and enables deeper networks without compromising resolution. We demonstrate the utility of our OctNet representation by analyzing the impact of resolution on several 3D tasks including 3D object classification, orientation estimation and point cloud labeling.
Key facts. Cited by 342 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Nov 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 113; 2022: 76; 2023: 70; 2024: 43; 2025: 20; 2026: 20.
342 papers.
Sort:
By area:
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2021Advances in Neural Renderingcited by 365
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2022Language-Grounded Indoor 3D Semantic Segmentation in the Wildcited by 246
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Cloudscited by 211
- 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 200
- 2024Scene-LLM: Extending Language Model for 3D Visual Understanding and Reasoningcited by 175
- 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
38 more
- 2021Walk in the Cloud: Learning Curves for Point Clouds Shape Analysiscited by 172
- 2021Deep Parametric Continuous Convolutional Neural Networkscited by 161
- 2021InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referringcited by 141
- 2021Hierarchical Aggregation for 3D Instance Segmentationcited by 127
- 2021NeSF: Neural Semantic Fields for Generalizable Semantic Segmentation of 3D Scenescited by 119
- 2021A-SDF: Learning Disentangled Signed Distance Functions for Articulated Shape Representationcited by 114
- 2023OctFormer: Octree-based Transformers for 3D Point Cloudscited by 109
- 2021Neural Parts: Learning Expressive 3D Shape Abstractions with Invertible Neural Networkscited by 103
- 2024DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Modelscited by 98
- 2021Bidirectional Projection Network for Cross Dimension Scene Understandingcited by 95
- 20223DILG: Irregular Latent Grids for 3D Generative Modelingcited by 93
- 2022POCO: Point Convolution for Surface Reconstructioncited by 92
- 2021One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentationcited by 89
- 2021Guided Point Contrastive Learning for Semi-supervised Point Cloud Semantic Segmentationcited by 87
- 2021A comprehensive survey on point cloud registrationcited by 84
- 2022Surface Representation for Point Cloudscited by 84
- 20213D Semantic Scene Completion: a Surveycited by 74
- 2022P2P: Tuning Pre-trained Image Models for Point Cloud Analysis with Point-to-Pixel Promptingcited by 74
- 2023FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformercited by 73
- 2021Understanding Pooling in Graph Neural Networkscited by 69
- 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
- 2021Deep Implicit Moving Least-Squares Functions for 3D Reconstructioncited by 67
- 2025CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generationcited by 67
- 2021Multi-Modal 3D Object Detection in Autonomous Driving: a Surveycited by 63
- 2021Adaptive Graph Convolution for Point Cloud Analysiscited by 60
- 2021Learning 3D Semantic Segmentation with only 2D Image Supervisioncited by 60
- 2021SA-ConvONet: Sign-Agnostic Optimization of Convolutional Occupancy Networkscited by 59
- 2022AlignSDF: Pose-Aligned Signed Distance Fields for Hand-Object Reconstructioncited by 59
- 2021PRA-Net: Point Relation-Aware Network for 3D Point Cloud Analysiscited by 58
- 2022OctAttention: Octree-Based Large-Scale Contexts Model for Point Cloud Compressioncited by 58
- 2023Efficient 3D Semantic Segmentation with Superpoint Transformercited by 57
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2022Contrastive Boundary Learning for Point Cloud Segmentationcited by 56
- 2021Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Cloudscited by 55
- 2022Few-View Object Reconstruction with Unknown Categories and Camera Posescited by 53
- 2021Learning Semantic Segmentation of Large-Scale Point Clouds with Random Samplingcited by 51
- 2021CSG-Stump: A Learning Friendly CSG-Like Representation for Interpretable Shape Parsingcited by 51
- 20213D-to-2D Distillation for Indoor Scene Parsingcited by 48
50 most cited of 342 All 342 (JSON)
- 2026LoCoSplat: Real-Time Feed-Forward 3D Gaussian Splatting with Minimal 3D Reasoning3 Oct 2026
- 2026Octrees as an Explicit 3D Language1 Oct 2026
- 2026SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation1 Oct 2026
- 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generation28 Sep 2026
- 2026LatentReRig: An SDF-Based VAE with Dual Decoders for Latent-Space Deformation Conditioning21 Sep 2026
- 2026ZODIAC: Zero-shot Octree-based Diffusion for Anatomical Completion25 Aug 2026
- 2026PCT-Prompt: A Prompt-Guided Transformer Framework for Dense Prediction Tasks in Point Clouds17 Aug 2026
- 2026Efficient Human-Contact Representation for Human-Scene Interaction10 Aug 2026
- 2026PVCap: Towards Accurate 3D Dense Captioning via PseudoCap and VoxelCapNet7 Jul 2026
- 2026UnderOneFacade: Worldwide Facade Semantic Segmentation Benchmark Dataset2 Jul 2026
- 2026Deep Learning Approaches for 3D Medical Scene Completion: From Geometric Modeling to Generative Paradigms23 Jun 2026
- 2026A Cookbook of 3D Vision: Data, Learning Paradigms, and Application2 Jun 2026
38 more
- 2026A Survey on Deep Learning Architectures for Point Cloud Classification and Segmentation16 May 2026
- 2026Rollback-Free Stable Brick Structures Generation7 May 2026
- 2026Hierarchical Mesh Transformers with Topology-Guided Pretraining for Morphometric Analysis of Brain Structures6 Apr 2026
- 2026VoxelCodeBench: Benchmarking 3D World Modeling Through Code Generation2 Apr 2026
- 2026Semantic Segmentation of Textured Non-manifold 3D Meshes using Transformers2 Apr 2026
- 2026VG3S: Visual Geometry Grounded Gaussian Splatting for Semantic Occupancy Prediction6 Mar 2026
- 2026Content-Aware Frequency Encoding for Implicit Neural Representations with Fourier-Chebyshev Features1 Mar 2026
- 2026Optimization and Generation in Aerodynamics Inverse Design3 Feb 2026
- 2025CoRe3D: Collaborative Reasoning as a Foundation for 3D Intelligence14 Dec 2025
- 2025SUCCESS-GS: Survey of Compactness and Compression for Efficient Static and Dynamic Gaussian Splatting8 Dec 2025
- 2025Certified L2-Norm Robustness of 3D Point Cloud Recognition in the Frequency Domain10 Nov 2025
- 2025Faithful Contouring: Near-Lossless 3D Voxel Representation Free from Iso-surface6 Nov 2025
- 2025COS3D: Collaborative Open-Vocabulary 3D Segmentation23 Oct 2025
- 2025DAGLFNet: Deep Feature Attention Guided Global and Local Feature Fusion for Pseudo-Image Point Cloud Segmentation12 Oct 2025
- 2025VolSplat: Rethinking Feed-Forward 3D Gaussian Splatting with Voxel-Aligned Prediction23 Sep 2025
- 2025Octree Diffusion for Semantic Scene Generation and Completion20 Sep 2025
- 2025A Comprehensive Survey for Real-World Industrial Defect Detection: Challenges, Approaches, and Prospects15 Jul 2025
- 2025LEO-VL: Efficient Scene Representation for Scalable 3D Vision-Language Learning11 Jun 2025
- 2025NUC-Net: Non-uniform Cylindrical Partition Network for Efficient LiDAR Semantic Segmentation30 May 2025
- 2025Memory-Efficient Super-Resolution of 3D Micro-CT Images Using Octree-Based GANs: Enhancing Resolution and Segmentation Accuracy24 May 2025
- 2025CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generation7 May 2025
- 2025LaRI: Layered Ray Intersections for Single-view 3D Geometric Reasoning25 Apr 2025
- 2025Efficient Autoregressive Shape Generation via Octree-Based Adaptive Tokenization3 Apr 2025
- 2025Deep Unsupervised Segmentation of Log Point Clouds18 Mar 2025
- 2025Fourier Decomposition for Explicit Representation of 3D Point Cloud Attributes13 Mar 2025
- 2025PartSDF: Part-Based Implicit Neural Representation for Composite 3D Shape Parametrization and Optimization18 Feb 2025
- 2025Unsupervised deep learning for semantic segmentation of multispectral LiDAR forest point clouds10 Feb 2025
- 2025Multi-view Structural Convolution Network for Domain-Invariant Point Cloud Recognition of Autonomous Vehicles27 Jan 2025
- 2024Level-Set Parameters: Novel Representation for 3D Shape Analysis18 Dec 2024
- 2024An Enhanced Classification Method Based on Adaptive Multi-Scale Fusion for Long-tailed Multispectral Point Clouds16 Dec 2024
- 2024Constraint-Aware Feature Learning for Parametric Point Cloud12 Nov 2024
- 2024Deep Learning on 3D Semantic Segmentation: A Detailed Review4 Nov 2024
- 2024Att2CPC: Attention-Guided Lossy Attribute Compression of Point Clouds23 Oct 2024
- 2024Optimizing 3D Geometry Reconstruction from Implicit Neural Representations16 Oct 2024
- 2024Pic@Point: Cross-Modal Learning by Local and Global Point-Picture Correspondence12 Oct 2024
- 2024Improving Adversarial Robustness for 3D Point Cloud Recognition at Test-Time through Purified Self-Training23 Sep 2024
- 2024Current Symmetry Group Equivariant Convolution Frameworks for Representation Learning11 Sep 2024
- 2024Efficiently Expanding Receptive Fields: Local Split Attention and Parallel Aggregation for Enhanced Large-scale Point Cloud Semantic Segmentation3 Sep 2024
50 newest of 342 All 342 (JSON)
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Modelscited by 458
- 2024DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Modelscited by 98
- 2022Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Modelscited by 45
- 2023Diffusion Probabilistic Models for Scene-Scale 3D Categorical Datacited by 33
- 2024Motion2VecSets: 4D Latent Vector Set Diffusion for Non-rigid Shape Reconstruction and Trackingcited by 29
- 2023DiffCLIP: Leveraging Stable Diffusion for Language Grounded 3D Classificationcited by 23
- 2024DAM: Diffusion Activation Maximization for 3D Global Explanationscited by 1
- 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generationcited by 0
- 2026FILIGREE3D: Scaling Sparse Latent Flow Matching for Ultra-High-Resolution Image-to-3D Generation28 Sep 2026
- 2024DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models29 Feb 2024
- 2024DAM: Diffusion Activation Maximization for 3D Global Explanations26 Jan 2024
- 2024Motion2VecSets: 4D Latent Vector Set Diffusion for Non-rigid Shape Reconstruction and Tracking12 Jan 2024
- 2023DiffCLIP: Leveraging Stable Diffusion for Language Grounded 3D Classification25 May 2023
- 20233DShape2VecSet: A 3D Shape Representation for Neural Fields and Generative Diffusion Models26 Jan 2023
- 2023Diffusion Probabilistic Models for Scene-Scale 3D Categorical Data2 Jan 2023
- 2022Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Models3 Nov 2022
- 2021Plenoxels: Radiance Fields without Neural Networkscited by 1,613
- 2021PlenOctrees for Real-time Rendering of Neural Radiance Fieldscited by 905
- 2021Deep Marching Tetrahedra: a Hybrid Representation for High-Resolution 3D Shape Synthesiscited by 460
- 2021Advances in Neural Renderingcited by 365
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2022Language-Grounded Indoor 3D Semantic Segmentation in the Wildcited by 246
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Cloudscited by 211
- 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 200
- 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
- 2021Walk in the Cloud: Learning Curves for Point Clouds Shape Analysiscited by 172
- 2021Deep Parametric Continuous Convolutional Neural Networkscited by 161
12 most cited of 330 All 330 (JSON)
- 2026LoCoSplat: Real-Time Feed-Forward 3D Gaussian Splatting with Minimal 3D Reasoning3 Oct 2026
- 2026Octrees as an Explicit 3D Language1 Oct 2026
- 2026SILSA: Sliding-Window Slice Latents for Topology-Preserving High-Resolution 3D Generation1 Oct 2026
- 2026LatentReRig: An SDF-Based VAE with Dual Decoders for Latent-Space Deformation Conditioning21 Sep 2026
- 2026ZODIAC: Zero-shot Octree-based Diffusion for Anatomical Completion25 Aug 2026
- 2026PCT-Prompt: A Prompt-Guided Transformer Framework for Dense Prediction Tasks in Point Clouds17 Aug 2026
- 2026Efficient Human-Contact Representation for Human-Scene Interaction10 Aug 2026
- 2026PVCap: Towards Accurate 3D Dense Captioning via PseudoCap and VoxelCapNet7 Jul 2026
- 2026UnderOneFacade: Worldwide Facade Semantic Segmentation Benchmark Dataset2 Jul 2026
- 2026Deep Learning Approaches for 3D Medical Scene Completion: From Geometric Modeling to Generative Paradigms23 Jun 2026
- 2026A Cookbook of 3D Vision: Data, Learning Paradigms, and Application2 Jun 2026
- 2026A Survey on Deep Learning Architectures for Point Cloud Classification and Segmentation16 May 2026
12 newest of 330 All 330 (JSON)