Volumetric and Multi-View CNNs for Object Classification on 3D Data
Not on the map. Why?
Abstract (arXiv)
3D shape models are becoming widely available and easier to capture, making available 3D information crucial for progress in object classification. Current state-of-the-art methods rely on CNNs to address this problem. Recently, we witness two types of CNNs being developed: CNNs based upon volumetric representations versus CNNs based upon multi-view representations. Empirical results from these two types of CNNs exhibit a large gap, indicating that existing volumetric CNN architectures and approaches are unable to fully exploit the power of 3D representations. In this paper, we aim to improve both volumetric CNNs and multi-view CNNs according to extensive analysis of existing approaches. To this end, we introduce two distinct network architectures of volumetric CNNs. In addition, we examine multi-view CNNs, where we introduce multi-resolution filtering in 3D. Overall, we are able to outperform current state-of-the-art methods for both volumetric CNNs and multi-view CNNs. We provide extensive experiments designed to evaluate underlying design choices, thus providing a better understanding of the space of methods available for object classification on 3D data.
Key facts. Cited by 240 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Apr 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 90; 2022: 52; 2023: 46; 2024: 34; 2025: 13; 2026: 5.
240 papers.
Sort:
By area:
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2023A Survey on Multimodal Large Language Models for Autonomous Drivingcited by 288
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
- 2021Walk in the Cloud: Learning Curves for Point Clouds Shape Analysiscited by 172
- 2021(AF)2-S3Net: Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Networkcited by 164
- 2021Deep Parametric Continuous Convolutional Neural Networkscited by 161
38 more
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
- 2021Using Shape to Categorize: Low-Shot Learning with an Explicit Shape Biascited by 115
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 110
- 2023OctFormer: Octree-based Transformers for 3D Point Cloudscited by 105
- 2021NeuTex: Neural Texture Mapping for Volumetric Neural Renderingcited by 98
- 2021Bidirectional Projection Network for Cross Dimension Scene Understandingcited by 95
- 2022Compressible-composable NeRF via Rank-residual Decompositioncited by 92
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 91
- 2022Surface Representation for Point Cloudscited by 84
- 2021Equivariant Point Network for 3D Point Cloud Analysiscited by 81
- 2023StyleRF: Zero-shot 3D Style Transfer of Neural Radiance Fieldscited by 79
- 2025RayZer: A Self-supervised Large View Synthesis Modelcited by 74
- 2022TorchSparse: Efficient Point Cloud Inference Enginecited by 72
- 2023FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformercited by 72
- 2022Dual Octree Graph Networks for Learning Adaptive Volumetric Shape Representationscited by 71
- 2024Point Mamba: A Novel Point Cloud Backbone Based on State Space Model with Octree-Based Ordering Strategycited by 71
- 2022Benchmarking and Analyzing Point Cloud Classification under Corruptionscited by 70
- 2023Learning Neural Volumetric Representations of Dynamic Humans in Minutescited by 70
- 2023Deep Learning on Implicit Neural Representations of Shapescited by 62
- 2021Adaptive Graph Convolution for Point Cloud Analysiscited by 60
- 2021PRA-Net: Point Relation-Aware Network for 3D Point Cloud Analysiscited by 58
- 2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56
- 2022Contrastive Boundary Learning for Point Cloud Segmentationcited by 56
- 2021Generative Zero-Shot Learning for Semantic Segmentation of 3D Point Cloudscited by 55
- 2021SSPC-Net: Semi-supervised Semantic 3D Point Cloud Segmentation Networkcited by 54
- 20213D Siamese Voxel-to-BEV Tracker for Sparse Point Cloudscited by 54
- 2021A Review of Location Encoding for GeoAI: Methods and Applicationscited by 53
- 2021Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysiscited by 47
- 20213D-SiamRPN: An End-to-End Learning Method for Real-Time 3D Single Object Tracking Using Raw Point Cloudcited by 45
- 2021PatchFormer: An Efficient Point Transformer with Patch Attentioncited by 43
- 2021PVT: Point-Voxel Transformer for Point Cloud Learningcited by 42
- 2021Joint Learning of 3D Shape Retrieval and Deformationcited by 41
- 2023Self-positioning Point-based Transformer for Point Cloud Understandingcited by 40
- 2021Point Cloud Augmentation with Weighted Local Transformationscited by 39
- 2023PartSLIP++: Enhancing Low-Shot 3D Part Segmentation via Multi-View Instance Segmentation and Maximum Likelihood Estimationcited by 37
- 2021MVT: Multi-view Vision Transformer for 3D Object Recognitioncited by 34
- 2024WE-GS: An In-the-wild Efficient 3D Gaussian Representation for Unconstrained Photo Collectionscited by 33
50 most cited of 240 All 240 (JSON)
- 2026Temporal Residual Neural Radiance Fields for Monocular Video Dynamic Human Body Reconstruction4 Sep 2026
- 2026Discretizing Group-Convolutional Neural Networks for 3D Geometry in Feature Space14 May 2026
- 2026Random Walk on Point Clouds for Feature Detection22 Apr 2026
- 2026Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understanding21 Mar 2026
- 2026GATS: Gaussian Aware Temporal Scaling Transformer for Invariant 4D Spatio-Temporal Point Cloud Representation17 Mar 2026
- 2025A Compact Hybrid Convolution--Frequency State Space Network for Learned Image Compression25 Nov 2025
- 2025MFM-point: Multi-scale Flow Matching for Point Cloud Generation25 Nov 2025
- 2025LiSTAR: Ray-Centric World Models for 4D LiDAR Sequences in Autonomous Driving20 Nov 2025
- 2025PointCubeNet: 3D Part-level Reasoning with 3x3x3 Point Cloud Blocks10 Nov 2025
- 2025Learning Neural Exposure Fields for View Synthesis9 Oct 2025
- 2025PUMPS: Skeleton-Agnostic Point-based Universal Motion Pre-Training for Synthesis in Human Motion Tasks27 Jul 2025
- 2025Taking Language Embedded 3D Gaussian Splatting into the Wild26 Jul 2025
38 more
- 2025ToothForge: Automatic Dental Shape Generation using Synchronized Spectral Embeddings3 Jun 2025
- 2025Towards Explicit Geometry-Reflectance Collaboration for Generalized LiDAR Segmentation in Adverse Weather3 Jun 2025
- 2025Self-supervised Latent Space Optimization with Nebula Variational Coding2 Jun 2025
- 2025RayZer: A Self-supervised Large View Synthesis Model1 May 2025
- 2025Content-Distortion High-Order Interaction for Blind Image Quality Assessment7 Apr 2025
- 2025Random Walks in Self-supervised Learning for Triangular Meshes2 Mar 2025
- 2024Look Inside for More: Internal Spatial Modality Perception for 3D Anomaly Detection18 Dec 2024
- 2024M3D: Dual-Stream Selective State Spaces and Depth-Driven Framework for High-Fidelity Single-View 3D Reconstruction19 Nov 2024
- 2024Hierarchical mutual distillation for multi-view fusion: Learning from all possible view combinations15 Nov 2024
- 2024Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodings12 Nov 2024
- 2024Random Token Fusion for Multi-View Medical Diagnosis21 Oct 2024
- 2024Foundation Model-Powered 3D Few-Shot Class Incremental Learning via Training-free Adaptor11 Oct 2024
- 2024Lidar Panoptic Segmentation in an Open World22 Sep 2024
- 2024SRIF: Semantic Shape Registration Empowered by Diffusion-based Image Morphing and Flow Estimation18 Sep 2024
- 2024VSFormer: Mining Correlations in Flexible View Set for Multi-view 3D Shape Understanding14 Sep 2024
- 2024RISurConv: Rotation Invariant Surface Attention-Augmented Convolutions for 3D Point Cloud Classification and Segmentation12 Aug 2024
- 2024Sampling Foundational Transformer: A Theoretical Perspective11 Aug 2024
- 2024Differentiable Convex Polyhedra Optimization from Multi-view Images22 Jul 2024
- 2024Global Attention-Guided Dual-Domain Point Cloud Feature Learning for Classification and Segmentation12 Jul 2024
- 2024Freeview Sketching: View-Aware Fine-Grained Sketch-Based Image Retrieval1 Jul 2024
- 2024Self-supervised Graph Neural Network for Mechanical CAD Retrieval13 Jun 2024
- 2024Stable-Pose: Leveraging Transformers for Pose-Guided Text-to-Image Generation4 Jun 2024
- 2024WE-GS: An In-the-wild Efficient 3D Gaussian Representation for Unconstrained Photo Collections4 Jun 2024
- 2024A Survey on Vision-Language-Action Models for Embodied AI23 May 2024
- 2024Point Resampling and Ray Transformation Aid to Editable NeRF Models12 May 2024
- 2024PRENet: A Plane-Fit Redundancy Encoding Point Cloud Sequence Network for Real-Time 3D Action Recognition11 May 2024
- 2024Multimodal Sense-Informed Prediction of 3D Human Motions5 May 2024
- 2024Evaluating Deep Clustering Algorithms on Non-Categorical 3D CAD Models29 Apr 2024
- 2024A Hybrid Generative and Discriminative PointNet on Unordered Point Sets19 Apr 2024
- 2024UniMix: Towards Domain Adaptive and Generalizable LiDAR Semantic Segmentation in Adverse Weather8 Apr 2024
- 2024TexVocab: Texture Vocabulary-conditioned Human Avatars31 Mar 2024
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPS20 Mar 2024
- 2024Local-consistent Transformation Learning for Rotation-invariant Point Cloud Analysis17 Mar 2024
- 2024TrIND: Representing Anatomical Trees by Denoising Diffusion of Implicit Neural Fields13 Mar 2024
- 2024Memory-based Adapters for Online 3D Scene Perception11 Mar 2024
- 2024Point Mamba: A Novel Point Cloud Backbone Based on State Space Model with Octree-Based Ordering Strategy11 Mar 2024
- 2024MM-Point: Multi-View Information-Enhanced Multi-Modal Self-Supervised 3D Point Cloud Understanding15 Feb 2024
- 2024Large-Language-Model Empowered Dose Volume Histogram Prediction for Intensity Modulated Radiotherapy11 Feb 2024
50 newest of 240 All 240 (JSON)
- 2024Stable-Pose: Leveraging Transformers for Pose-Guided Text-to-Image Generationcited by 12
- 2024SRIF: Semantic Shape Registration Empowered by Diffusion-based Image Morphing and Flow Estimationcited by 12
- 2024Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodingscited by 10
- 2024TrIND: Representing Anatomical Trees by Denoising Diffusion of Implicit Neural Fieldscited by 4
- 2025MFM-point: Multi-scale Flow Matching for Point Cloud Generationcited by 3
- 2025MFM-point: Multi-scale Flow Matching for Point Cloud Generation25 Nov 2025
- 2024Wavelet Latent Diffusion (Wala): Billion-Parameter 3D Generative Model with Compact Wavelet Encodings12 Nov 2024
- 2024SRIF: Semantic Shape Registration Empowered by Diffusion-based Image Morphing and Flow Estimation18 Sep 2024
- 2024Stable-Pose: Leveraging Transformers for Pose-Guided Text-to-Image Generation4 Jun 2024
- 2024TrIND: Representing Anatomical Trees by Denoising Diffusion of Implicit Neural Fields13 Mar 2024
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2024A Survey on Vision-Language-Action Models for Embodied AI23 May 2024
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2022Point-NeRF: Point-based Neural Radiance Fieldscited by 503
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021Group-Free 3D Object Detection via Transformerscited by 215
- 2021RPVNet: A Deep and Efficient Range-Point-Voxel Fusion Network for LiDAR Point Cloud Segmentationcited by 173
- 2021Walk in the Cloud: Learning Curves for Point Clouds Shape Analysiscited by 172
- 2021(AF)2-S3Net: Attentive Feature Fusion with Adaptive Feature Selection for Sparse Semantic Segmentation Networkcited by 164
- 2021Deep Parametric Continuous Convolutional Neural Networkscited by 161
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2022Neural 3D Scene Reconstruction with the Manhattan-world Assumptioncited by 123
12 most cited of 229 All 229 (JSON)
- 2026Temporal Residual Neural Radiance Fields for Monocular Video Dynamic Human Body Reconstruction4 Sep 2026
- 2026Discretizing Group-Convolutional Neural Networks for 3D Geometry in Feature Space14 May 2026
- 2026Random Walk on Point Clouds for Feature Detection22 Apr 2026
- 2026GATS: Gaussian Aware Temporal Scaling Transformer for Invariant 4D Spatio-Temporal Point Cloud Representation17 Mar 2026
- 2025A Compact Hybrid Convolution--Frequency State Space Network for Learned Image Compression25 Nov 2025
- 2025PointCubeNet: 3D Part-level Reasoning with 3x3x3 Point Cloud Blocks10 Nov 2025
- 2025Learning Neural Exposure Fields for View Synthesis9 Oct 2025
- 2025PUMPS: Skeleton-Agnostic Point-based Universal Motion Pre-Training for Synthesis in Human Motion Tasks27 Jul 2025
- 2025Taking Language Embedded 3D Gaussian Splatting into the Wild26 Jul 2025
- 2025ToothForge: Automatic Dental Shape Generation using Synchronized Spectral Embeddings3 Jun 2025
- 2025Towards Explicit Geometry-Reflectance Collaboration for Generalized LiDAR Segmentation in Adverse Weather3 Jun 2025
- 2025Self-supervised Latent Space Optimization with Nebula Variational Coding2 Jun 2025
12 newest of 229 All 229 (JSON)