PointCNN: Convolution On X-Transformed Points
Not on the map. Why?
Abstract (arXiv)
We present a simple and general framework for feature learning from point clouds. The key to the success of CNNs is the convolution operator that is capable of leveraging spatially-local correlation in data represented densely in grids (e.g. images). However, point clouds are irregular and unordered, thus directly convolving kernels against features associated with the points, will result in desertion of shape information and variance to point ordering. To address these problems, we propose to learn an X-transformation from the input points, to simultaneously promote two causes. The first is the weighting of the input features associated with the points, and the second is the permutation of the points into a latent and potentially canonical order. Element-wise product and sum operations of the typical convolution operator are subsequently applied on the X-transformed features. The proposed method is a generalization of typical CNNs to feature learning from point clouds, thus we call it PointCNN. Experiments show that PointCNN achieves on par or better performance than state-of-the-art methods on multiple challenging benchmark datasets and tasks.
Key facts. Cited by 764 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Jan 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 161; 2022: 184; 2023: 156; 2024: 123; 2025: 90; 2026: 50.
764 papers.
Sort:
By area:
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2021PointCLIP: Point Cloud Understanding by CLIPcited by 463
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
- 2022PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategiescited by 436
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 388
- 2022Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Frameworkcited by 379
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 305
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 289
38 more
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 264
- 2021PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detectioncited by 232
- 2021Self-Supervised Pretraining of 3D Features on any Point-Cloudcited by 217
- 2021PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Cloudscited by 211
- 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 200
- 2022CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understandingcited by 198
- 2021Spatio-temporal Self-Supervised Representation Learning for 3D Point Cloudscited by 180
- 2021Walk in the Cloud: Learning Curves for Point Clouds Shape Analysiscited by 172
- 2021The Values Encoded in Machine Learning Researchcited by 172
- 2021Frame Averaging for Invariant and Equivariant Network Designcited by 168
- 2022Stratified Transformer for 3D Point Cloud Segmentationcited by 167
- 2024PointMamba: A Simple State Space Model for Point Cloud Analysiscited by 167
- 2023Contrast with Reconstruct: Contrastive 3D Representation Learning Guided by Generative Pretrainingcited by 164
- 2022Masked Discrimination for Self-Supervised Learning on Point Cloudscited by 155
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2022Learning 3D Representations from 2D Pre-trained Models via Image-to-Point Masked Autoencoderscited by 144
- 2022GAPartNet: Cross-Category Domain-Generalizable Object Perception and Manipulation via Generalizable and Actionable Partscited by 139
- 2023Meta-Transformer: A Unified Framework for Multimodal Learningcited by 136
- 2021Mix3D: Out-of-Context Data Augmentation for 3D Scenescited by 126
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 122
- 2023PointGPT: Auto-regressively Generative Pre-training from Point Cloudscited by 115
- 2025Sonata: Self-Supervised Learning of Reliable Point Representationscited by 110
- 2021Beyond Self-attention: External Attention using Two Linear Layers for Visual Taskscited by 109
- 2023OctFormer: Octree-based Transformers for 3D Point Cloudscited by 109
- 20213D Object Detection for Autonomous Driving: A Surveycited by 106
- 2024SAMPart3D: Segment Any Part in 3D Objectscited by 97
- 2021Bidirectional Projection Network for Cross Dimension Scene Understandingcited by 95
- 2022Learning to Generate Realistic LiDAR Point Cloudscited by 93
- 2022POCO: Point Convolution for Surface Reconstructioncited by 92
- 2021Neural Scene Flow Priorcited by 91
- 2023SAI3D: Segment Any Instance in 3D Scenescited by 90
- 2021Generative Models as Distributions of Functionscited by 89
- 2021One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentationcited by 89
- 2023HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splattingcited by 89
- 2023Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Trainingcited by 86
- 2022Surface Representation for Point Cloudscited by 84
50 most cited of 764 All 764 (JSON)
- 2026Atomizer-IO: Beyond Pixels, Patches and Grids30 Sep 2026
- 2026Semantic Privacy Protection with Utility Preservation for 3D Point Clouds12 Sep 2026
- 2026MSSP: Multi-Scale Spatially-Constrained Partition for Unsupervised Semantic Segmentation of 3D Point Clouds7 Sep 2026
- 2026PCT-Prompt: A Prompt-Guided Transformer Framework for Dense Prediction Tasks in Point Clouds17 Aug 2026
- 2026Active Spiking Perception: The Membrane Potential as a Belief State for Anytime 3D Point Cloud Recognition4 Aug 2026
- 2026Toward High-Fidelity 3D Point-Cloud Learning for Brain Folding Morphology Prediction Using Trans-Unet23 Jul 2026
- 2026Point Ladder Tuning: Parameter-Efficient Hierarchical Adaptation for 3D Point Cloud Understanding21 Jul 2026
- 2026GaussFusion: Towards Multimodal 3D Gaussian Pretraining7 Jul 2026
- 2026UnderOneFacade: Worldwide Facade Semantic Segmentation Benchmark Dataset2 Jul 2026
- 2026Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentation24 Jun 2026
- 2026GVC-Seg: Training-Free 3D Instance Segmentation via Geometric Visual Correspondence6 Jun 2026
- 2026A Cross-view Fusion Framework for Robust 6-DoF Grasp Pose Estimation5 Jun 2026
38 more
- 2026PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understanding4 Jun 2026
- 2026Recent Advances and Trends in Learning-based 3D Representations3 Jun 2026
- 2026Towards Compact Autonomous Driving Perception with Balanced Learning and Multi-sensor Fusion2 Jun 2026
- 2026Learning Permutation-invariant Macroscopic Dynamics29 May 2026
- 2026Fitting Unknown Number of Hyperplanes with Manifold Optimization27 May 2026
- 2026Neuromorphic LiDAR-based Bird's Eye View Object Detection using Energy-efficient Spiking Neural Networks24 May 2026
- 2026GIBLy: Improving 3D Semantic Segmentation through an Architecture-Agnostic Lightweight Geometric Inductive Bias Layer22 May 2026
- 2026Resolving Long-Tail Ambiguity in Unsupervised 3D Point Cloud Segmentation with Language Priors20 May 2026
- 2026OPTNet: Ordering Point Transformer Network for Post-disaster 3D Semantic Segmentation16 May 2026
- 2026A Survey on Deep Learning Architectures for Point Cloud Classification and Segmentation16 May 2026
- 2026Hierarchical and Holistic Open-Vocabulary Functional 3D Scene Graphs for Indoor Spaces15 May 2026
- 2026Discretizing Group-Convolutional Neural Networks for 3D Geometry in Feature Space14 May 2026
- 2026RelFlexformer: Efficient Attention 3D-Transformers for Integrable Relative Positional Encodings11 May 2026
- 2026Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Models5 May 2026
- 2026Channel-Level Relation to Attentive Aggregation with Neighborhood-Homogeneity Constraint for Point Cloud Analysis4 May 2026
- 2026LOD-Net: Locality-Aware 3D Object Detection Using Multi-Scale Transformer Network17 Apr 2026
- 2026APC: Transferable and Efficient Adversarial Point Counterattack for Robust 3D Point Cloud Recognition17 Apr 2026
- 2026P3T: Prototypical Point-level Prompt Tuning with Enhanced Generalization for 3D Vision-Language Models17 Apr 2026
- 2026LIDARLearn: A Unified Deep Learning Library for 3D Point Cloud Classification, Segmentation, and Self-Supervised Representation Learning12 Apr 2026
- 2026Part-Level 3D Gaussian Vehicle Generation with Joint and Hinge Axis Estimation6 Apr 2026
- 2026Bridging the Dimensionality Gap: A Taxonomy and Survey of 2D Vision Model Adaptation for 3D Analysis3 Apr 2026
- 2026SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Prediction3 Apr 2026
- 2026LiDAR for Crowd Management: Applications, Benefits, and Future Directions29 Mar 2026
- 2026Spatially-Aware Evaluation Framework for Aerial LiDAR Point Cloud Semantic Segmentation: Distance-Based Metrics on Challenging Regions23 Mar 2026
- 2026Benchmarking Deep Learning Models for Aerial LiDAR Point Cloud Semantic Segmentation under Real Acquisition Conditions: A Case Study in Navarre23 Mar 2026
- 2026Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understanding21 Mar 2026
- 2026MonoArt: Progressive Structural Reasoning for Monocular Articulated 3D Reconstruction19 Mar 2026
- 2026Learning Coordinate-based Convolutional Kernels for Continuous SE(3) Equivariant and Efficient Point Cloud Analysis18 Mar 2026
- 2026Joint Optimization of Storage and Loading for High-Performance 3D Point Cloud Data Processing16 Mar 2026
- 2026InFusionLayer: a CFA-based ensemble tool to generate new classifiers for learning and modeling9 Mar 2026
- 2026SLNet: A Super-Lightweight Geometry-Adaptive Network for 3D Point Cloud Recognition8 Mar 2026
- 2026SCOPE: Scene-Contextualized Incremental Few-Shot 3D Segmentation6 Mar 2026
- 2026Efficient Point Cloud Processing with High-Dimensional Positional Encoding and Non-Local MLPs4 Mar 2026
- 2026NPNet: A Non-Parametric Network with Adaptive Gaussian-Fourier Positional Encoding for 3D Classification and Segmentation31 Jan 2026
- 2026Neural Particle Automata: Learning Self-Organizing Particle Dynamics22 Jan 2026
- 2026REVNET: Rotation-Equivariant Point Cloud Completion via Vector Neuron Anchor Transformer13 Jan 2026
- 2026G2P: Gaussian-to-Point Attribute Alignment for Boundary-Aware 3D Segmentation7 Jan 2026
- 2026Point-SRA: Self-Representation Alignment for 3D Representation Learning5 Jan 2026
50 newest of 764 All 764 (JSON)
- 2024PointMamba: A Simple State Space Model for Point Cloud Analysiscited by 167
- 2024Point Mamba: A Novel Point Cloud Backbone Based on State Space Model with Octree-Based Ordering Strategycited by 73
- 2024Point Cloud Mamba: Point Cloud Learning via State Space Modelcited by 66
- 2024Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Modelcited by 57
- 2024PoinTramba: A Hybrid Transformer-Mamba Framework for Point Cloud Analysiscited by 26
- 2024LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modelingcited by 12
- 2024MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretrainingcited by 12
- 2025Spectral Informed Mamba for Robust Point Cloud Processingcited by 10
- 2026Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Modelscited by 6
- 2024NIMBA: Towards Robust and Principled Processing of Point Clouds With SSMscited by 3
- 2025PointLAMA: Latent Attention meets Mamba for Efficient Point Cloud Pretrainingcited by 1
- 2025Minkowski-MambaNet: A Point Cloud Framework with Selective State Space Models for Forest Biomass Quantificationcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Mantis: Mamba-native Tuning is Efficient for 3D Point Cloud Foundation Models5 May 2026
- 2026Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understanding21 Mar 2026
- 2025Minkowski-MambaNet: A Point Cloud Framework with Selective State Space Models for Forest Biomass Quantification10 Oct 2025
- 2025PointLAMA: Latent Attention meets Mamba for Efficient Point Cloud Pretraining23 Jul 2025
- 2025Spectral Informed Mamba for Robust Point Cloud Processing6 Mar 2025
- 2024NIMBA: Towards Robust and Principled Processing of Point Clouds With SSMs31 Oct 2024
- 2024MAP: Unleashing Hybrid Mamba-Transformer Vision Backbone's Potential with Masked Autoregressive Pretraining1 Oct 2024
- 2024LCM: Locally Constrained Compact Point Cloud Model for Masked Point Modeling27 May 2024
- 2024PoinTramba: A Hybrid Transformer-Mamba Framework for Point Cloud Analysis24 May 2024
- 2024Mamba3D: Enhancing Local Features for 3D Point Cloud Analysis via State Space Model23 Apr 2024
- 2024Point Mamba: A Novel Point Cloud Backbone Based on State Space Model with Octree-Based Ordering Strategy11 Mar 2024
- 2024Point Cloud Mamba: Point Cloud Learning via State Space Model1 Mar 2024
12 newest of 13 All 13 (JSON)
- 2021PointCLIP: Point Cloud Understanding by CLIPcited by 463
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applicationscited by 84
- 2023CLIP goes 3D: Leveraging Prompt Tuning for Language Grounded 3D Recognitioncited by 77
- 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretrainingcited by 52
- 2023Joint Representation Learning for Text and 3D Point Cloudcited by 14
- 2023Geometrically-driven Aggregation for Zero-shot 3D Point Cloud Understandingcited by 13
- 2025LEO-VL: Efficient Scene Representation for Scalable 3D Vision-Language Learningcited by 5
- 2026PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understandingcited by 1
- 2025MR-COSMO: Visual-Text Memory Recall and Direct CrOSs-MOdal Alignment Method for Query-Driven 3D Segmentationcited by 0
- 2026P3T: Prototypical Point-level Prompt Tuning with Enhanced Generalization for 3D Vision-Language Modelscited by 0
- 2026PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understanding4 Jun 2026
- 2026P3T: Prototypical Point-level Prompt Tuning with Enhanced Generalization for 3D Vision-Language Models17 Apr 2026
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct 2025
- 2025MR-COSMO: Visual-Text Memory Recall and Direct CrOSs-MOdal Alignment Method for Query-Driven 3D Segmentation26 Jun 2025
- 2025LEO-VL: Efficient Scene Representation for Scalable 3D Vision-Language Learning11 Jun 2025
- 2025SceneSplat: Gaussian Splatting-based Scene Understanding with Vision-Language Pretraining23 Mar 2025
- 2023Geometrically-driven Aggregation for Zero-shot 3D Point Cloud Understanding4 Dec 2023
- 2023CLIP goes 3D: Leveraging Prompt Tuning for Language Grounded 3D Recognition20 Mar 2023
- 2023Joint Representation Learning for Text and 3D Point Cloud18 Jan 2023
- 2021PointCLIP: Point Cloud Understanding by CLIP4 Dec 2021
- 2023Point Cloud Pre-training with Diffusion Modelscited by 47
- 2024Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Modelscited by 12
- 2025PointDico: Contrastive 3D Representation Learning Guided by Diffusion Modelscited by 11
- 2024Test-Time Adaptation of 3D Point Clouds via Denoising Diffusion Modelscited by 7
- 2025Harnessing Text-to-Image Diffusion Models for Point Cloud Self-Supervised Learningcited by 3
- 2025HierOctFusion: Multi-scale Octree-based 3D Shape Generation via Part-Whole-Hierarchy Message Passingcited by 3
- 2025DiffVL: Diffusion-Based Visual Localization on 2D Maps via BEV-Conditioned GPS Denoisingcited by 2
- 2025PointDico: Contrastive 3D Representation Learning Guided by Diffusion Models9 Dec 2025
- 2025DiffVL: Diffusion-Based Visual Localization on 2D Maps via BEV-Conditioned GPS Denoising18 Sep 2025
- 2025HierOctFusion: Multi-scale Octree-based 3D Shape Generation via Part-Whole-Hierarchy Message Passing14 Aug 2025
- 2025Harnessing Text-to-Image Diffusion Models for Point Cloud Self-Supervised Learning12 Jul 2025
- 2024Test-Time Adaptation of 3D Point Clouds via Denoising Diffusion Models21 Nov 2024
- 2024Open-Vocabulary 3D Semantic Segmentation with Text-to-Image Diffusion Models18 Jul 2024
- 2023Point Cloud Pre-training with Diffusion Models25 Nov 2023
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?cited by 122
- 2022Distillation with Contrast is All You Need for Self-Supervised Point Cloud Representation Learningcited by 19
- 20223D Point Cloud Pre-training with Knowledge Distillation from 2D Imagescited by 7
- 2024GeoMask3D: Geometrically Informed Mask Selection for Self-Supervised Point Cloud Learning in 3Dcited by 3
- 2024PMT-MAE: Dual-Branch Self-Supervised Learning with Distillation for Efficient Point Cloud Classificationcited by 0
- 2024Efficient Point Cloud Classification via Offline Distillation Framework and Negative-Weight Self-Distillation Techniquecited by 0
- 2026Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentationcited by 0
- 2026Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentation24 Jun 2026
- 2024Efficient Point Cloud Classification via Offline Distillation Framework and Negative-Weight Self-Distillation Technique3 Sep 2024
- 2024PMT-MAE: Dual-Branch Self-Supervised Learning with Distillation for Efficient Point Cloud Classification3 Sep 2024
- 2024GeoMask3D: Geometrically Informed Mask Selection for Self-Supervised Point Cloud Learning in 3D20 May 2024
- 20223D Point Cloud Pre-training with Knowledge Distillation from 2D Images17 Dec 2022
- 2022Autoencoders as Cross-Modal Teachers: Can Pretrained 2D Image Transformers Help 3D Representation Learning?16 Dec 2022
- 2022Distillation with Contrast is All You Need for Self-Supervised Point Cloud Representation Learning9 Feb 2022
- 2022Automatic Relation-aware Graph Network Proliferationcited by 6
- 2022Automatic Relation-aware Graph Network Proliferation31 May 2022
- 2021Point-BERT: Pre-training 3D Point Cloud Transformers with Masked Point Modelingcited by 653
- 2023Point Transformer V3: Simpler, Faster, Strongercited by 589
- 20213D Shape Generation and Completion through Point-Voxel Diffusioncited by 516
- 2022Masked Autoencoders for Point Cloud Self-supervised Learningcited by 459
- 2022Point Transformer V2: Grouped Vector Attention and Partition-based Poolingcited by 388
- 2022Rethinking Network Design and Local Geometry in Point Cloud: A Simple Residual MLP Frameworkcited by 379
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 305
- 2023Geometry-Informed Neural Operator for Large-Scale 3D PDEscited by 303
- 2023OpenMask3D: Open-Vocabulary 3D Instance Segmentationcited by 289
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 267
- 2022Point-M2AE: Multi-scale Masked Autoencoders for Hierarchical Point Cloud Pre-trainingcited by 264
12 most cited of 724 All 724 (JSON)
- 2026Atomizer-IO: Beyond Pixels, Patches and Grids30 Sep 2026
- 2026Semantic Privacy Protection with Utility Preservation for 3D Point Clouds12 Sep 2026
- 2026MSSP: Multi-Scale Spatially-Constrained Partition for Unsupervised Semantic Segmentation of 3D Point Clouds7 Sep 2026
- 2026PCT-Prompt: A Prompt-Guided Transformer Framework for Dense Prediction Tasks in Point Clouds17 Aug 2026
- 2026Active Spiking Perception: The Membrane Potential as a Belief State for Anytime 3D Point Cloud Recognition4 Aug 2026
- 2026Toward High-Fidelity 3D Point-Cloud Learning for Brain Folding Morphology Prediction Using Trans-Unet23 Jul 2026
- 2026Point Ladder Tuning: Parameter-Efficient Hierarchical Adaptation for 3D Point Cloud Understanding21 Jul 2026
- 2026GaussFusion: Towards Multimodal 3D Gaussian Pretraining7 Jul 2026
- 2026UnderOneFacade: Worldwide Facade Semantic Segmentation Benchmark Dataset2 Jul 2026
- 2026GVC-Seg: Training-Free 3D Instance Segmentation via Geometric Visual Correspondence6 Jun 2026
- 2026A Cross-view Fusion Framework for Robust 6-DoF Grasp Pose Estimation5 Jun 2026
- 2026Recent Advances and Trends in Learning-based 3D Representations3 Jun 2026
12 newest of 724 All 724 (JSON)