DeltaConv: Anisotropic Operators for Geometric Deep Learning on Point Clouds
Not on the map. Why?
Abstract (arXiv)
Learning from 3D point-cloud data has rapidly gained momentum, motivated by the success of deep learning on images and the increased availability of 3D~data. In this paper, we aim to construct anisotropic convolution layers that work directly on the surface derived from a point cloud. This is challenging because of the lack of a global coordinate system for tangential directions on surfaces. We introduce DeltaConv, a convolution layer that combines geometric operators from vector calculus to enable the construction of anisotropic filters on point clouds. Because these operators are defined on scalar- and vector-fields, we separate the network into a scalar- and a vector-stream, which are connected by the operators. The vector stream enables the network to explicitly represent, evaluate, and process directional information. Our convolutions are robust and simple to implement and match or improve on state-of-the-art approaches on several benchmarks, while also speeding up training and inference.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 72 of its 112 references that are in the map. First posted on arXiv 16 Nov 2021.
Builds on
72 of 112 references.
References · 72
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,384
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,880
- 2019Fast Graph Representation Learning with PyTorch Geometriccited by 2,414
38 more
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,202
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,201
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2013Spectral Networks and Locally Connected Networks on Graphscited by 1,097
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2018PointCNN: Convolution On X-Transformed Pointscited by 764
- 20173D Semantic Segmentation with Submanifold Sparse Convolutional Networkscited by 746
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2018PointConv: Deep Convolutional Networks on 3D Point Cloudscited by 656
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
- 2019Deep Learning for 3D Point Clouds: A Surveycited by 557
- 2019Revisiting Point Cloud Classification: A New Benchmark Dataset and Classification Model on Real-World Datacited by 532
- 2018Hypergraph Neural Networkscited by 482
- 2018Spherical CNNscited by 452
- 2019Relation-Shape Convolutional Neural Network for Point Cloud Analysiscited by 346
- 2017Dynamic Edge-Conditioned Filters in Convolutional Neural Networks on Graphscited by 307
- 2021Vector Neurons: A General Framework for SO(3)-Equivariant Networkscited by 304
- 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 262
- 2018SpiderCNN: Deep Learning on Point Sets with Parameterized Convolutional Filterscited by 261
- 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 244
- 2021PAConv: Position Adaptive Convolution with Dynamic Kernel Assembling on Point Cloudscited by 211
- 2021Walk in the Cloud: Learning Curves for Point Clouds Shape Analysiscited by 172
- 2020DiffusionNet: Discretization Agnostic Learning on Surfacescited by 163
- 2017SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernelscited by 160
- 2018Point Convolutional Neural Networks by Extension Operatorscited by 154
- 2019Modeling Point Clouds with Self-Attention and Gumbel Subset Samplingcited by 151
- 2021Revisiting Point Cloud Shape Classification with a Simple and Effective Baselinecited by 145
- 2017Pointwise Convolutional Neural Networkscited by 126
- 2019DensePoint: Learning Densely Contextual Representation for Efficient Point Cloud Processingcited by 104
- 2016Learning shape correspondence with anisotropic convolutional neural networkscited by 95
- 2020Gauge Equivariant Mesh CNNs: Anisotropic convolutions on geometric graphscited by 90
- 2020A Closer Look at Local Aggregation Operators in Point Cloud Analysiscited by 87
- 2018Local Spectral Graph Convolution for Point Set Feature Learningcited by 84
- 2019Spherical CNNs on Unstructured Gridscited by 76
- 2021Coordinate Independent Convolutional Networks -- Isometry and Gauge Equivariant Convolutions on Riemannian Manifoldscited by 72
- 2020Learning Geometry-Disentangled Representation for Complementary Understanding of 3D Object Point Cloudcited by 71
- 2018RGCNN: Regularized Graph CNN for Point Cloud Segmentationcited by 70
50 most cited of 72 All 72 (JSON)
Built on by
Citing papers per year: 2023: 4; 2024: 2; 2025: 3; 2026: 1.
10 papers.
- 2023Understanding and Improving Features Learned in Deep Functional Mapscited by 20
- 2024A comprehensive overview of deep learning techniques for 3D point cloud classification and semantic segmentationcited by 14
- 2023Toward Mesh-Invariant 3D Generative Deep Learning with Geometric Measurescited by 6
- 2025PoissonNet: A Local-Global Approach for Learning on Surfacescited by 6
- 2023Basis restricted elastic shape analysis on the space of unregistered surfacescited by 5
- 2024Beyond Fixed Topologies: Unregistered Training and Comprehensive Evaluation Metrics for 3D Talking Headscited by 4
- 2025Learning Hemodynamic Scalar Fields on Coronary Artery Meshes: A Benchmark of Geometric Deep Learning Modelscited by 2
- 2025Neural Descriptors: Self-Supervised Learning of Robust Local Surface Descriptors Using Polynomial Patchescited by 2
- 2026Neural Particle Automata: Learning Self-Organizing Particle Dynamicscited by 2
- 20233D Understanding of Deformable Linear Objects: Datasets and Transferability Benchmarkcited by 1
- 2026Neural Particle Automata: Learning Self-Organizing Particle Dynamics22 Jan 2026
- 2025PoissonNet: A Local-Global Approach for Learning on Surfaces15 Oct 2025
- 2025Neural Descriptors: Self-Supervised Learning of Robust Local Surface Descriptors Using Polynomial Patches5 Mar 2025
- 2025Learning Hemodynamic Scalar Fields on Coronary Artery Meshes: A Benchmark of Geometric Deep Learning Models15 Jan 2025
- 2024Beyond Fixed Topologies: Unregistered Training and Comprehensive Evaluation Metrics for 3D Talking Heads14 Oct 2024
- 2024A comprehensive overview of deep learning techniques for 3D point cloud classification and semantic segmentation20 May 2024
- 2023Basis restricted elastic shape analysis on the space of unregistered surfaces7 Nov 2023
- 20233D Understanding of Deformable Linear Objects: Datasets and Transferability Benchmark13 Oct 2023
- 2023Toward Mesh-Invariant 3D Generative Deep Learning with Geometric Measures27 Jun 2023
- 2023Understanding and Improving Features Learned in Deep Functional Maps29 Mar 2023