Neural Point-Forms
Not on the map. Why?
Abstract (arXiv)
Point cloud learning often rests on the premise that observed samples are noisy traces of an underlying geometric object, such as a manifold embedded in a high-dimensional feature space. Yet much of this geometry is not captured directly by coordinates, pairwise distances, or learned graph neighborhoods alone. In the smooth setting, differential forms are devices to encode higher order tangency information. In this work, we introduce a new family of principled learnable geometric features for point clouds called neural point-forms (NPFs). In the absence of a natural tangency structure, we instead use Laplacian-based techniques from Diffusion Geometry to build a discrete model for comparing differential forms on point clouds via inner products. In the continuum, submanifolds of a shared ambient feature space are represented as comparison matrices, whose entries describe how pairs of feature forms interact with extrinsic tangency information. We make this intuition precise by proving the long-run consistency of comparison matrices under standard sampling, bandwidth, density, and manifold-hypothesis assumptions. This yields a compact, efficient and permutation-invariant neural layer whose output is a learned form-comparison matrix. Across synthetic and biologically relevant experiments, we show that NPFs provide a competitive, and interpretable representation, with the strongest benefits appearing when labels depend on sampling density, manifold-like structure, or response-relevant population geometry.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 41 of its 78 references that are in the map. First posted on arXiv 15 May 2026.
Builds on
41 of 78 references.
References · 41
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2017Graph Attention Networkscited by 8,923
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,223
- 2018World Modelscited by 1,513
29 more
- 2020Point Transformercited by 1,470
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
- 2019KPConv: Flexible and Deformable Convolution for Point Cloudscited by 1,205
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,167
- 2018Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learningcited by 1,102
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
- 2020A Generalization of Transformer Networks to Graphscited by 661
- 2020On the Bottleneck of Graph Neural Networks and its Practical Implicationscited by 631
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
- 2018Hypergraph Neural Networkscited by 488
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 478
- 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 474
- 2020A Note on Over-Smoothing for Graph Neural Networkscited by 249
- 2023A Survey on Oversmoothing in Graph Neural Networkscited by 247
- 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 221
- 2020Generalization and Representational Limits of Graph Neural Networkscited by 218
- 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
- 2023On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topologycited by 166
- 2020Simplicial Neural Networkscited by 110
- 2022Topological Deep Learning: Going Beyond Graph Datacited by 97
- 2021Principled Simplicial Neural Networks for Trajectory Predictioncited by 77
- 2024Position: Topological Deep Learning is the New Frontier for Relational Learningcited by 66
- 2023Simplicial Representation Learning with Neural k-Formscited by 18
- 2024TopoTune : A Framework for Generalized Combinatorial Complex Neural Networkscited by 18
- 2025Carr'e du champ flow matching: better quality-generalisation tradeoff in generative modelscited by 14
- 2026Computing Diffusion Geometrycited by 7
- 2025HiPoNet: A Multi-View Simplicial Complex Network for High Dimensional Point-Cloud and Single-Cell Datacited by 2
- 2025On the Sheafification of Higher-Order Message Passingcited by 1
Built on by
Not cited yet.