Tangent Bundle Convolutional Learning: from Manifolds to Cellular Sheaves and Back
Not on the map. Why?
Abstract (arXiv)
In this work we introduce a convolution operation over the tangent bundle of Riemann manifolds in terms of exponentials of the Connection Laplacian operator. We define tangent bundle filters and tangent bundle neural networks (TNNs) based on this convolution operation, which are novel continuous architectures operating on tangent bundle signals, i.e. vector fields over the manifolds. Tangent bundle filters admit a spectral representation that generalizes the ones of scalar manifold filters, graph filters and standard convolutional filters in continuous time. We then introduce a discretization procedure, both in the space and time domains, to make TNNs implementable, showing that their discrete counterpart is a novel principled variant of the very recently introduced sheaf neural networks. We formally prove that this discretized architecture converges to the underlying continuous TNN. Finally, we numerically evaluate the effectiveness of the proposed architecture on various learning tasks, both on synthetic and real data.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 32 of its 68 references that are in the map. First posted on arXiv 20 Mar 2023.
Builds on
32 of 68 references.
References · 32
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,223
- 2018How Powerful are Graph Neural Networks?cited by 4,355
- 2018Relational inductive biases, deep learning, and graph networkscited by 1,341
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,042
- 2021Understanding over-squashing and bottlenecks on graphs via curvaturecited by 471
- 2018A General Theory of Equivariant CNNs on Homogeneous Spacescited by 223
- 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 219
- 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 208
- 2023On Over-Squashing in Message Passing Neural Networks: The Impact of Width, Depth, and Topologycited by 163
- 2020Graphon Neural Networks and the Transferability of Graph Neural Networkscited by 117
20 more
- 2018Convolutional Neural Network Architectures for Signals Supported on Graphscited by 94
- 2019Topological Signal Processing over Simplicial Complexescited by 94
- 2019Transferability of Spectral Graph Convolutional Neural Networkscited by 90
- 2020Gauge Equivariant Mesh CNNs: Anisotropic convolutions on geometric graphscited by 90
- 2020Sheaf Neural Networkscited by 80
- 2020Graphs, Convolutions, and Neural Networks: From Graph Filters to Graph Neural Networkscited by 73
- 2022Sheaf Neural Networks with Connection Laplacianscited by 64
- 2020EdgeNets:Edge Varying Graph Neural Networkscited by 36
- 2022Cell Attention Networkscited by 34
- 2018The Vector Heat Methodcited by 31
- 2021Learning Decentralized Wireless Resource Allocations with Graph Neural Networkscited by 24
- 2020Algebraic Neural Networks: Stability to Deformationscited by 22
- 2022Simplicial Attention Neural Networkscited by 21
- 2013Spectral Convergence of the connection Laplacian from random samplescited by 19
- 2022Convolutional Neural Networks on Manifolds: From Graphs and Backcited by 13
- 2022Tangent Bundle Filters and Neural Networks: from Manifolds to Cellular Sheaves and Backcited by 9
- 2021Stability of Neural Networks on Riemannian Manifoldscited by 7
- 2018Parallel Transport Convolution: A New Tool for Convolutional Neural Networks on Manifoldscited by 6
- 2022Diffusion of Information on Networked Lattices by Gossipcited by 4
- 2020Multidimensional Persistence Module Classification via Lattice-Theoretic Convolutionscited by 1
Built on by
Citing papers per year: 2023: 2; 2024: 5; 2025: 7; 2026: 7.
21 papers.
Sort:
By area:
- 2024Position: Topological Deep Learning is the New Frontier for Relational Learningcited by 65
- 2024E(n) Equivariant Topological Neural Networkscited by 22
- 2023From Latent Graph to Latent Topology Inference: Differentiable Cell Complex Modulecited by 19
- 2024Bundle Neural Networks for message diffusion on graphscited by 13
- 2024Attending to Topological Spaces: The Cellular Transformercited by 11
- 2025Copresheaf Topological Neural Networks: A Generalized Deep Learning Frameworkcited by 11
- 2025Cooperative Sheaf Neural Networkscited by 10
- 2023Implicit Gaussian process representation of vector fields over arbitrary latent manifoldscited by 6
- 2024Higher-Order Topological Directionality and Directed Simplicial Neural Networkscited by 5
- 2025Learning the Structure of Connection Graphscited by 3
- 2025VDW-GNNs: Vector diffusion wavelets for geometric graph neural networkscited by 1
- 2025Topological Neural Networks over the Aircited by 0
9 more
- 2025Directed Semi-Simplicial Learning with Applications to Brain Activity Decodingcited by 0
- 2025CoVariance Filters and Neural Networks over Hilbert Spacescited by 0
- 2026Topology of Reasoning: Retrieved Cell Complex-Augmented Generation for Textual Graph Question Answeringcited by 0
- 2026Multi-Agent System Identification with Nonlinear Sheaf Diffusioncited by 0
- 2026Topological Signal Processing: An Application-Oriented Tutorialcited by 0
- 2026Learned, Relied Upon, or Necessary? Separating Checkpoint Dependence from Task-Level Value in Sheaf GNNscited by 0
- 2026Sheaf-theoretic Signal Processing on Graphs: Spectral Theory, Filtering, and Samplingcited by 0
- 2026Equivariant Cellular Sheaves for Molecular Electronic Structure: Bridging Sheaf Cohomology and E(3)-Equivariant Hamiltonian Learningcited by 0
- 2026Equivariant Sheaf Neural Networks: Learning Geometric Transport on Graphscited by 0
- 2026Equivariant Sheaf Neural Networks: Learning Geometric Transport on Graphs28 Aug 2026
- 2026Sheaf-theoretic Signal Processing on Graphs: Spectral Theory, Filtering, and Sampling2 Aug 2026
- 2026Learned, Relied Upon, or Necessary? Separating Checkpoint Dependence from Task-Level Value in Sheaf GNNs28 Jul 2026
- 2026Equivariant Cellular Sheaves for Molecular Electronic Structure: Bridging Sheaf Cohomology and E(3)-Equivariant Hamiltonian Learning14 Jun 2026
- 2026Topological Signal Processing: An Application-Oriented Tutorial18 May 2026
- 2026Multi-Agent System Identification with Nonlinear Sheaf Diffusion11 May 2026
- 2026Topology of Reasoning: Retrieved Cell Complex-Augmented Generation for Textual Graph Question Answering22 Feb 2026
- 2025Learning the Structure of Connection Graphs13 Oct 2025
- 2025VDW-GNNs: Vector diffusion wavelets for geometric graph neural networks1 Oct 2025
- 2025CoVariance Filters and Neural Networks over Hilbert Spaces16 Sep 2025
- 2025Cooperative Sheaf Neural Networks1 Jul 2025
- 2025Copresheaf Topological Neural Networks: A Generalized Deep Learning Framework27 May 2025
9 more
- 2025Directed Semi-Simplicial Learning with Applications to Brain Activity Decoding23 May 2025
- 2025Topological Neural Networks over the Air14 Feb 2025
- 2024Higher-Order Topological Directionality and Directed Simplicial Neural Networks12 Sep 2024
- 2024Bundle Neural Networks for message diffusion on graphs24 May 2024
- 2024E(n) Equivariant Topological Neural Networks24 May 2024
- 2024Attending to Topological Spaces: The Cellular Transformer23 May 2024
- 2024Position: Topological Deep Learning is the New Frontier for Relational Learning14 Feb 2024
- 2023Implicit Gaussian process representation of vector fields over arbitrary latent manifolds28 Sep 2023
- 2023From Latent Graph to Latent Topology Inference: Differentiable Cell Complex Module25 May 2023
- 2024Position: Topological Deep Learning is the New Frontier for Relational Learningcited by 65
- 2024E(n) Equivariant Topological Neural Networkscited by 22
- 2023From Latent Graph to Latent Topology Inference: Differentiable Cell Complex Modulecited by 19
- 2024Bundle Neural Networks for message diffusion on graphscited by 13
- 2024Attending to Topological Spaces: The Cellular Transformercited by 11
- 2025Copresheaf Topological Neural Networks: A Generalized Deep Learning Frameworkcited by 11
- 2025Cooperative Sheaf Neural Networkscited by 10
- 2023Implicit Gaussian process representation of vector fields over arbitrary latent manifoldscited by 6
- 2024Higher-Order Topological Directionality and Directed Simplicial Neural Networkscited by 5
- 2025Learning the Structure of Connection Graphscited by 3
- 2025VDW-GNNs: Vector diffusion wavelets for geometric graph neural networkscited by 1
- 2025Topological Neural Networks over the Aircited by 0
12 most cited of 20 All 20 (JSON)
- 2026Equivariant Sheaf Neural Networks: Learning Geometric Transport on Graphs28 Aug 2026
- 2026Sheaf-theoretic Signal Processing on Graphs: Spectral Theory, Filtering, and Sampling2 Aug 2026
- 2026Learned, Relied Upon, or Necessary? Separating Checkpoint Dependence from Task-Level Value in Sheaf GNNs28 Jul 2026
- 2026Equivariant Cellular Sheaves for Molecular Electronic Structure: Bridging Sheaf Cohomology and E(3)-Equivariant Hamiltonian Learning14 Jun 2026
- 2026Topological Signal Processing: An Application-Oriented Tutorial18 May 2026
- 2026Multi-Agent System Identification with Nonlinear Sheaf Diffusion11 May 2026
- 2025Learning the Structure of Connection Graphs13 Oct 2025
- 2025VDW-GNNs: Vector diffusion wavelets for geometric graph neural networks1 Oct 2025
- 2025CoVariance Filters and Neural Networks over Hilbert Spaces16 Sep 2025
- 2025Cooperative Sheaf Neural Networks1 Jul 2025
- 2025Copresheaf Topological Neural Networks: A Generalized Deep Learning Framework27 May 2025
- 2025Directed Semi-Simplicial Learning with Applications to Brain Activity Decoding23 May 2025
12 newest of 20 All 20 (JSON)