Copresheaf Topological Neural Networks: A Generalized Deep Learning Framework
Not on the map. Why?
Abstract (arXiv)
We introduce copresheaf topological neural networks (CTNNs), a powerful unifying framework that encapsulates a wide spectrum of deep learning architectures, designed to operate on structured data, including images, point clouds, graphs, meshes, and topological manifolds. While deep learning has profoundly impacted domains ranging from digital assistants to autonomous systems, the principled design of neural architectures tailored to specific tasks and data types remains one of the field's most persistent open challenges. CTNNs address this gap by formulating model design in the language of copresheaves, a concept from algebraic topology that generalizes most practical deep learning models in use today. This abstract yet constructive formulation yields a rich design space from which theoretically sound and practically effective solutions can be derived to tackle core challenges in representation learning, such as long-range dependencies, oversmoothing, heterophily, and non-Euclidean domains. Our empirical results on structured data benchmarks demonstrate that CTNNs consistently outperform conventional baselines, particularly in tasks requiring hierarchical or localized sensitivity. These results establish CTNNs as a principled multi-scale foundation for the next generation of deep learning architectures.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 50 of its 71 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
50 of 71 references.
References · 50
- 2017Attention Is All You Needcited by 60,361
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
- 2017Graph Attention Networkscited by 8,923
- 2017Inductive Representation Learning on Large Graphscited by 6,320
- 2018How Powerful are Graph Neural Networks?cited by 4,393
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
- 2018Hypergraph Neural Networkscited by 488
- 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 397
- 2019Hypergraph Convolution and Hypergraph Attentioncited by 228
- 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 221
- 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
38 more
- 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
- 2020Networks beyond pairwise interactions: structure and dynamicscited by 130
- 2020Simplicial Neural Networkscited by 110
- 2022Topological Deep Learning: Going Beyond Graph Datacited by 97
- 2020Sheaf Neural Networkscited by 84
- 2020Cell Complex Neural Networkscited by 67
- 2021What are higher-order networks?cited by 66
- 2024Position: Topological Deep Learning is the New Frontier for Relational Learningcited by 66
- 2022Sheaf Neural Networks with Connection Laplacianscited by 65
- 2022Message passing all the way upcited by 47
- 2023Architectures of Topological Deep Learning: A Survey of Message-Passing Topological Neural Networkscited by 43
- 2022Simplicial Attention Networkscited by 41
- 2022Cell Attention Networkscited by 35
- 2023Sheaf Hypergraph Networkscited by 34
- 2023Generalized Simplicial Attention Neural Networkscited by 27
- 2023Tangent Bundle Convolutional Learning: from Manifolds to Cellular Sheaves and Backcited by 22
- 2023Combinatorial Complexes: Bridging the Gap Between Cell Complexes and Hypergraphscited by 15
- 2024Bundle Neural Networks for message diffusion on graphscited by 14
- 2021Knowledge Sheaves: A Sheaf-Theoretic Framework for Knowledge Graph Embeddingcited by 11
- 2024Attending to Topological Spaces: The Cellular Transformercited by 11
- 2024Heterogeneous Sheaf Neural Networkscited by 10
- 2025Sheaf theory: from deep geometry to deep learningcited by 10
- 2024Joint Diffusion Processes as an Inductive Bias in Sheaf Neural Networkscited by 9
- 2022Higher-order signal processing with the Dirac operatorcited by 8
- 2025HOG-Diff: Higher-Order Guided Diffusion for Graph Generationcited by 8
- 2023Sheaf4Rec: Sheaf Neural Networks for Graph-based Recommender Systemscited by 7
- 2023ICML 2023 Topological Deep Learning Challenge : Design and Resultscited by 7
- 2022A Topological Deep Learning Framework for Neural Spike Decodingcited by 6
- 2023Implicit Gaussian process representation of vector fields over arbitrary latent manifoldscited by 6
- 2021Sheaves as a Framework for Understanding and Interpreting Model Fitcited by 5
- 2024Sheaf HyperNetworks for Personalized Federated Learningcited by 5
- 2024Bayesian Sheaf Neural Networkscited by 5
- 2024FedSheafHN: Personalized Federated Learning on Graph-structured Datacited by 3
- 2022Cohomology in Constraint Satisfaction and Structure Isomorphismcited by 2
- 2022Stable and Transferable Hyper-Graph Neural Networkscited by 2
- 2023Topological Community Detection: A Sheaf-Theoretic Approachcited by 2
- 2024Quiver Laplacians and Feature Selectioncited by 2
- 2022Notes on presheaf representations of strategies and cohomological refinements of k-consistency and k-equivalencecited by 1
Built on by
Citing papers per year: 2025: 1; 2026: 11.
12 papers.
- 2026Topological Neural Operatorscited by 4
- 2026Kan Extension Transformers: A Categorical Unification of Attention, Diffusion, and Predict-Detach Self-Conditioningcited by 3
- 2025CuMPerLay: Learning Cubical Multiparameter Persistence Vectorizationscited by 1
- 2026From Persistence to Survival: Hypothesis Testing, Effect Sizes and Vectorisation for Topological Featurescited by 1
- 2026Foundations of Equivariant Deep Learning: Unifying Graph and Sheaf Neural Networkscited by 1
- 2026Persistent Sheaf Laplacian Analysis of Protein Stability and Solubility Changes upon Mutationcited by 0
- 2026Collapsed Effective Operators for Higher-order Structurescited by 0
- 2026Do Sheaf Neural Networks Use Holonomy? A Measure--Intervene--Control Studycited by 0
- 2026Equivariant Sheaf Neural Networks: Learning Geometric Transport on Graphscited by 0
- 2026Higher Structures in Deep Learningcited by 0
- 2026Let the Heads Talk: Beyond Diagonal Graph Attentioncited by 0
- 2026Mathematical Invariant-Enabled Topological Neural Networks for Molecular and Materials Property Predictioncited by 0
- 2026Mathematical Invariant-Enabled Topological Neural Networks for Molecular and Materials Property Prediction6 Oct 2026
- 2026Let the Heads Talk: Beyond Diagonal Graph Attention1 Oct 2026
- 2026Higher Structures in Deep Learning31 Aug 2026
- 2026Equivariant Sheaf Neural Networks: Learning Geometric Transport on Graphs28 Aug 2026
- 2026Do Sheaf Neural Networks Use Holonomy? A Measure--Intervene--Control Study21 Jul 2026
- 2026Foundations of Equivariant Deep Learning: Unifying Graph and Sheaf Neural Networks4 Jul 2026
- 2026Collapsed Effective Operators for Higher-order Structures22 Jun 2026
- 2026From Persistence to Survival: Hypothesis Testing, Effect Sizes and Vectorisation for Topological Features10 Jun 2026
- 2026Topological Neural Operators8 Jun 2026
- 2026Kan Extension Transformers: A Categorical Unification of Attention, Diffusion, and Predict-Detach Self-Conditioning26 May 2026
- 2026Persistent Sheaf Laplacian Analysis of Protein Stability and Solubility Changes upon Mutation18 Jan 2026
- 2025CuMPerLay: Learning Cubical Multiparameter Persistence Vectorizations14 Oct 2025