mlsanityData to 14 Oct 2026

Copresheaf Topological Neural Networks: A Generalized Deep Learning Framework

arXiv 2505.21251 ↗First posted 27 May 2025cs.LGcited by 12

Not on the map. Why?

Abstract (arXiv)

We introduce copresheaf topological neural networks (CTNNs), a powerful unifying framework that encapsulates a wide spectrum of deep learning architectures, designed to operate on structured data, including images, point clouds, graphs, meshes, and topological manifolds. While deep learning has profoundly impacted domains ranging from digital assistants to autonomous systems, the principled design of neural architectures tailored to specific tasks and data types remains one of the field's most persistent open challenges. CTNNs address this gap by formulating model design in the language of copresheaves, a concept from algebraic topology that generalizes most practical deep learning models in use today. This abstract yet constructive formulation yields a rich design space from which theoretically sound and practically effective solutions can be derived to tackle core challenges in representation learning, such as long-range dependencies, oversmoothing, heterophily, and non-Euclidean domains. Our empirical results on structured data benchmarks demonstrate that CTNNs consistently outperform conventional baselines, particularly in tasks requiring hierarchical or localized sensitivity. These results establish CTNNs as a principled multi-scale foundation for the next generation of deep learning architectures.

Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 50 of its 71 references that are in the map. First posted on arXiv 27 May 2025.

Builds on

50 of 71 references.

References · 50

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2017Graph Attention Networkscited by 8,923
  4. 2017Inductive Representation Learning on Large Graphscited by 6,320
  5. 2018How Powerful are Graph Neural Networks?cited by 4,393
  6. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  7. 2016Geometric deep learning: going beyond Euclidean datacited by 1,048
  8. 2018Hypergraph Neural Networkscited by 488
  9. 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 397
  10. 2019Hypergraph Convolution and Hypergraph Attentioncited by 228
  11. 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 221
  12. 2021Weisfeiler and Lehman Go Cellular: CW Networkscited by 218
38 more
  1. 2022Neural Sheaf Diffusion: A Topological Perspective on Heterophily and Oversmoothing in GNNscited by 214
  2. 2020Networks beyond pairwise interactions: structure and dynamicscited by 130
  3. 2020Simplicial Neural Networkscited by 110
  4. 2022Topological Deep Learning: Going Beyond Graph Datacited by 97
  5. 2020Sheaf Neural Networkscited by 84
  6. 2020Cell Complex Neural Networkscited by 67
  7. 2021What are higher-order networks?cited by 66
  8. 2024Position: Topological Deep Learning is the New Frontier for Relational Learningcited by 66
  9. 2022Sheaf Neural Networks with Connection Laplacianscited by 65
  10. 2022Message passing all the way upcited by 47
  11. 2023Architectures of Topological Deep Learning: A Survey of Message-Passing Topological Neural Networkscited by 43
  12. 2022Simplicial Attention Networkscited by 41
  13. 2022Cell Attention Networkscited by 35
  14. 2023Sheaf Hypergraph Networkscited by 34
  15. 2023Generalized Simplicial Attention Neural Networkscited by 27
  16. 2023Tangent Bundle Convolutional Learning: from Manifolds to Cellular Sheaves and Backcited by 22
  17. 2023Combinatorial Complexes: Bridging the Gap Between Cell Complexes and Hypergraphscited by 15
  18. 2024Bundle Neural Networks for message diffusion on graphscited by 14
  19. 2021Knowledge Sheaves: A Sheaf-Theoretic Framework for Knowledge Graph Embeddingcited by 11
  20. 2024Attending to Topological Spaces: The Cellular Transformercited by 11
  21. 2024Heterogeneous Sheaf Neural Networkscited by 10
  22. 2025Sheaf theory: from deep geometry to deep learningcited by 10
  23. 2024Joint Diffusion Processes as an Inductive Bias in Sheaf Neural Networkscited by 9
  24. 2022Higher-order signal processing with the Dirac operatorcited by 8
  25. 2025HOG-Diff: Higher-Order Guided Diffusion for Graph Generationcited by 8
  26. 2023Sheaf4Rec: Sheaf Neural Networks for Graph-based Recommender Systemscited by 7
  27. 2023ICML 2023 Topological Deep Learning Challenge : Design and Resultscited by 7
  28. 2022A Topological Deep Learning Framework for Neural Spike Decodingcited by 6
  29. 2023Implicit Gaussian process representation of vector fields over arbitrary latent manifoldscited by 6
  30. 2021Sheaves as a Framework for Understanding and Interpreting Model Fitcited by 5
  31. 2024Sheaf HyperNetworks for Personalized Federated Learningcited by 5
  32. 2024Bayesian Sheaf Neural Networkscited by 5
  33. 2024FedSheafHN: Personalized Federated Learning on Graph-structured Datacited by 3
  34. 2022Cohomology in Constraint Satisfaction and Structure Isomorphismcited by 2
  35. 2022Stable and Transferable Hyper-Graph Neural Networkscited by 2
  36. 2023Topological Community Detection: A Sheaf-Theoretic Approachcited by 2
  37. 2024Quiver Laplacians and Feature Selectioncited by 2
  38. 2022Notes on presheaf representations of strategies and cohomological refinements of k-consistency and k-equivalencecited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 11.

12 papers.