mlsanityData to 7 Oct 2026

Topological Neural Networks go Persistent, Equivariant, and Continuous

arXiv 2406.03164 ↗First posted 5 Jun 2024cs.LGcited by 15

Not on the map. Why?

Abstract (arXiv)

Topological Neural Networks (TNNs) incorporate higher-order relational information beyond pairwise interactions, enabling richer representations than Graph Neural Networks (GNNs). Concurrently, topological descriptors based on persistent homology (PH) are being increasingly employed to augment the GNNs. We investigate the benefits of integrating these two paradigms. Specifically, we introduce TopNets as a broad framework that subsumes and unifies various methods in the intersection of GNNs/TNNs and PH such as (generalizations of) RePHINE and TOGL. TopNets can also be readily adapted to handle (symmetries in) geometric complexes, extending the scope of TNNs and PH to spatial settings. Theoretically, we show that PH descriptors can provably enhance the expressivity of simplicial message-passing networks. Empirically, (continuous and E(n)-equivariant extensions of) TopNets achieve strong performance across diverse tasks, including antibody design, molecular dynamics simulation, and drug property prediction.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 49 of its 69 references that are in the map. First posted on arXiv 5 Jun 2024.

Builds on

49 of 69 references.

References · 49

  1. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
  2. 2017Graph Attention Networkscited by 8,854
  3. 2018How Powerful are Graph Neural Networks?cited by 4,355
  4. 2018Neural Ordinary Differential Equationscited by 3,733
  5. 2017Neural Message Passing for Quantum Chemistrycited by 3,460
  6. 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
  7. 2019DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operatorscited by 1,965
  8. 2017Deep Setscited by 1,394
  9. 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
  10. 2021E(n) Equivariant Graph Neural Networkscited by 951
  11. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
  12. 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
37 more
  1. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 602
  2. 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 584
  3. 2020Directional Message Passing for Molecular Graphscited by 556
  4. 2020Masked Label Prediction: Unified Message Passing Model for Semi-Supervised Classificationcited by 500
  5. 2022MACE: Higher Order Equivariant Message Passing Neural Networks for Fast and Accurate Force Fieldscited by 467
  6. 2021Machine learning accelerated computational fluid dynamicscited by 461
  7. 2019Augmented Neural ODEscited by 396
  8. 2021GRAND: Graph Neural Diffusioncited by 258
  9. 2020Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Moleculescited by 254
  10. 2015Persistence Images: A Stable Vector Representation of Persistent Homologycited by 235
  11. 2021Weisfeiler and Lehman Go Topological: Message Passing Simplicial Networkscited by 219
  12. 2020Generalization and Representational Limits of Graph Neural Networkscited by 217
  13. 2017Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equationscited by 203
  14. 2022e3nn: Euclidean Neural Networkscited by 171
  15. 2019Graph Neural Ordinary Differential Equationscited by 153
  16. 2019PersLay: A Neural Network Layer for Persistence Diagrams and New Graph Topological Signaturescited by 125
  17. 2017Deep Learning with Topological Signaturescited by 113
  18. 2020HNHN: Hypergraph Networks with Hyperedge Neuronscited by 104
  19. 2019Topological Signal Processing over Simplicial Complexescited by 94
  20. 2022Clifford Neural Layers for PDE Modelingcited by 91
  21. 2023On the Expressive Power of Geometric Graph Neural Networkscited by 89
  22. 2021Iterative Refinement Graph Neural Network for Antibody Sequence-Structure Co-designcited by 82
  23. 2024ClimODE: Climate and Weather Forecasting with Physics-informed Neural ODEscited by 78
  24. 2022Conditional Antibody Design as 3D Equivariant Graph Translationcited by 75
  25. 2019Mixed High-Order Attention Network for Person Re-Identificationcited by 65
  26. 2020Learning continuous-time PDEs from sparse data with graph neural networkscited by 53
  27. 2023Architectures of Topological Deep Learning: A Survey of Message-Passing Topological Neural Networkscited by 43
  28. 2022Cell Attention Networkscited by 34
  29. 2022Do Residual Neural Networks discretize Neural Ordinary Differential Equations?cited by 27
  30. 2023E(n) Equivariant Message Passing Simplicial Networkscited by 23
  31. 2023Generalization bounds for neural ordinary differential equations and deep residual networkscited by 21
  32. 2023Going beyond persistent homology using persistent homologycited by 21
  33. 2023Curvature Filtrations for Graph Generative Model Evaluationcited by 18
  34. 2023On the Expressivity of Persistent Homology in Graph Learningcited by 18
  35. 2023AbODE: Ab Initio Antibody Design using Conjoined ODEscited by 15
  36. 2022Modular Flows: Differential Molecular Generationcited by 11
  37. 2023Trainability, Expressivity and Interpretability in Gated Neural ODEscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 8; 2026: 6.

15 papers.

Sort: