mlsanityData to 14 Oct 2026

Persformer: A Transformer Architecture for Topological Machine Learning

arXiv 2112.15210 ↗First posted 30 Dec 2021cs.LG math.ATcited by 19

Not on the map. Why?

Abstract (arXiv)

One of the main challenges of Topological Data Analysis (TDA) is to extract features from persistent diagrams directly usable by machine learning algorithms. Indeed, persistence diagrams are intrinsically (multi-)sets of points in ℝ2 and cannot be seen in a straightforward manner as vectors. In this article, we introduce textttPersformer, the first Transformer neural network architecture that accepts persistence diagrams as input. The textttPersformer architecture significantly outperforms previous topological neural network architectures on classical synthetic and graph benchmark datasets. Moreover, it satisfies a universal approximation theorem. This allows us to introduce the first interpretability method for topological machine learning, which we explore in two examples.

Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 30 Dec 2021.

Builds on

20 of 41 references.

References · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  5. 2017Deep Setscited by 1,421
  6. 2021Scaling Vision Transformerscited by 999
  7. 2015Persistence Images: A Stable Vector Representation of Persistent Homologycited by 236
  8. 2019PersLay: A Neural Network Layer for Persistence Diagrams and New Graph Topological Signaturescited by 126
  9. 2017Deep Learning with Topological Signaturescited by 114
  10. 2020Topology of deep neural networkscited by 112
  11. 2018Training Tips for the Transformer Modelcited by 85
  12. 2017Sliced Wasserstein Kernel for Persistence Diagramscited by 77
8 more
  1. 2014A Stable Multi-Scale Kernel for Topological Machine Learningcited by 75
  2. 2020giotto-tda: A Topological Data Analysis Toolkit for Machine Learning and Data Explorationcited by 55
  3. 2018Persistence Fisher Kernel: A Riemannian Manifold Kernel for Persistence Diagramscited by 33
  4. 2019Persistent homology detects curvaturecited by 26
  5. 2017Kernel method for persistence diagrams via kernel embedding and weight factorcited by 20
  6. 2021Topological Uncertainty: Monitoring trained neural networks through persistence of activation graphscited by 20
  7. 2016Topological analysis of the connectome of digital reconstructions of neural microcircuitscited by 15
  8. 2020Visualising the Evolution of English Covid-19 Cases with Topological Data Analysis Ball Mappercited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 5; 2024: 4; 2025: 3; 2026: 5.

19 papers.

Sort:

  1. 2023Topological Deep Learning: A Review of an Emerging Paradigmcited by 34
  2. 2023Euler Characteristic Tools For Topological Data Analysiscited by 13
  3. 2022The Topological BERT: Transforming Attention into Topology for Natural Language Processingcited by 10
  4. 2024Topology-Aware 3D Gaussian Splatting: Leveraging Persistent Homology for Optimized Structural Integritycited by 6
  5. 2022Dialogue Term Extraction using Transfer Learning and Topological Data Analysiscited by 5
  6. 2025Topological Dictionary Learningcited by 4
  7. 2025SparseMeXT Unlocking the Potential of Sparse Representations for HD Map Constructioncited by 4
  8. 2026A Closed-Form Persistence-Landmark Pipeline for Certified Point-Cloud and Graph Classificationcited by 4
  9. 2023Statistical learning on measures: an application to persistence diagramscited by 3
  10. 2026A Closed-Form Adaptive-Landmark Kernel for Certified Point-Cloud and Graph Classificationcited by 3
  11. 2024Multiset Transformer: Advancing Representation Learning in Persistence Diagramscited by 2
  12. 2026nD-RoPE: A Generalized RoPE for n-Dimensional Position Embeddingcited by 2
7 more
  1. 2023Discrete transforms of quantized persistence diagramscited by 1
  2. 2023Decorrelating neurons using persistencecited by 0
  3. 2024GridPE: A Grid Cell-Inspired Unified Position Embedding for Arbitrary-Dimensional Spacescited by 0
  4. 2024xPerT: Extended Persistence Transformercited by 0
  5. 2025TUN: Detecting Significant Points in Persistence Diagrams with Deep Learningcited by 0
  6. 2026COMPLEX: A Closed-Form Certified Embedding of Multiparameter Persistence Modulescited by 0
  7. 2026LandscapeSHAP: Which Persistent Homology Class Gets the Credit?cited by 0