Persformer: A Transformer Architecture for Topological Machine Learning
Not on the map. Why?
Abstract (arXiv)
One of the main challenges of Topological Data Analysis (TDA) is to extract features from persistent diagrams directly usable by machine learning algorithms. Indeed, persistence diagrams are intrinsically (multi-)sets of points in ℝ2 and cannot be seen in a straightforward manner as vectors. In this article, we introduce textttPersformer, the first Transformer neural network architecture that accepts persistence diagrams as input. The textttPersformer architecture significantly outperforms previous topological neural network architectures on classical synthetic and graph benchmark datasets. Moreover, it satisfies a universal approximation theorem. This allows us to introduce the first interpretability method for topological machine learning, which we explore in two examples.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 20 of its 41 references that are in the map. First posted on arXiv 30 Dec 2021.
Builds on
20 of 41 references.
References · 20
- 2017Attention Is All You Needcited by 60,361
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
- 2017Deep Setscited by 1,421
- 2021Scaling Vision Transformerscited by 999
- 2015Persistence Images: A Stable Vector Representation of Persistent Homologycited by 236
- 2019PersLay: A Neural Network Layer for Persistence Diagrams and New Graph Topological Signaturescited by 126
- 2017Deep Learning with Topological Signaturescited by 114
- 2020Topology of deep neural networkscited by 112
- 2018Training Tips for the Transformer Modelcited by 85
- 2017Sliced Wasserstein Kernel for Persistence Diagramscited by 77
8 more
- 2014A Stable Multi-Scale Kernel for Topological Machine Learningcited by 75
- 2020giotto-tda: A Topological Data Analysis Toolkit for Machine Learning and Data Explorationcited by 55
- 2018Persistence Fisher Kernel: A Riemannian Manifold Kernel for Persistence Diagramscited by 33
- 2019Persistent homology detects curvaturecited by 26
- 2017Kernel method for persistence diagrams via kernel embedding and weight factorcited by 20
- 2021Topological Uncertainty: Monitoring trained neural networks through persistence of activation graphscited by 20
- 2016Topological analysis of the connectome of digital reconstructions of neural microcircuitscited by 15
- 2020Visualising the Evolution of English Covid-19 Cases with Topological Data Analysis Ball Mappercited by 1
Built on by
Citing papers per year: 2022: 2; 2023: 5; 2024: 4; 2025: 3; 2026: 5.
19 papers.
Sort:
- 2023Topological Deep Learning: A Review of an Emerging Paradigmcited by 34
- 2023Euler Characteristic Tools For Topological Data Analysiscited by 13
- 2022The Topological BERT: Transforming Attention into Topology for Natural Language Processingcited by 10
- 2024Topology-Aware 3D Gaussian Splatting: Leveraging Persistent Homology for Optimized Structural Integritycited by 6
- 2022Dialogue Term Extraction using Transfer Learning and Topological Data Analysiscited by 5
- 2025Topological Dictionary Learningcited by 4
- 2025SparseMeXT Unlocking the Potential of Sparse Representations for HD Map Constructioncited by 4
- 2026A Closed-Form Persistence-Landmark Pipeline for Certified Point-Cloud and Graph Classificationcited by 4
- 2023Statistical learning on measures: an application to persistence diagramscited by 3
- 2026A Closed-Form Adaptive-Landmark Kernel for Certified Point-Cloud and Graph Classificationcited by 3
- 2024Multiset Transformer: Advancing Representation Learning in Persistence Diagramscited by 2
- 2026nD-RoPE: A Generalized RoPE for n-Dimensional Position Embeddingcited by 2
7 more
- 2023Discrete transforms of quantized persistence diagramscited by 1
- 2023Decorrelating neurons using persistencecited by 0
- 2024GridPE: A Grid Cell-Inspired Unified Position Embedding for Arbitrary-Dimensional Spacescited by 0
- 2024xPerT: Extended Persistence Transformercited by 0
- 2025TUN: Detecting Significant Points in Persistence Diagrams with Deep Learningcited by 0
- 2026COMPLEX: A Closed-Form Certified Embedding of Multiparameter Persistence Modulescited by 0
- 2026LandscapeSHAP: Which Persistent Homology Class Gets the Credit?cited by 0
- 2026LandscapeSHAP: Which Persistent Homology Class Gets the Credit?25 Sep 2026
- 2026COMPLEX: A Closed-Form Certified Embedding of Multiparameter Persistence Modules18 Sep 2026
- 2026nD-RoPE: A Generalized RoPE for n-Dimensional Position Embedding10 Jun 2026
- 2026A Closed-Form Adaptive-Landmark Kernel for Certified Point-Cloud and Graph Classification5 May 2026
- 2026A Closed-Form Persistence-Landmark Pipeline for Certified Point-Cloud and Graph Classification4 May 2026
- 2025TUN: Detecting Significant Points in Persistence Diagrams with Deep Learning16 Dec 2025
- 2025SparseMeXT Unlocking the Potential of Sparse Representations for HD Map Construction12 May 2025
- 2025Topological Dictionary Learning14 Mar 2025
- 2024Topology-Aware 3D Gaussian Splatting: Leveraging Persistent Homology for Optimized Structural Integrity21 Dec 2024
- 2024Multiset Transformer: Advancing Representation Learning in Persistence Diagrams22 Nov 2024
- 2024xPerT: Extended Persistence Transformer18 Oct 2024
- 2024GridPE: A Grid Cell-Inspired Unified Position Embedding for Arbitrary-Dimensional Spaces11 Jun 2024
7 more
- 2023Discrete transforms of quantized persistence diagrams28 Dec 2023
- 2023Decorrelating neurons using persistence9 Aug 2023
- 2023Euler Characteristic Tools For Topological Data Analysis24 Mar 2023
- 2023Statistical learning on measures: an application to persistence diagrams15 Mar 2023
- 2023Topological Deep Learning: A Review of an Emerging Paradigm8 Feb 2023
- 2022Dialogue Term Extraction using Transfer Learning and Topological Data Analysis22 Aug 2022
- 2022The Topological BERT: Transforming Attention into Topology for Natural Language Processing30 Jun 2022
- 2023Topological Deep Learning: A Review of an Emerging Paradigmcited by 34
- 2023Euler Characteristic Tools For Topological Data Analysiscited by 13
- 2022The Topological BERT: Transforming Attention into Topology for Natural Language Processingcited by 10
- 2024Topology-Aware 3D Gaussian Splatting: Leveraging Persistent Homology for Optimized Structural Integritycited by 6
- 2022Dialogue Term Extraction using Transfer Learning and Topological Data Analysiscited by 5
- 2025Topological Dictionary Learningcited by 4
- 2025SparseMeXT Unlocking the Potential of Sparse Representations for HD Map Constructioncited by 4
- 2026A Closed-Form Persistence-Landmark Pipeline for Certified Point-Cloud and Graph Classificationcited by 4
- 2023Statistical learning on measures: an application to persistence diagramscited by 3
- 2026A Closed-Form Adaptive-Landmark Kernel for Certified Point-Cloud and Graph Classificationcited by 3
- 2024Multiset Transformer: Advancing Representation Learning in Persistence Diagramscited by 2
- 2026nD-RoPE: A Generalized RoPE for n-Dimensional Position Embeddingcited by 2
12 most cited of 19 All 19 (JSON)
- 2026LandscapeSHAP: Which Persistent Homology Class Gets the Credit?25 Sep 2026
- 2026COMPLEX: A Closed-Form Certified Embedding of Multiparameter Persistence Modules18 Sep 2026
- 2026nD-RoPE: A Generalized RoPE for n-Dimensional Position Embedding10 Jun 2026
- 2026A Closed-Form Adaptive-Landmark Kernel for Certified Point-Cloud and Graph Classification5 May 2026
- 2026A Closed-Form Persistence-Landmark Pipeline for Certified Point-Cloud and Graph Classification4 May 2026
- 2025TUN: Detecting Significant Points in Persistence Diagrams with Deep Learning16 Dec 2025
- 2025SparseMeXT Unlocking the Potential of Sparse Representations for HD Map Construction12 May 2025
- 2025Topological Dictionary Learning14 Mar 2025
- 2024Topology-Aware 3D Gaussian Splatting: Leveraging Persistent Homology for Optimized Structural Integrity21 Dec 2024
- 2024Multiset Transformer: Advancing Representation Learning in Persistence Diagrams22 Nov 2024
- 2024xPerT: Extended Persistence Transformer18 Oct 2024
- 2024GridPE: A Grid Cell-Inspired Unified Position Embedding for Arbitrary-Dimensional Spaces11 Jun 2024
12 newest of 19 All 19 (JSON)