SPANet: Generalized Permutationless Set Assignment for Particle Physics using Symmetry Preserving Attention
Not on the map. Why?
Abstract (arXiv)
The creation of unstable heavy particles at the Large Hadron Collider is the most direct way to address some of the deepest open questions in physics. Collisions typically produce variable-size sets of observed particles which have inherent ambiguities complicating the assignment of observed particles to the decay products of the heavy particles. Current strategies for tackling these challenges in the physics community ignore the physical symmetries of the decay products and consider all possible assignment permutations and do not scale to complex configurations. Attention based deep learning methods for sequence modelling have achieved state-of-the-art performance in natural language processing, but they lack built-in mechanisms to deal with the unique symmetries found in physical set-assignment problems. We introduce a novel method for constructing symmetry-preserving attention networks which reflect the problem's natural invariances to efficiently find assignments without evaluating all permutations. This general approach is applicable to arbitrarily complex configurations and significantly outperforms current methods, improving reconstruction efficiency between 19% - 35% on typical benchmark problems while decreasing inference time by two to five orders of magnitude on the most complex events, making many important and previously intractable cases tractable. A full code repository containing a general library, the specific configuration used, and a complete dataset release, are avaiable at https://github.com/Alexanders101/SPANet
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). Builds on 15 of its 57 references that are in the map. First posted on arXiv 7 Jun 2021.
Builds on
15 of 57 references.
References · 15
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,239
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
- 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 262
- 2018Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networkscited by 129
- 2020Gauge Equivariant Mesh CNNs: Anisotropic convolutions on geometric graphscited by 90
- 2017DeepPermNet: Visual Permutation Learningcited by 32
- 2020Permutationless Many-Jet Event Reconstruction with Symmetry Preserving Attention Networkscited by 22
- 2020Sherpa: Robust Hyperparameter Optimization for Machine Learningcited by 14
3 more
Built on by
Citing papers per year: 2022: 3; 2023: 7; 2024: 4; 2025: 0; 2026: 4.
18 papers.
Sort:
By area:
- 2023Deep Learning Symmetries and Their Lie Groups, Algebras, and Subalgebras from First Principlescited by 22
- 2023End-To-End Latent Variational Diffusion Models for Inverse Problems in High Energy Physicscited by 22
- 2022nu-Flows: Conditional Neutrino Regressioncited by 11
- 2022Snowmass 2021 Computational Frontier CompF03 Topical Group Report: Machine Learningcited by 10
- 2023nu2-Flows: Fast and improved neutrino reconstruction in multi-neutrino final states with conditional normalizing flowscited by 10
- 2023Topological Reconstruction of Particle Physics Processes using Graph Neural Networkscited by 8
- 2022The Quarks of Attentioncited by 7
- 2023Reconstruction of Unstable Heavy Particles Using Deep Symmetry-Preserving Attention Networkscited by 7
- 2024Ultra Fast Transformers on FPGAs for Particle Physics Experimentscited by 6
- 2023Oracle-Preserving Latent Flowscited by 5
- 2024Optimal Equivariant Architectures from the Symmetries of Matrix-Element Likelihoodscited by 5
- 2024Reconstructing short-lived particles using hypergraph representation learningcited by 4
6 more
- 2023Interpretable Joint Event-Particle Reconstruction for Neutrino Physics at NOvA with Sparse CNNs and Transformerscited by 3
- 2024Reconstruction of boosted and resolved multi-Higgs-boson events with symmetry-preserving attention networkscited by 1
- 2026Pointwise Metrics Mislead: An Evaluation Protocol for Multimodal Inverse Problemscited by 1
- 2026Pairton: Iterative Reconstruction of Short-Lived Particlescited by 1
- 2026Probing SMEFT Operators through tbarttbart Production with Hyper-Graph Neural Networks at the LHCcited by 0
- 2026ResoSeg: Resonance Tagger using Transformer and Segment Modelcited by 0
- 2026ResoSeg: Resonance Tagger using Transformer and Segment Model11 Sep 2026
- 2026Pairton: Iterative Reconstruction of Short-Lived Particles14 Aug 2026
- 2026Pointwise Metrics Mislead: An Evaluation Protocol for Multimodal Inverse Problems21 May 2026
- 2026Probing SMEFT Operators through tbarttbart Production with Hyper-Graph Neural Networks at the LHC18 May 2026
- 2024Reconstruction of boosted and resolved multi-Higgs-boson events with symmetry-preserving attention networks5 Dec 2024
- 2024Optimal Equivariant Architectures from the Symmetries of Matrix-Element Likelihoods24 Oct 2024
- 2024Reconstructing short-lived particles using hypergraph representation learning15 Feb 2024
- 2024Ultra Fast Transformers on FPGAs for Particle Physics Experiments1 Feb 2024
- 2023Reconstruction of Unstable Heavy Particles Using Deep Symmetry-Preserving Attention Networks5 Sep 2023
- 2023nu2-Flows: Fast and improved neutrino reconstruction in multi-neutrino final states with conditional normalizing flows5 Jul 2023
- 2023End-To-End Latent Variational Diffusion Models for Inverse Problems in High Energy Physics17 May 2023
- 2023Topological Reconstruction of Particle Physics Processes using Graph Neural Networks24 Mar 2023
6 more
- 2023Interpretable Joint Event-Particle Reconstruction for Neutrino Physics at NOvA with Sparse CNNs and Transformers10 Mar 2023
- 2023Oracle-Preserving Latent Flows2 Feb 2023
- 2023Deep Learning Symmetries and Their Lie Groups, Algebras, and Subalgebras from First Principles13 Jan 2023
- 2022Snowmass 2021 Computational Frontier CompF03 Topical Group Report: Machine Learning15 Sep 2022
- 2022nu-Flows: Conditional Neutrino Regression1 Jul 2022
- 2022The Quarks of Attention15 Feb 2022
- 2023Deep Learning Symmetries and Their Lie Groups, Algebras, and Subalgebras from First Principlescited by 22
- 2022nu-Flows: Conditional Neutrino Regressioncited by 11
- 2022Snowmass 2021 Computational Frontier CompF03 Topical Group Report: Machine Learningcited by 10
- 2023nu2-Flows: Fast and improved neutrino reconstruction in multi-neutrino final states with conditional normalizing flowscited by 10
- 2023Topological Reconstruction of Particle Physics Processes using Graph Neural Networkscited by 8
- 2022The Quarks of Attentioncited by 7
- 2023Reconstruction of Unstable Heavy Particles Using Deep Symmetry-Preserving Attention Networkscited by 7
- 2024Ultra Fast Transformers on FPGAs for Particle Physics Experimentscited by 6
- 2023Oracle-Preserving Latent Flowscited by 5
- 2024Optimal Equivariant Architectures from the Symmetries of Matrix-Element Likelihoodscited by 5
- 2024Reconstructing short-lived particles using hypergraph representation learningcited by 4
- 2023Interpretable Joint Event-Particle Reconstruction for Neutrino Physics at NOvA with Sparse CNNs and Transformerscited by 3
12 most cited of 17 All 17 (JSON)
- 2026ResoSeg: Resonance Tagger using Transformer and Segment Model11 Sep 2026
- 2026Pairton: Iterative Reconstruction of Short-Lived Particles14 Aug 2026
- 2026Pointwise Metrics Mislead: An Evaluation Protocol for Multimodal Inverse Problems21 May 2026
- 2026Probing SMEFT Operators through tbarttbart Production with Hyper-Graph Neural Networks at the LHC18 May 2026
- 2024Reconstruction of boosted and resolved multi-Higgs-boson events with symmetry-preserving attention networks5 Dec 2024
- 2024Optimal Equivariant Architectures from the Symmetries of Matrix-Element Likelihoods24 Oct 2024
- 2024Reconstructing short-lived particles using hypergraph representation learning15 Feb 2024
- 2024Ultra Fast Transformers on FPGAs for Particle Physics Experiments1 Feb 2024
- 2023Reconstruction of Unstable Heavy Particles Using Deep Symmetry-Preserving Attention Networks5 Sep 2023
- 2023nu2-Flows: Fast and improved neutrino reconstruction in multi-neutrino final states with conditional normalizing flows5 Jul 2023
- 2023Topological Reconstruction of Particle Physics Processes using Graph Neural Networks24 Mar 2023
- 2023Interpretable Joint Event-Particle Reconstruction for Neutrino Physics at NOvA with Sparse CNNs and Transformers10 Mar 2023
12 newest of 17 All 17 (JSON)