Lorentz group equivariant autoencoders
Not on the map. Why?
Abstract (arXiv)
There has been significant work recently in developing machine learning (ML) models in high energy physics (HEP) for tasks such as classification, simulation, and anomaly detection. Often these models are adapted from those designed for datasets in computer vision or natural language processing, which lack inductive biases suited to HEP data, such as equivariance to its inherent symmetries. Such biases have been shown to make models more performant and interpretable, and reduce the amount of training data needed. To that end, we develop the Lorentz group autoencoder (LGAE), an autoencoder model equivariant with respect to the proper, orthochronous Lorentz group SO^+(3,1), with a latent space living in the representations of the group. We present our architecture and several experimental results on jets at the LHC and find it outperforms graph and convolutional neural network baseline models on several compression, reconstruction, and anomaly detection metrics. We also demonstrate the advantage of such an equivariant model in analyzing the latent space of the autoencoder, which can improve the explainability of potential anomalies discovered by such ML models.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 46 of its 101 references that are in the map. First posted on arXiv 14 Dec 2022.
Builds on
46 of 101 references.
References · 46
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2017Neural Message Passing for Quantum Chemistrycited by 3,460
- 2016Group Equivariant Convolutional Networkscited by 1,154
- 2021Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gaugescited by 1,131
- 2016A Point Set Generation Network for 3D Object Reconstruction from a Single Imagecited by 972
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 735
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 701
- 2016Interaction Networks for Learning about Objects, Relations and Physicscited by 503
- 2019General E(2)-Equivariant Steerable CNNscited by 441
- 2019Cormorant: Covariant Molecular Neural Networkscited by 262
- 2020Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Datacited by 248
34 more
- 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 244
- 2018A General Theory of Equivariant CNNs on Homogeneous Spacescited by 223
- 2021A Practical Method for Constructing Equivariant Multilayer Perceptrons for Arbitrary Matrix Groupscited by 185
- 2022e3nn: Euclidean Neural Networkscited by 171
- 2018Clebsch-Gordan Nets: a Fully Fourier Space Spherical Convolutional Neural Networkcited by 168
- 2018Recent Advances in Autoencoder-Based Representation Learningcited by 130
- 2020Lorentz Group Equivariant Neural Network for Particle Physicscited by 120
- 2018Energy Flow Networks: Deep Sets for Particle Jetscited by 83
- 2020Explainable Artificial Intelligence: a Systematic Reviewcited by 79
- 2017CaloGAN: Simulating 3D High Energy Particle Showers in Multi-Layer Electromagnetic Calorimeters with Generative Adversarial Networkscited by 78
- 2021A Living Review of Machine Learning for Particle Physicscited by 77
- 2019ParticleNet: Jet Tagging via Particle Cloudscited by 64
- 2017Accelerating Science with Generative Adversarial Networks: An Application to 3D Particle Showers in Multi-Layer Calorimeterscited by 55
- 2019FSPool: Learning Set Representations with Featurewise Sort Poolingcited by 53
- 2017Learning Particle Physics by Example: Location-Aware Generative Adversarial Networks for Physics Synthesiscited by 46
- 2020Anomaly Detection With Conditional Variational Autoencoderscited by 46
- 2021Particle Cloud Generation with Message Passing Generative Adversarial Networkscited by 45
- 2019Calorimetry with Deep Learning: Particle Simulation and Reconstruction for Collider Physicscited by 42
- 2018Variational Autoencoders for New Physics Mining at the Large Hadron Collidercited by 40
- 2020Variational Autoencoders for Anomalous Jet Taggingcited by 33
- 2021Autoencoders for unsupervised anomaly detection in high energy physicscited by 32
- 2020Trajectory Prediction using Equivariant Continuous Convolutioncited by 26
- 2021A reconfigurable neural network ASIC for detector front-end data compression at the HL-LHCcited by 20
- 2021Bump Hunting in Latent Spacecited by 19
- 2021Charged particle tracking via edge-classifying interaction networkscited by 19
- 2017Jet Constituents for Deep Neural Network Based Top Quark Taggingcited by 15
- 2020Variational Autoencoders for Jet Simulationcited by 14
- 2022Graph Neural Networks in Particle Physics: Implementations, Innovations, and Challengescited by 12
- 2020Graph Generative Adversarial Networks for Sparse Data Generation in High Energy Physicscited by 11
- 2021Particle Graph Autoencoders and Differentiable, Learned Energy Mover's Distancecited by 10
- 2021Autoencoders for Semivisible Jet Detectioncited by 9
- 2021An Exploration of Learnt Representations of W Jetscited by 8
- 2022IRC-safe Graph Autoencoder for unsupervised anomaly detectioncited by 8
- 2022Particle-based Fast Jet Simulation at the LHC with Variational Autoencoderscited by 7
Built on by
Citing papers per year: 2023: 6; 2024: 1; 2025: 4; 2026: 4.
15 papers.
Sort:
By area:
- 2023Deep Learning Symmetries and Their Lie Groups, Algebras, and Subalgebras from First Principlescited by 22
- 2023Anomalies, Representations, and Self-Supervisioncited by 10
- 2023Fast Particle-based Anomaly Detection Algorithm with Variational Autoencodercited by 6
- 2023Oracle-Preserving Latent Flowscited by 5
- 2024Optimal Equivariant Architectures from the Symmetries of Matrix-Element Likelihoodscited by 5
- 2023mathbbZ2× mathbbZ2 Equivariant Quantum Neural Networks: Benchmarking against Classical Neural Networkscited by 4
- 2025Enhancing anomaly detection with topology-aware autoencoderscited by 3
- 2025Surrogate Modeling of 3D Rayleigh-Benard Convection with Equivariant Autoencoderscited by 3
- 2023Lorentz Equivariant Model for Knowledge-Enhanced Hyperbolic Collaborative Filteringcited by 1
- 2025Learning symmetries in datasetscited by 1
- 2026jBOT: Semantic Jet Representation Clustering Emerges from Self-Distillationcited by 1
- 2026Artificial Intelligence and Symmetries: Learning, Encoding, and Discovering Structure in Physical Datacited by 1
3 more
- 2025Learnable cut flow for high energy physicscited by 0
- 2026Generative models on phase spacecited by 0
- 2026Contrastive Learning for Interpretable Anomaly Detection at Collider Experimentscited by 0
- 2026Contrastive Learning for Interpretable Anomaly Detection at Collider Experiments13 Aug 2026
- 2026Generative models on phase space2 Apr 2026
- 2026Artificial Intelligence and Symmetries: Learning, Encoding, and Discovering Structure in Physical Data2 Feb 2026
- 2026jBOT: Semantic Jet Representation Clustering Emerges from Self-Distillation16 Jan 2026
- 2025Surrogate Modeling of 3D Rayleigh-Benard Convection with Equivariant Autoencoders19 May 2025
- 2025Learning symmetries in datasets7 Apr 2025
- 2025Learnable cut flow for high energy physics28 Mar 2025
- 2025Enhancing anomaly detection with topology-aware autoencoders14 Feb 2025
- 2024Optimal Equivariant Architectures from the Symmetries of Matrix-Element Likelihoods24 Oct 2024
- 2023mathbbZ2× mathbbZ2 Equivariant Quantum Neural Networks: Benchmarking against Classical Neural Networks30 Nov 2023
- 2023Fast Particle-based Anomaly Detection Algorithm with Variational Autoencoder28 Nov 2023
- 2023Lorentz Equivariant Model for Knowledge-Enhanced Hyperbolic Collaborative Filtering9 Feb 2023
3 more
- 2023Oracle-Preserving Latent Flows2 Feb 2023
- 2023Deep Learning Symmetries and Their Lie Groups, Algebras, and Subalgebras from First Principles13 Jan 2023
- 2023Anomalies, Representations, and Self-Supervision11 Jan 2023
- 2026Generative models on phase spacecited by 0
- 2026Generative models on phase space2 Apr 2026
- 2023Deep Learning Symmetries and Their Lie Groups, Algebras, and Subalgebras from First Principlescited by 22
- 2023Anomalies, Representations, and Self-Supervisioncited by 10
- 2023Fast Particle-based Anomaly Detection Algorithm with Variational Autoencodercited by 6
- 2023Oracle-Preserving Latent Flowscited by 5
- 2024Optimal Equivariant Architectures from the Symmetries of Matrix-Element Likelihoodscited by 5
- 2023mathbbZ2× mathbbZ2 Equivariant Quantum Neural Networks: Benchmarking against Classical Neural Networkscited by 4
- 2025Enhancing anomaly detection with topology-aware autoencoderscited by 3
- 2025Surrogate Modeling of 3D Rayleigh-Benard Convection with Equivariant Autoencoderscited by 3
- 2023Lorentz Equivariant Model for Knowledge-Enhanced Hyperbolic Collaborative Filteringcited by 1
- 2025Learning symmetries in datasetscited by 1
- 2026jBOT: Semantic Jet Representation Clustering Emerges from Self-Distillationcited by 1
- 2026Artificial Intelligence and Symmetries: Learning, Encoding, and Discovering Structure in Physical Datacited by 1
12 most cited of 14 All 14 (JSON)
- 2026Contrastive Learning for Interpretable Anomaly Detection at Collider Experiments13 Aug 2026
- 2026Artificial Intelligence and Symmetries: Learning, Encoding, and Discovering Structure in Physical Data2 Feb 2026
- 2026jBOT: Semantic Jet Representation Clustering Emerges from Self-Distillation16 Jan 2026
- 2025Surrogate Modeling of 3D Rayleigh-Benard Convection with Equivariant Autoencoders19 May 2025
- 2025Learning symmetries in datasets7 Apr 2025
- 2025Learnable cut flow for high energy physics28 Mar 2025
- 2025Enhancing anomaly detection with topology-aware autoencoders14 Feb 2025
- 2024Optimal Equivariant Architectures from the Symmetries of Matrix-Element Likelihoods24 Oct 2024
- 2023mathbbZ2× mathbbZ2 Equivariant Quantum Neural Networks: Benchmarking against Classical Neural Networks30 Nov 2023
- 2023Fast Particle-based Anomaly Detection Algorithm with Variational Autoencoder28 Nov 2023
- 2023Lorentz Equivariant Model for Knowledge-Enhanced Hyperbolic Collaborative Filtering9 Feb 2023
- 2023Oracle-Preserving Latent Flows2 Feb 2023
12 newest of 14 All 14 (JSON)