Autoencoders for unsupervised anomaly detection in high energy physics
Not on the map. Why?
Abstract (arXiv)
Autoencoders are widely used in machine learning applications, in particular for anomaly detection. Hence, they have been introduced in high energy physics as a promising tool for model-independent new physics searches. We scrutinize the usage of autoencoders for unsupervised anomaly detection based on reconstruction loss to show their capabilities, but also their limitations. As a particle physics benchmark scenario, we study the tagging of top jet images in a background of QCD jet images. Although we reproduce the positive results from the literature, we show that the standard autoencoder setup cannot be considered as a model-independent anomaly tagger by inverting the task: due to the sparsity and the specific structure of the jet images, the autoencoder fails to tag QCD jets if it is trained on top jets even in a semi-supervised setup. Since the same autoencoder architecture can be a good tagger for a specific example of an anomaly and a bad tagger for a different example, we suggest improved performance measures for the task of model-independent anomaly detection. We also improve the capability of the autoencoder to learn non-trivial features of the jet images, such that it is able to achieve both top jet tagging and the inverse task of QCD jet tagging with the same setup. However, we want to stress that a truly model-independent and powerful autoencoder-based unsupervised jet tagger still needs to be developed.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 25 of its 68 references that are in the map. First posted on arXiv 19 Apr 2021.
Builds on
25 of 68 references.
References · 25
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detectioncited by 560
- 2019Likelihood Ratios for Out-of-Distribution Detectioncited by 451
- 2018Do Deep Generative Models Know What They Don't Know?cited by 443
- 2020A Unifying Review of Deep and Shallow Anomaly Detectioncited by 423
- 2019Deep Learning for Anomaly Detection: A Surveycited by 357
- 2020Why Normalizing Flows Fail to Detect Out-of-Distribution Datacited by 220
- 2019Input complexity and out-of-distribution detection with likelihood-based generative modelscited by 186
- 2020Deep Learning for Anomaly Detection: A Reviewcited by 159
- 2021A Living Review of Machine Learning for Particle Physicscited by 77
- 2020Understanding Anomaly Detection with Deep Invertible Networks through Hierarchies of Distributions and Featurescited by 64
- 2018Machine Learning in High Energy Physics Community White Papercited by 48
13 more
- 2017Classification without labels: Learning from mixed samples in high energy physicscited by 42
- 2018Variational Autoencoders for New Physics Mining at the Large Hadron Collidercited by 40
- 2020Variational Autoencoders for Anomalous Jet Taggingcited by 33
- 2017Weakly Supervised Classification in High Energy Physicscited by 21
- 2018Novelty Detection Meets Collider Physicscited by 20
- 2021Topological Obstructions to Autoencodingcited by 20
- 2021Better Latent Spaces for Better Autoencoderscited by 20
- 2021Bump Hunting in Latent Spacecited by 19
- 2017Jet Constituents for Deep Neural Network Based Top Quark Taggingcited by 15
- 2021Comparing Weak- and Unsupervised Methods for Resonant Anomaly Detectioncited by 13
- 2018Learning to Classify from Impure Samples with High-Dimensional Datacited by 8
- 2017(Machine) Learning to Do More with Lesscited by 7
- 2019Machine Learning on data with sPlot background subtractioncited by 2
Built on by
Citing papers per year: 2021: 4; 2022: 7; 2023: 10; 2024: 6; 2025: 4; 2026: 1.
32 papers.
Sort:
By area:
- 2021Machine Learning in the Search for New Fundamental Physicscited by 50
- 2023Machine Learning for Anomaly Detection in Particle Physicscited by 29
- 2022Learning new physics efficiently with nonparametric methodscited by 20
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Reviewcited by 18
- 2021Challenges for Unsupervised Anomaly Detection in Particle Physicscited by 16
- 2021Online-compatible Unsupervised Non-resonant Anomaly Detectioncited by 15
- 2022Lorentz group equivariant autoencoderscited by 15
- 2022Snowmass 2021 Computational Frontier CompF03 Topical Group Report: Machine Learningcited by 10
- 2023Improving new physics searches with diffusion models for event observables and jet constituentscited by 10
- 2024Anomaly Detection Based on Isolation Mechanisms: A Surveycited by 10
- 2021Autoencoders for Semivisible Jet Detectioncited by 9
- 2022IRC-safe Graph Autoencoder for unsupervised anomaly detectioncited by 8
20 more
- 2022Neural Embedding: Learning the Embedding of the Manifold of Physics Datacited by 7
- 2023Fast Particle-based Anomaly Detection Algorithm with Variational Autoencodercited by 6
- 2024Generating Physical Dynamics under Priorscited by 6
- 2022Invariant Representation Driven Neural Classifier for Anti-QCD Jet Taggingcited by 4
- 2023Comparative Evaluation of Anomaly Detection Methods for Fraud Detection in Online Credit Card Paymentscited by 4
- 2024Radio-astronomical Image Reconstruction with Conditional Denoising Diffusion Modelcited by 4
- 2023Generative Invertible Quantum Neural Networkscited by 3
- 2023AD-NEV: A Scalable Multi-level Neuroevolution Framework for Multivariate Anomaly Detectioncited by 3
- 2023Versatile Energy-Based Probabilistic Models for High Energy Physicscited by 2
- 2025AutoSciDACT: Automated Scientific Discovery through Contrastive Embedding and Hypothesis Testingcited by 2
- 2023Targeted collapse regularized autoencoder for anomaly detection: black hole at the centercited by 1
- 2023Triggering Dark Showers with Conditional Dual Auto-Encoderscited by 1
- 2024A comprehensive GeoAI review: Progress, Challenges and Outlookscited by 1
- 2025Fast reconstruction-based ROI triggering via anomaly detection in the CYGNO optical TPCcited by 1
- 2022Radial Autoencoders for Enhanced Anomaly Detectioncited by 0
- 2024AD-NEv++ : The multi-architecture neuroevolution-based multivariate anomaly detection frameworkcited by 0
- 2024A Data Mining-Based Dynamical Anomaly Detection Method for Integrating with an Advance Metering Systemcited by 0
- 2025TRANSIT your events into a new mass: Fast background interpolation for weakly-supervised anomaly searchescited by 0
- 2025A Generative Model for Disentangling Galaxy Photometric Parameterscited by 0
- 2026Quantum-Inspired Tensor Network Autoencoders for Anomaly Detection: A MERA-Based Approachcited by 0
- 2026Quantum-Inspired Tensor Network Autoencoders for Anomaly Detection: A MERA-Based Approach8 Apr 2026
- 2025Fast reconstruction-based ROI triggering via anomaly detection in the CYGNO optical TPC30 Dec 2025
- 2025AutoSciDACT: Automated Scientific Discovery through Contrastive Embedding and Hypothesis Testing24 Oct 2025
- 2025A Generative Model for Disentangling Galaxy Photometric Parameters21 Jul 2025
- 2025TRANSIT your events into a new mass: Fast background interpolation for weakly-supervised anomaly searches6 Mar 2025
- 2024A comprehensive GeoAI review: Progress, Challenges and Outlooks16 Dec 2024
- 2024Generating Physical Dynamics under Priors1 Sep 2024
- 2024A Data Mining-Based Dynamical Anomaly Detection Method for Integrating with an Advance Metering System4 May 2024
- 2024AD-NEv++ : The multi-architecture neuroevolution-based multivariate anomaly detection framework25 Mar 2024
- 2024Anomaly Detection Based on Isolation Mechanisms: A Survey16 Mar 2024
- 2024Radio-astronomical Image Reconstruction with Conditional Denoising Diffusion Model15 Feb 2024
- 2023Comparative Evaluation of Anomaly Detection Methods for Fraud Detection in Online Credit Card Payments21 Dec 2023
20 more
- 2023Machine Learning for Anomaly Detection in Particle Physics20 Dec 2023
- 2023Improving new physics searches with diffusion models for event observables and jet constituents15 Dec 2023
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Review15 Dec 2023
- 2023Fast Particle-based Anomaly Detection Algorithm with Variational Autoencoder28 Nov 2023
- 2023Triggering Dark Showers with Conditional Dual Auto-Encoders22 Jun 2023
- 2023Targeted collapse regularized autoencoder for anomaly detection: black hole at the center22 Jun 2023
- 2023AD-NEV: A Scalable Multi-level Neuroevolution Framework for Multivariate Anomaly Detection25 May 2023
- 2023Generative Invertible Quantum Neural Networks24 Feb 2023
- 2023Versatile Energy-Based Probabilistic Models for High Energy Physics1 Feb 2023
- 2022Lorentz group equivariant autoencoders14 Dec 2022
- 2022Snowmass 2021 Computational Frontier CompF03 Topical Group Report: Machine Learning15 Sep 2022
- 2022Neural Embedding: Learning the Embedding of the Manifold of Physics Data10 Aug 2022
- 2022IRC-safe Graph Autoencoder for unsupervised anomaly detection26 Apr 2022
- 2022Learning new physics efficiently with nonparametric methods5 Apr 2022
- 2022Radial Autoencoders for Enhanced Anomaly Detection29 Mar 2022
- 2022Invariant Representation Driven Neural Classifier for Anti-QCD Jet Tagging18 Jan 2022
- 2021Machine Learning in the Search for New Fundamental Physics7 Dec 2021
- 2021Autoencoders for Semivisible Jet Detection6 Dec 2021
- 2021Online-compatible Unsupervised Non-resonant Anomaly Detection11 Nov 2021
- 2021Challenges for Unsupervised Anomaly Detection in Particle Physics13 Oct 2021
- 2021Machine Learning in the Search for New Fundamental Physicscited by 50
- 2023Machine Learning for Anomaly Detection in Particle Physicscited by 29
- 2022Learning new physics efficiently with nonparametric methodscited by 20
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Reviewcited by 18
- 2021Challenges for Unsupervised Anomaly Detection in Particle Physicscited by 16
- 2021Online-compatible Unsupervised Non-resonant Anomaly Detectioncited by 15
- 2022Lorentz group equivariant autoencoderscited by 15
- 2022Snowmass 2021 Computational Frontier CompF03 Topical Group Report: Machine Learningcited by 10
- 2024Anomaly Detection Based on Isolation Mechanisms: A Surveycited by 10
- 2021Autoencoders for Semivisible Jet Detectioncited by 9
- 2022IRC-safe Graph Autoencoder for unsupervised anomaly detectioncited by 8
- 2022Neural Embedding: Learning the Embedding of the Manifold of Physics Datacited by 7
12 most cited of 30 All 30 (JSON)
- 2026Quantum-Inspired Tensor Network Autoencoders for Anomaly Detection: A MERA-Based Approach8 Apr 2026
- 2025Fast reconstruction-based ROI triggering via anomaly detection in the CYGNO optical TPC30 Dec 2025
- 2025AutoSciDACT: Automated Scientific Discovery through Contrastive Embedding and Hypothesis Testing24 Oct 2025
- 2025A Generative Model for Disentangling Galaxy Photometric Parameters21 Jul 2025
- 2025TRANSIT your events into a new mass: Fast background interpolation for weakly-supervised anomaly searches6 Mar 2025
- 2024A comprehensive GeoAI review: Progress, Challenges and Outlooks16 Dec 2024
- 2024Generating Physical Dynamics under Priors1 Sep 2024
- 2024A Data Mining-Based Dynamical Anomaly Detection Method for Integrating with an Advance Metering System4 May 2024
- 2024AD-NEv++ : The multi-architecture neuroevolution-based multivariate anomaly detection framework25 Mar 2024
- 2024Anomaly Detection Based on Isolation Mechanisms: A Survey16 Mar 2024
- 2023Comparative Evaluation of Anomaly Detection Methods for Fraud Detection in Online Credit Card Payments21 Dec 2023
- 2023Machine Learning for Anomaly Detection in Particle Physics20 Dec 2023
12 newest of 30 All 30 (JSON)