The Dark Machines Anomaly Score Challenge: Benchmark Data and Model Independent Event Classification for the Large Hadron Collider
Not on the map. Why?
Abstract (arXiv)
We describe the outcome of a data challenge conducted as part of the Dark Machines Initiative and the Les Houches 2019 workshop on Physics at TeV colliders. The challenged aims at detecting signals of new physics at the LHC using unsupervised machine learning algorithms. First, we propose how an anomaly score could be implemented to define model-independent signal regions in LHC searches. We define and describe a large benchmark dataset, consisting of >1 Billion simulated LHC events corresponding to 10~rmfb-1 of proton-proton collisions at a center-of-mass energy of 13 TeV. We then review a wide range of anomaly detection and density estimation algorithms, developed in the context of the data challenge, and we measure their performance in a set of realistic analysis environments. We draw a number of useful conclusions that will aid the development of unsupervised new physics searches during the third run of the LHC, and provide our benchmark dataset for future studies at https://www.phenoMLdata.org. Code to reproduce the analysis is provided at https://github.com/bostdiek/DarkMachines-UnsupervisedChallenge.
Key facts. Cited by 29 papers in the map (data through 14 Oct 2026). Builds on 24 of its 116 references that are in the map. First posted on arXiv 28 May 2021.
Builds on
24 of 116 references.
References · 24
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2013Auto-Encoding Variational Bayescited by 4,053
- 2015Variational Inference with Normalizing Flowscited by 2,170
- 2017Deep Setscited by 1,421
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,070
- 2016Improving Variational Inference with Inverse Autoregressive Flowcited by 640
- 2016Adversarial Feature Learningcited by 350
- 2015MADE: Masked Autoencoder for Distribution Estimationcited by 307
- 2016Adversarially Learned Inferencecited by 216
- 2018Adversarially Learned Anomaly Detectioncited by 115
- 2018Energy Flow Networks: Deep Sets for Particle Jetscited by 84
- 2018Sylvester Normalizing Flows for Variational Inferencecited by 72
12 more
- 2020Anomaly Detection with Density Estimationcited by 72
- 2019Deep Set Prediction Networkscited by 71
- 2019FSPool: Learning Set Representations with Featurewise Sort Poolingcited by 53
- 2017Classification without labels: Learning from mixed samples in high energy physicscited by 43
- 2018Variational Autoencoders for New Physics Mining at the Large Hadron Collidercited by 41
- 2017Weakly Supervised Classification in High Energy Physicscited by 21
- 2021Topological Obstructions to Autoencodingcited by 20
- 2019Nonparametric Density Estimation for High-Dimensional Data - Algorithms and Applicationscited by 18
- 2020Adversarially Learned Anomaly Detection on CMS Open Data: re-discovering the top quarkcited by 18
- 2018Learning to Classify from Impure Samples with High-Dimensional Datacited by 8
- 2017(Machine) Learning to Do More with Lesscited by 7
- 2017Convolutional Normalizing Flowscited by 2
Built on by
Citing papers per year: 2021: 7; 2022: 3; 2023: 10; 2024: 1; 2025: 5; 2026: 3.
29 papers.
Sort:
By area:
- 2021Machine Learning in the Search for New Fundamental Physicscited by 50
- 2023Machine Learning for Anomaly Detection in Particle Physicscited by 30
- 2023PC-JeDi: Diffusion for Particle Cloud Generation in High Energy Physicscited by 27
- 2022Learning new physics efficiently with nonparametric methodscited by 21
- 2023Quantum anomaly detection in the latent space of proton collision events at the LHCcited by 21
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Reviewcited by 18
- 2021Challenges for Unsupervised Anomaly Detection in Particle Physicscited by 16
- 2021Online-compatible Unsupervised Non-resonant Anomaly Detectioncited by 15
- 2025Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Modelscited by 14
- 2023High-dimensional and Permutation Invariant Anomaly Detectioncited by 12
- 2023Anomalies, Representations, and Self-Supervisioncited by 11
- 2023CURTAINs Flows For Flows: Constructing Unobserved Regions with Maximum Likelihood Estimationcited by 10
17 more
- 2023Improving new physics searches with diffusion models for event observables and jet constituentscited by 10
- 2021Autoencoders for Semivisible Jet Detectioncited by 9
- 2023Unravelling physics beyond the standard model with classical and quantum anomaly detectioncited by 9
- 2021New Methods and Datasets for Group Anomaly Detection From Fundamental Physicscited by 6
- 2022Benchmarking energy consumption and latency for neuromorphic computing in condensed matter and particle physicscited by 5
- 2021Shared Data and Algorithms for Deep Learning in Fundamental Physicscited by 4
- 2021Funnels: Exact maximum likelihood with dimensionality reductioncited by 4
- 2022Resonant Anomaly Detection with Multiple Reference Datasetscited by 4
- 2024Universal New Physics Latent Spacecited by 3
- 2025ColliderML: The First Release of an OpenDataDetector High-Luminosity Physics Benchmark Datasetcited by 3
- 2026Model-Agnostic Signal Discovery with Machine Learning: Bridging the Gap Between Theory and Practicecited by 3
- 2023Decorrelation using Optimal Transportcited by 0
- 2025TRANSIT your events into a new mass: Fast background interpolation for weakly-supervised anomaly searchescited by 0
- 2025Generator Based Inference (GBI)cited by 0
- 2025SparsePixels: Efficient Convolution for Sparse Data on FPGAscited by 0
- 2026Contrastive Learning for Interpretable Anomaly Detection at Collider Experimentscited by 0
- 2026Local Diagnostics of Learned Event Representations for Anomaly Detection at the HL-LHCcited by 0
- 2026Local Diagnostics of Learned Event Representations for Anomaly Detection at the HL-LHC9 Oct 2026
- 2026Contrastive Learning for Interpretable Anomaly Detection at Collider Experiments13 Aug 2026
- 2026Model-Agnostic Signal Discovery with Machine Learning: Bridging the Gap Between Theory and Practice29 May 2026
- 2025ColliderML: The First Release of an OpenDataDetector High-Luminosity Physics Benchmark Dataset17 Dec 2025
- 2025SparsePixels: Efficient Convolution for Sparse Data on FPGAs5 Dec 2025
- 2025Generator Based Inference (GBI)30 May 2025
- 2025TRANSIT your events into a new mass: Fast background interpolation for weakly-supervised anomaly searches6 Mar 2025
- 2025Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Models9 Jan 2025
- 2024Universal New Physics Latent Space29 Jul 2024
- 2023Machine Learning for Anomaly Detection in Particle Physics20 Dec 2023
- 2023Improving new physics searches with diffusion models for event observables and jet constituents15 Dec 2023
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Review15 Dec 2023
17 more
- 2023Decorrelation using Optimal Transport11 Jul 2023
- 2023High-dimensional and Permutation Invariant Anomaly Detection6 Jun 2023
- 2023CURTAINs Flows For Flows: Constructing Unobserved Regions with Maximum Likelihood Estimation8 May 2023
- 2023PC-JeDi: Diffusion for Particle Cloud Generation in High Energy Physics9 Mar 2023
- 2023Unravelling physics beyond the standard model with classical and quantum anomaly detection25 Jan 2023
- 2023Quantum anomaly detection in the latent space of proton collision events at the LHC25 Jan 2023
- 2023Anomalies, Representations, and Self-Supervision11 Jan 2023
- 2022Resonant Anomaly Detection with Multiple Reference Datasets20 Dec 2022
- 2022Benchmarking energy consumption and latency for neuromorphic computing in condensed matter and particle physics21 Sep 2022
- 2022Learning new physics efficiently with nonparametric methods5 Apr 2022
- 2021Funnels: Exact maximum likelihood with dimensionality reduction15 Dec 2021
- 2021Machine Learning in the Search for New Fundamental Physics7 Dec 2021
- 2021Autoencoders for Semivisible Jet Detection6 Dec 2021
- 2021Online-compatible Unsupervised Non-resonant Anomaly Detection11 Nov 2021
- 2021Challenges for Unsupervised Anomaly Detection in Particle Physics13 Oct 2021
- 2021New Methods and Datasets for Group Anomaly Detection From Fundamental Physics6 Jul 2021
- 2021Shared Data and Algorithms for Deep Learning in Fundamental Physics1 Jul 2021
- 2021Machine Learning in the Search for New Fundamental Physicscited by 50
- 2023Machine Learning for Anomaly Detection in Particle Physicscited by 30
- 2023PC-JeDi: Diffusion for Particle Cloud Generation in High Energy Physicscited by 27
- 2022Learning new physics efficiently with nonparametric methodscited by 21
- 2023Quantum anomaly detection in the latent space of proton collision events at the LHCcited by 21
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Reviewcited by 18
- 2021Challenges for Unsupervised Anomaly Detection in Particle Physicscited by 16
- 2021Online-compatible Unsupervised Non-resonant Anomaly Detectioncited by 15
- 2025Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Modelscited by 14
- 2023High-dimensional and Permutation Invariant Anomaly Detectioncited by 12
- 2023Anomalies, Representations, and Self-Supervisioncited by 11
- 2023CURTAINs Flows For Flows: Constructing Unobserved Regions with Maximum Likelihood Estimationcited by 10
12 most cited of 28 All 28 (JSON)
- 2026Local Diagnostics of Learned Event Representations for Anomaly Detection at the HL-LHC9 Oct 2026
- 2026Contrastive Learning for Interpretable Anomaly Detection at Collider Experiments13 Aug 2026
- 2026Model-Agnostic Signal Discovery with Machine Learning: Bridging the Gap Between Theory and Practice29 May 2026
- 2025ColliderML: The First Release of an OpenDataDetector High-Luminosity Physics Benchmark Dataset17 Dec 2025
- 2025SparsePixels: Efficient Convolution for Sparse Data on FPGAs5 Dec 2025
- 2025Generator Based Inference (GBI)30 May 2025
- 2025TRANSIT your events into a new mass: Fast background interpolation for weakly-supervised anomaly searches6 Mar 2025
- 2025Large Physics Models: Towards a collaborative approach with Large Language Models and Foundation Models9 Jan 2025
- 2024Universal New Physics Latent Space29 Jul 2024
- 2023Machine Learning for Anomaly Detection in Particle Physics20 Dec 2023
- 2023Deep Generative Models for Detector Signature Simulation: A Taxonomic Review15 Dec 2023
- 2023Decorrelation using Optimal Transport11 Jul 2023
12 newest of 28 All 28 (JSON)