E Pluribus Unum Ex Machina: Learning from Many Collider Events at Once
Not on the map. Why?
Abstract (arXiv)
There have been a number of recent proposals to enhance the performance of machine learning strategies for collider physics by combining many distinct events into a single ensemble feature. To evaluate the efficacy of these proposals, we study the connection between single-event classifiers and multi-event classifiers under the assumption that collider events are independent and identically distributed (IID). We show how one can build optimal multi-event classifiers from single-event classifiers, and we also show how to construct multi-event classifiers such that they produce optimal single-event classifiers. This is illustrated for a Gaussian example as well as for classification tasks relevant for searches and measurements at the Large Hadron Collider. We extend our discussion to regression tasks by showing how they can be phrased in terms of parametrized classifiers. Empirically, we find that training a single-event (per-instance) classifier is more effective than training a multi-event (per-ensemble) classifier, as least for the cases we studied, and we relate this fact to properties of the loss function gradient in the two cases. While we did not identify a clear benefit from using multi-event classifiers in the collider context, we speculate on the potential value of these methods in cases involving only approximate independence, as relevant for jet substructure studies.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 22 of its 71 references that are in the map. First posted on arXiv 18 Jan 2021.
Builds on
22 of 71 references.
References · 22
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2013Auto-Encoding Variational Bayescited by 3,980
- 2016Improved Techniques for Training GANscited by 2,938
- 2015Variational Inference with Normalizing Flowscited by 2,161
- 2017Deep Setscited by 1,394
- 2020Flows for simultaneous manifold learning and density estimationcited by 117
- 2015Approximating Likelihood Ratios with Calibrated Discriminative Classifierscited by 87
- 2018Energy Flow Networks: Deep Sets for Particle Jetscited by 83
- 2020Anomaly Detection with Density Estimationcited by 71
- 2018Mining gold from implicit models to improve likelihood-free inferencecited by 60
- 2018Machine Learning in High Energy Physics Community White Papercited by 48
- 2017Classification without labels: Learning from mixed samples in high energy physicscited by 42
10 more
- 2016Parameterized Machine Learning for High-Energy Physicscited by 33
- 2019MadMiner: Machine learning-based inference for particle physicscited by 32
- 2019OmniFold: A Method to Simultaneously Unfold All Observablescited by 31
- 2020Simulation Assisted Likelihood-free Anomaly Detectioncited by 27
- 2018Constraining Effective Field Theories with Machine Learningcited by 26
- 2018A Guide to Constraining Effective Field Theories with Machine Learningcited by 25
- 2019Neural Networks for Full Phase-space Reweighting and Parameter Tuningcited by 20
- 2018JUNIPR: a Framework for Unsupervised Machine Learning in Particle Physicscited by 18
- 2018Likelihood-free inference with an improved cross-entropy estimatorcited by 10
- 2020Parameter Estimation using Neural Networks in the Presence of Detector Effectscited by 6
Built on by
Citing papers per year: 2021: 4; 2022: 4; 2023: 2; 2024: 1; 2025: 3; 2026: 1.
15 papers.
Sort:
- 2021A Living Review of Machine Learning for Particle Physicscited by 77
- 2021CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flowscited by 46
- 2022New directions for surrogate models and differentiable programming for High Energy Physics detector simulationcited by 16
- 2023Learning Likelihood Ratios with Neural Network Classifierscited by 11
- 2021Latent Space Refinement for Deep Generative Modelscited by 10
- 2023Hierarchical Neural Simulation-Based Inference Over Event Ensemblescited by 8
- 2022Resonant Anomaly Detection with Multiple Reference Datasetscited by 4
- 2022Bias and Priors in Machine Learning Calibrations for High Energy Physicscited by 3
- 2022Machine-Learned Exclusion Limits without Binningcited by 3
- 2024Neural Quasiprobabilistic Likelihood Ratio Estimation with Negatively Weighted Datacited by 2
- 2021Towards a method to anticipate dark matter signals with deep learning at the LHCcited by 1
- 2025Discriminative versus Generative Approaches to Simulation-based Inferencecited by 1
- 2026Localizing Global Discrepancies: Marginal Contributions and Contextual Anomaly Detection28 Aug 2026
- 2025Increasing Information Extraction in Low-Signal Regimes via Multiple Instance Learning9 Aug 2025
- 2025BitHEP -- The Limits of Low-Precision ML in HEP4 Apr 2025
- 2025Discriminative versus Generative Approaches to Simulation-based Inference11 Mar 2025
- 2024Neural Quasiprobabilistic Likelihood Ratio Estimation with Negatively Weighted Data14 Oct 2024
- 2023Hierarchical Neural Simulation-Based Inference Over Event Ensembles21 Jun 2023
- 2023Learning Likelihood Ratios with Neural Network Classifiers17 May 2023
- 2022Resonant Anomaly Detection with Multiple Reference Datasets20 Dec 2022
- 2022Machine-Learned Exclusion Limits without Binning9 Nov 2022
- 2022Bias and Priors in Machine Learning Calibrations for High Energy Physics10 May 2022
- 2022New directions for surrogate models and differentiable programming for High Energy Physics detector simulation15 Mar 2022
- 2021CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flows9 Jun 2021
3 more
- 2021A Living Review of Machine Learning for Particle Physicscited by 77
- 2021CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flowscited by 46
- 2022New directions for surrogate models and differentiable programming for High Energy Physics detector simulationcited by 16
- 2023Learning Likelihood Ratios with Neural Network Classifierscited by 11
- 2021Latent Space Refinement for Deep Generative Modelscited by 10
- 2023Hierarchical Neural Simulation-Based Inference Over Event Ensemblescited by 8
- 2022Resonant Anomaly Detection with Multiple Reference Datasetscited by 4
- 2022Bias and Priors in Machine Learning Calibrations for High Energy Physicscited by 3
- 2022Machine-Learned Exclusion Limits without Binningcited by 3
- 2024Neural Quasiprobabilistic Likelihood Ratio Estimation with Negatively Weighted Datacited by 2
- 2021Towards a method to anticipate dark matter signals with deep learning at the LHCcited by 1
- 2025Discriminative versus Generative Approaches to Simulation-based Inferencecited by 1
12 most cited of 15 All 15 (JSON)
- 2026Localizing Global Discrepancies: Marginal Contributions and Contextual Anomaly Detection28 Aug 2026
- 2025Increasing Information Extraction in Low-Signal Regimes via Multiple Instance Learning9 Aug 2025
- 2025BitHEP -- The Limits of Low-Precision ML in HEP4 Apr 2025
- 2025Discriminative versus Generative Approaches to Simulation-based Inference11 Mar 2025
- 2024Neural Quasiprobabilistic Likelihood Ratio Estimation with Negatively Weighted Data14 Oct 2024
- 2023Hierarchical Neural Simulation-Based Inference Over Event Ensembles21 Jun 2023
- 2023Learning Likelihood Ratios with Neural Network Classifiers17 May 2023
- 2022Resonant Anomaly Detection with Multiple Reference Datasets20 Dec 2022
- 2022Machine-Learned Exclusion Limits without Binning9 Nov 2022
- 2022Bias and Priors in Machine Learning Calibrations for High Energy Physics10 May 2022
- 2022New directions for surrogate models and differentiable programming for High Energy Physics detector simulation15 Mar 2022
- 2021CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flows9 Jun 2021
12 newest of 15 All 15 (JSON)