# CaloChallenge 2022: A Community Challenge for Fast Calorimeter Simulation

arXiv: https://arxiv.org/abs/2410.21611 · HTML: https://mlsanity.com/paper/2410.21611/

## Key facts

- Cited by 35 papers in the map (data through 14 Oct 2026).
- Placed in Flow matching, time series and science, one of 14 directions in Diffusion models.
- First posted on arXiv 28 Oct 2024.

## Placed in

- Diffusion models / [Flow matching, time series and science](https://mlsanity.com/diffusion/flow-matching-time-series-and-science/)

## Built on by (most cited first, 30 of 35)

- [Tell What You Hear From What You See -- Video to Audio Generation Through Text](https://mlsanity.com/paper/2411.05679/) (2024)
- [A Lorentz-Equivariant Transformer for All of the LHC](https://mlsanity.com/paper/2411.00446/) (2024)
- [OmniJet-αC: Learning point cloud calorimeter simulations using generative transformers](https://mlsanity.com/paper/2501.05534/) (2025)
- [CaloHadronic: a diffusion model for the generation of hadronic showers](https://mlsanity.com/paper/2506.21720/) (2025)
- [A Scalable Nystrom-Based Kernel Two-Sample Test with Permutations](https://mlsanity.com/paper/2502.13570/) (2025)
- [Scaling laws for amplitude surrogates](https://mlsanity.com/paper/2601.13308/) (2026)
- [Conditioned quantum-assisted deep generative surrogate for particle-calorimeter interactions](https://mlsanity.com/paper/2410.22870/) (2024)
- [Comparing Generative Models with the New Physics Learning Machine](https://mlsanity.com/paper/2508.02275/) (2025)
- [Learning to Validate Generative Models: a Goodness-of-Fit Approach](https://mlsanity.com/paper/2511.09118/) (2025)
- [Forecasting Generative Amplification](https://mlsanity.com/paper/2509.08048/) (2025)
- [SURFing to the Fundamental Limit of Jet Tagging](https://mlsanity.com/paper/2511.15779/) (2025)
- [AI Benchmark Democratization and Carpentry](https://mlsanity.com/paper/2512.11588/) (2025)
- [ColliderML: The First Release of an OpenDataDetector High-Luminosity Physics Benchmark Dataset](https://mlsanity.com/paper/2512.15230/) (2025)
- [AllShowers: One model for all calorimeter showers](https://mlsanity.com/paper/2601.11716/) (2026)
- [Generalizable Foundation Models for Calorimetry via Mixtures-of-Experts and Parameter Efficient Fine Tuning](https://mlsanity.com/paper/2603.28804/) (2026)
- [Extrapolating Jet Radiation with Autoregressive Transformers](https://mlsanity.com/paper/2412.12074/) (2024)
- [An MLCommons Scientific Benchmarks Ontology](https://mlsanity.com/paper/2511.05614/) (2025)
- [A First Full Physics Benchmark for Highly Granular Calorimeter Surrogates](https://mlsanity.com/paper/2511.17293/) (2025)
- [BRICKS: Compositional Neural Markov Kernels for Zero-Shot Radiation-Matter Simulation](https://mlsanity.com/paper/2605.06591/) (2026)
- [Generative Models and Statistical Validation](https://mlsanity.com/paper/2605.30453/) (2026)
- [Interpreting "Interpretability" and Explaining "Explainability" in Machine Learning in Physics](https://mlsanity.com/paper/2606.26228/) (2026)
- [Are We Ready for AI-Driven Discovery? AI Verification Before the Next Fundamental Physics Breakthrough](https://mlsanity.com/paper/2607.10039/) (2026)
- [Prompting Particle Physics: Tokenized Multi-modal Foundation Models for Combinatorially Many Tasks](https://mlsanity.com/paper/2609.31862/) (2026)
- [Zephyr quantum-assisted hierarchical Calo4pQVAE for particle-calorimeter interactions](https://mlsanity.com/paper/2412.04677/) (2024)
- [BitHEP -- The Limits of Low-Precision ML in HEP](https://mlsanity.com/paper/2504.03387/) (2025)
- [Calorimeter Shower Superresolution with Conditional Normalizing Flows: Implementation and Statistical Evaluation](https://mlsanity.com/paper/2603.26813/) (2026)
- [CaloTrilogy: Toward a Breakthrough in One-Step, End-to-End, Physics-Guided Shower Generation for Modern Calorimeters](https://mlsanity.com/paper/2606.04165/) (2026)
- [Learnable cut flow for high energy physics](https://mlsanity.com/paper/2503.22498/) (2025)
- [Generative diffusion model surrogates for mechanistic agent-based biological models](https://mlsanity.com/paper/2505.09630/) (2025)
- [DSS-GAN: Directional State Space GAN with Mamba backbone for Class-Conditional Image Synthesis](https://mlsanity.com/paper/2603.17637/) (2026)

## Abstract (arXiv)

We present the results of the "Fast Calorimeter Simulation Challenge 2022" - the CaloChallenge. We study state-of-the-art generative models on four calorimeter shower datasets of increasing dimensionality, ranging from a few hundred voxels to a few tens of thousand voxels. The 31 individual submissions span a wide range of current popular generative architectures, including Variational AutoEncoders (VAEs), Generative Adversarial Networks (GANs), Normalizing Flows, Diffusion models, and models based on Conditional Flow Matching. We compare all submissions in terms of quality of generated calorimeter showers, as well as shower generation time and model size. To assess the quality we use a broad range of different metrics including differences in 1-dimensional histograms of observables, KPD/FPD scores, AUCs of binary classifiers, and the log-posterior of a multiclass classifier. The results of the CaloChallenge provide the most complete and comprehensive survey of cutting-edge approaches to calorimeter fast simulation to date. In addition, our work provides a uniquely detailed perspective on the important problem of how to evaluate generative models. As such, the results presented here should be applicable for other domains that use generative AI and require fast and faithful generation of samples in a large phase space.
