mlsanityData to 7 Oct 2026

OmniJet-αC: Learning point cloud calorimeter simulations using generative transformers

arXiv 2501.05534 ↗First posted 9 Jan 2025hep-ph cs.LG hep-excited by 14

Not on the map. Why?

Abstract (arXiv)

We show the first use of generative transformers for generating calorimeter showers as point clouds in a high-granularity calorimeter. Using the tokenizer and generative part of the OmniJet-α model, we represent the hits in the detector as sequences of integers. This model allows variable-length sequences, which means that it supports realistic shower development and does not need to be conditioned on the number of hits. Since the tokenization represents the showers as point clouds, the model learns the geometry of the showers without being restricted to any particular voxel grid.

Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 38 of its 80 references that are in the map. First posted on arXiv 9 Jan 2025.

Builds on

38 of 80 references.

References · 38

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  3. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  4. 2017Neural Discrete Representation Learningcited by 4,650
  5. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 3,961
  7. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
  8. 2020Improved Techniques for Training Score-Based Generative Modelscited by 1,036
  9. 2019Lookahead Optimizer: k steps forward, 1 step backcited by 333
  10. 2022Particle Transformer for Jet Taggingcited by 95
  11. 2020Gradient Centralization: A New Optimization Technique for Deep Neural Networkscited by 82
  12. 2023Straightening Out the Straight-Through Estimator: Overcoming Optimization Challenges in Vector Quantized Networkscited by 80
26 more
  1. 2017CaloGAN: Simulating 3D High Energy Particle Showers in Multi-Layer Electromagnetic Calorimeters with Generative Adversarial Networkscited by 78
  2. 2017Accelerating Science with Generative Adversarial Networks: An Application to 3D Particle Showers in Multi-Layer Calorimeterscited by 55
  3. 2022Score-based Generative Models for Calorimeter Shower Simulationcited by 52
  4. 2021CaloFlow: Fast and Accurate Generation of Calorimeter Showers with Normalizing Flowscited by 46
  5. 2024Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Modelscited by 44
  6. 2019Calorimetry with Deep Learning: Particle Simulation and Reconstruction for Collider Physicscited by 42
  7. 2024OmniJet-α: The first cross-task foundation model for particle physicscited by 41
  8. 2024CaloChallenge 2022: A Community Challenge for Fast Calorimeter Simulationcited by 34
  9. 2023CaloClouds: Fast Geometry-Independent Highly-Granular Calorimeter Simulationcited by 33
  10. 2020GANplifying Event Samplescited by 28
  11. 2022CaloMan: Fast generation of calorimeter showers with density estimation on learned manifoldscited by 28
  12. 2024A Lorentz-Equivariant Transformer for All of the LHCcited by 27
  13. 2023Ultra-High-Resolution Detector Simulation with Intra-Event Aware GAN and Self-Supervised Relational Reasoningcited by 25
  14. 2017Controlling Physical Attributes in GAN-Accelerated Simulation of Electromagnetic Calorimeterscited by 23
  15. 2023Inductive Simulation of Calorimeter Showers with Normalizing Flowscited by 22
  16. 2024Re-Simulation-based Self-Supervised Learning for Pre-Training Foundation Modelscited by 21
  17. 2023CaloClouds II: Ultra-Fast Geometry-Independent Highly-Granular Calorimeter Simulationcited by 20
  18. 2022New directions for surrogate models and differentiable programming for High Energy Physics detector simulationcited by 16
  19. 2023Comparison of Point Cloud and Image-based Models for Calorimeter Fast Simulationcited by 16
  20. 2024Calo-VQ: Vector-Quantized Two-Stage Generative Model in Calorimeter Simulationcited by 15
  21. 2022CaloFlow for CaloChallenge Dataset 1cited by 14
  22. 2024Aspen Open Jets: Unlocking LHC Data for Foundation Models in Particle Physicscited by 14
  23. 2024Convolutional L2LFlows: Generating Accurate Showers in Highly Granular Calorimeters Using Convolutional Normalizing Flowscited by 13
  24. 2024Bumblebee: Foundation Model for Particle Physics Discoverycited by 12
  25. 2024Pretrained Event Classification Model for High Energy Physics Analysiscited by 8
  26. 2024Particle identification with machine learning from incomplete data in the ALICE experimentcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 6; 2026: 8.

14 papers.

Sort:

By area:

  1. 2026Neural Scaling Laws for Boosted Jet Taggingcited by 11
  2. 2025Foundation models for high-energy physicscited by 10
  3. 2025Fine-tuning machine-learned particle-flow reconstruction for new detector geometries in future colliderscited by 8
  4. 2025CaloHadronic: a diffusion model for the generation of hadronic showerscited by 8
  5. 2025Towards Foundation Models for Experimental Readout Systems Combining Discrete and Continuous Datacited by 5
  6. 2026AllShowers: One model for all calorimeter showerscited by 3
  7. 2026Generalizable Foundation Models for Calorimetry via Mixtures-of-Experts and Parameter Efficient Fine Tuningcited by 3
  8. 2025A First Full Physics Benchmark for Highly Granular Calorimeter Surrogatescited by 2
  9. 2025Double Descent and Overparameterization in Particle Physics Datacited by 1
  10. 2026Application of a Mixture of Experts-based Foundation Model to the GlueX DIRC Detectorcited by 1
  11. 2026CaloTrilogy: Toward a Breakthrough in One-Step, End-to-End, Physics-Guided Shower Generation for Modern Calorimeterscited by 1
  12. 2026Prompting Particle Physics: Tokenized Multi-modal Foundation Models for Combinatorially Many Taskscited by 1
2 more
  1. 2026GPT-Based Fast Simulation of CLAS12 Detector Hits via Conditional Autoregressive Generationcited by 0
  2. 2026Scaling Collider Event Generation with Residual-Quantized Tokenscited by 0