Neural Scaling Laws for Boosted Jet Tagging
Not on the map. Why?
Abstract (arXiv)
The success of Large Language Models (LLMs) has established that scaling compute, through joint increases in model capacity and dataset size, is the primary driver of performance in modern machine learning. While machine learning has long been an integral component of High Energy Physics (HEP) data analysis workflows, the compute used to train state-of-the-art HEP models remains orders of magnitude below that of industry foundation models. With scaling laws only beginning to be studied in the field, we investigate neural scaling laws for boosted jet classification using the public JetClass dataset. We derive compute optimal scaling laws and identify an effective performance limit that can be consistently approached through increased compute. We study how data repetition, common in HEP where simulation is expensive, modifies the scaling yielding a quantifiable effective dataset size gain. We then study how the scaling coefficients and asymptotic performance limits vary with the choice of input features and particle multiplicity, demonstrating that increased compute reliably drives performance toward an asymptotic limit, and that more expressive, lower-level features can raise the performance limit and improve results at fixed dataset size.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 21 of its 41 references that are in the map. First posted on arXiv 17 Feb 2026.
Builds on
21 of 41 references.
References · 21
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2020On Layer Normalization in the Transformer Architecturecited by 922
- 2019Deep Double Descent: Where Bigger Models and More Data Hurtcited by 672
- 2023Scaling Data-Constrained Language Modelscited by 403
- 2022Particle Transformer for Jet Taggingcited by 98
- 2024Masked Particle Modeling on Sets: Towards Self-Supervised High Energy Physics Foundation Modelscited by 46
- 2024OmniJet-α: The first cross-task foundation model for particle physicscited by 43
- 2024A Lorentz-Equivariant Transformer for All of the LHCcited by 28
- 2023Explainable Equivariant Neural Networks for Particle Physics: PELICANcited by 24
- 2024Is Tokenization Needed for Masked Particle Modelling?cited by 22
- 2024Finetuning Foundation Models for Joint Analysis Optimizationcited by 18
9 more
- 2024Aspen Open Jets: Unlocking LHC Data for Foundation Models in Particle Physicscited by 14
- 2025OmniJet-αC: Learning point cloud calorimeter simulations using generative transformerscited by 14
- 2026EveNet: A Foundation Model for Particle Collision Data Analysiscited by 9
- 2026Scaling laws for amplitude surrogatescited by 6
- 2025Towards Foundation Models for Experimental Readout Systems Combining Discrete and Continuous Datacited by 5
- 2023Differentiable Vertex Fitting for Jet Flavour Taggingcited by 3
- 2025SURFing to the Fundamental Limit of Jet Taggingcited by 3
- 2025Enhancing next token prediction based pre-training for jet foundation modelscited by 3
- 2025Double Descent and Overparameterization in Particle Physics Datacited by 2
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026Neural Scaling Laws for Jet Generationcited by 4
- 2026Towards Engineering Scaling Laws with Pretraining Data Compositioncited by 2
- 2026Statistical Properties of Training & Generalizationcited by 2
- 2026Prompting Particle Physics: Tokenized Multi-modal Foundation Models for Combinatorially Many Taskscited by 2
- 2026Pre-Training for Simulation-Based Science: A Study on Jet Foundation Model Training Objectivescited by 1
- 2026Scaling Collider Event Generation with Residual-Quantized Tokenscited by 1
- 2026Transfer Learning Across Fast- and Full-Simulation Domains in High-Energy Physicscited by 0
- 2026Velocityformer: Broken-Symmetry-Matched Equivariant Graph Transformers for Cosmological Velocity Reconstructioncited by 0
- 2026Finding and using interpretable latents in a neutrino foundation model with sparse autoencoderscited by 0
- 2026Leveraging Industrial Foundation Models at the Edge of Particle Physics Detectors via Distillation Learning and Hardware Co-designcited by 0
- 2026Machine learning for the LHC physics program: a 2025-2026 stocktakecited by 0
- 2026How to scale your HEP ML models: A recipe for robust architecture comparisons at scalecited by 0
- 2026How to scale your HEP ML models: A recipe for robust architecture comparisons at scale5 Oct 2026
- 2026Scaling Collider Event Generation with Residual-Quantized Tokens30 Sep 2026
- 2026Machine learning for the LHC physics program: a 2025-2026 stocktake26 Sep 2026
- 2026Prompting Particle Physics: Tokenized Multi-modal Foundation Models for Combinatorially Many Tasks25 Sep 2026
- 2026Leveraging Industrial Foundation Models at the Edge of Particle Physics Detectors via Distillation Learning and Hardware Co-design20 Sep 2026
- 2026Finding and using interpretable latents in a neutrino foundation model with sparse autoencoders26 Aug 2026
- 2026Statistical Properties of Training & Generalization18 Jun 2026
- 2026Towards Engineering Scaling Laws with Pretraining Data Composition18 Jun 2026
- 2026Pre-Training for Simulation-Based Science: A Study on Jet Foundation Model Training Objectives12 Jun 2026
- 2026Neural Scaling Laws for Jet Generation27 May 2026
- 2026Velocityformer: Broken-Symmetry-Matched Equivariant Graph Transformers for Cosmological Velocity Reconstruction20 May 2026
- 2026Transfer Learning Across Fast- and Full-Simulation Domains in High-Energy Physics8 May 2026