Leveraging universality of jet taggers through transfer learning
Not on the map. Why?
Abstract (arXiv)
A significant challenge in the tagging of boosted objects via machine-learning technology is the prohibitive computational cost associated with training sophisticated models. Nevertheless, the universality of QCD suggests that a large amount of the information learnt in the training is common to different physical signals and experimental setups. In this article, we explore the use of transfer learning techniques to develop fast and data-efficient jet taggers that leverage such universality. We consider the graph neural networks LundNet and ParticleNet, and introduce two prescriptions to transfer an existing tagger into a new signal based either on fine-tuning all the weights of a model or alternatively on freezing a fraction of them. In the case of W-boson and top-quark tagging, we find that one can obtain reliable taggers using an order of magnitude less data with a corresponding speed-up of the training process. Moreover, while keeping the size of the training data set fixed, we observe a speed-up of the training by up to a factor of three. This offers a promising avenue to facilitate the use of such tools in collider physics experiments.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 22 of its 92 references that are in the map. First posted on arXiv 11 Mar 2022.
Builds on
22 of 92 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2018Dynamic Graph CNN for Learning on Point Cloudscited by 2,220
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
- 2014How transferable are features in deep neural networks?cited by 1,216
- 2019A Comprehensive Survey on Transfer Learningcited by 1,154
- 2013DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognitioncited by 422
- 2018A Survey on Deep Transfer Learningcited by 417
- 2022Particle Transformer for Jet Taggingcited by 95
- 2019ParticleNet: Jet Tagging via Particle Cloudscited by 64
10 more
- 2021Machine Learning in the Search for New Fundamental Physicscited by 50
- 2015Jet-Images -- Deep Learning Editioncited by 41
- 2020Simulation Assisted Likelihood-free Anomaly Detectioncited by 27
- 2017QCD-Aware Recursive Neural Networks for Jet Physicscited by 22
- 2020Jet tagging in the Lund plane with graph networkscited by 22
- 2016Deep learning in color: towards automated quark/gluon jet discriminationcited by 21
- 2016Intrinsic Geometric Information Transfer Learning on Multiple Graph-Structured Datasetscited by 18
- 2017Recursive Neural Networks in Quark/Gluon Taggingcited by 10
- 2019Interpretable Deep Learning for Two-Prong Jet Classification with Jet Spectracited by 7
- 2018Spectral Analysis of Jet Substructure with Neural Networks: Boosted Higgs Casecited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1; 2025: 2; 2026: 1.
5 papers.
- 2024Finetuning Foundation Models for Joint Analysis Optimizationcited by 18
- 2025Fine-tuning machine-learned particle-flow reconstruction for new detector geometries in future colliderscited by 8
- 2022Jet tagging algorithm of graph network with HaarPooling message passingcited by 3
- 2025Vision Transformers for End-to-End Quark-Gluon Jet Classification from Calorimeter Imagescited by 2
- 2026A Lightweight Foundation Model for Collider Physics with Multi-Domain Adaptationcited by 1
- 2026A Lightweight Foundation Model for Collider Physics with Multi-Domain Adaptation29 Jul 2026
- 2025Vision Transformers for End-to-End Quark-Gluon Jet Classification from Calorimeter Images17 Jun 2025
- 2025Fine-tuning machine-learned particle-flow reconstruction for new detector geometries in future colliders28 Feb 2025
- 2024Finetuning Foundation Models for Joint Analysis Optimization24 Jan 2024
- 2022Jet tagging algorithm of graph network with HaarPooling message passing25 Oct 2022