mlsanityData to 13 Oct 2026

Quantum Vision Transformers for Quark-Gluon Classification

arXiv 2405.10284 ↗First posted 16 May 2024quant-ph cs.LG hep-phcited by 7

Not on the map. Why?

Abstract (arXiv)

We introduce a hybrid quantum-classical vision transformer architecture, notable for its integration of variational quantum circuits within both the attention mechanism and the multi-layer perceptrons. The research addresses the critical challenge of computational efficiency and resource constraints in analyzing data from the upcoming High Luminosity Large Hadron Collider, presenting the architecture as a potential solution. In particular, we evaluate our method by applying the model to multi-detector jet images from CMS Open Data. The goal is to distinguish quark-initiated from gluon-initiated jets. We successfully train the quantum model and evaluate it via numerical simulations. Using this approach, we achieve classification performance almost on par with the one obtained with the completely classical architecture, considering a similar number of parameters.

Key facts. Cited by 7 papers in the map (data through 13 Oct 2026). Builds on 32 of its 67 references that are in the map. First posted on arXiv 16 May 2024.

Builds on

32 of 67 references.

References · 32

  1. 2017Attention Is All You Needcited by 60,106
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,043
  4. 2016Layer Normalizationcited by 5,624
  5. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,170
  6. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,021
  7. 2016Gaussian Error Linear Units (GELUs)cited by 3,472
  8. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,266
  9. 2021How to train your ViT? Data, Augmentation, and Regularization in Vision Transformerscited by 566
  10. 2016Quantum Machine Learningcited by 326
  11. 2020A rigorous and robust quantum speed-up in supervised machine learningcited by 270
  12. 2021Generalization in quantum machine learning from few training datacited by 214
20 more
  1. 2021Quantum advantage in learning from experimentscited by 187
  2. 2022Better plain ViT baselines for ImageNet-1kcited by 98
  3. 2021A Living Review of Machine Learning for Particle Physicscited by 77
  4. 2021The Dawn of Quantum Natural Language Processingcited by 60
  5. 2021Machine Learning in the Search for New Fundamental Physicscited by 50
  6. 2018Machine Learning in High Energy Physics Community White Papercited by 49
  7. 2022Quantum Vision Transformerscited by 48
  8. 2022Quantum Self-Attention Neural Networks for Text Classificationcited by 43
  9. 2013Quantum support vector machine for big data classificationcited by 35
  10. 2017QCD-Aware Recursive Neural Networks for Jet Physicscited by 22
  11. 2022Annotated History of Modern AI and Deep Learningcited by 20
  12. 2017A Survey of Quantum Learning Theorycited by 12
  13. 2019End-to-End Jet Classification of Quarks and Gluons with the CMS Open Datacited by 11
  14. 2017Recursive Neural Networks in Quark/Gluon Taggingcited by 10
  15. 2022Snowmass 2021 Computational Frontier CompF03 Topical Group Report: Machine Learningcited by 10
  16. 2024Hybrid Quantum Vision Transformers for Event Classification in High Energy Physicscited by 10
  17. 2022Is the Machine Smarter than the Theorist: Deriving Formulas for Particle Kinematics with Symbolic Regressioncited by 8
  18. 2023A Comparison Between Invariant and Equivariant Classical and Quantum Graph Neural Networkscited by 6
  19. 2021Machine Learning in Nuclear Physicscited by 4
  20. 2023mathbbZ2× mathbbZ2 Equivariant Quantum Neural Networks: Benchmarking against Classical Neural Networkscited by 4

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2024: 3; 2025: 3; 2026: 1.

7 papers.