mlsanityData to 7 Oct 2026

Hybrid Quantum Vision Transformers for Event Classification in High Energy Physics

arXiv 2402.00776 ↗First posted 1 Feb 2024quant-ph cs.LG hep-phcited by 10

Not on the map. Why?

Abstract (arXiv)

Models based on vision transformer architectures are considered state-of-the-art when it comes to image classification tasks. However, they require extensive computational resources both for training and deployment. The problem is exacerbated as the amount and complexity of the data increases. Quantum-based vision transformer models could potentially alleviate this issue by reducing the training and operating time while maintaining the same predictive power. Although current quantum computers are not yet able to perform high-dimensional tasks yet, they do offer one of the most efficient solutions for the future. In this work, we construct several variations of a quantum hybrid vision transformer for a classification problem in high energy physics (distinguishing photons and electrons in the electromagnetic calorimeter). We test them against classical vision transformer architectures. Our findings indicate that the hybrid models can achieve comparable performance to their classical analogues with a similar number of parameters.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 1 Feb 2024.

Builds on

17 of 36 references.

References · 17

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  5. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
  6. 2020Big Bird: Transformers for Longer Sequencescited by 1,673
  7. 2020Reformer: The Efficient Transformercited by 1,658
  8. 2020Rethinking Attention with Performerscited by 1,584
  9. 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
  10. 2021Nystr"omformer: A Nystr"om-Based Algorithm for Approximating Self-Attentioncited by 468
  11. 2021Random Feature Attentioncited by 350
  12. 2021A Practical Survey on Faster and Lighter Transformerscited by 73
5 more
  1. 2022Quantum Self-Attention Neural Networks for Text Classificationcited by 42
  2. 2022FlexiBERT: Are Current Transformer Architectures too Homogeneous and Rigid?cited by 12
  3. 2021Value-aware Approximate Attentioncited by 5
  4. 2023NoisyNN: Exploring the Impact of Information Entropy Change in Learning Systemscited by 5
  5. 2022ANNA: Enhanced Language Representation for Question Answeringcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 7; 2025: 2; 2026: 1.

10 papers.