Hybrid Quantum Vision Transformers for Event Classification in High Energy Physics
Not on the map. Why?
Abstract (arXiv)
Models based on vision transformer architectures are considered state-of-the-art when it comes to image classification tasks. However, they require extensive computational resources both for training and deployment. The problem is exacerbated as the amount and complexity of the data increases. Quantum-based vision transformer models could potentially alleviate this issue by reducing the training and operating time while maintaining the same predictive power. Although current quantum computers are not yet able to perform high-dimensional tasks yet, they do offer one of the most efficient solutions for the future. In this work, we construct several variations of a quantum hybrid vision transformer for a classification problem in high energy physics (distinguishing photons and electrons in the electromagnetic calorimeter). We test them against classical vision transformer architectures. Our findings indicate that the hybrid models can achieve comparable performance to their classical analogues with a similar number of parameters.
Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 17 of its 36 references that are in the map. First posted on arXiv 1 Feb 2024.
Builds on
17 of 36 references.
References · 17
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2020Big Bird: Transformers for Longer Sequencescited by 1,673
- 2020Reformer: The Efficient Transformercited by 1,658
- 2020Rethinking Attention with Performerscited by 1,584
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
- 2021Nystr"omformer: A Nystr"om-Based Algorithm for Approximating Self-Attentioncited by 468
- 2021Random Feature Attentioncited by 350
- 2021A Practical Survey on Faster and Lighter Transformerscited by 73
5 more
- 2022Quantum Self-Attention Neural Networks for Text Classificationcited by 42
- 2022FlexiBERT: Are Current Transformer Architectures too Homogeneous and Rigid?cited by 12
- 2021Value-aware Approximate Attentioncited by 5
- 2023NoisyNN: Exploring the Impact of Information Entropy Change in Learning Systemscited by 5
- 2022ANNA: Enhanced Language Representation for Question Answeringcited by 2
Built on by
Citing papers per year: 2024: 7; 2025: 2; 2026: 1.
10 papers.
- 2024QADQN: Quantum Attention Deep Q-Network for Financial Market Predictioncited by 8
- 2024Quantum Vision Transformers for Quark-Gluon Classificationcited by 7
- 2025Quantum Doubly Stochastic Transformerscited by 6
- 2024Lorentz-Equivariant Quantum Graph Neural Network for High-Energy Physicscited by 4
- 2024Quantum Artificial Intelligence: A Brief Surveycited by 3
- 2024AQ-PINNs: Attention-Enhanced Quantum Physics-Informed Neural Networks for Carbon-Efficient Climate Modelingcited by 3
- 2025QUIET-SR: Quantum Image Enhancement Transformer for Single Image Super-Resolutioncited by 2
- 2024QMViT: A Mushroom is worth 16x16 Wordscited by 0
- 2024Lie-Equivariant Quantum Graph Neural Networkscited by 0
- 2026Quantum Phase Recognition via Quantum Attention Mechanismcited by 0
- 2026Quantum Phase Recognition via Quantum Attention Mechanism31 Jan 2026
- 2025Quantum Doubly Stochastic Transformers22 Apr 2025
- 2025QUIET-SR: Quantum Image Enhancement Transformer for Single Image Super-Resolution11 Mar 2025
- 2024Lie-Equivariant Quantum Graph Neural Networks22 Nov 2024
- 2024Lorentz-Equivariant Quantum Graph Neural Network for High-Energy Physics3 Nov 2024
- 2024AQ-PINNs: Attention-Enhanced Quantum Physics-Informed Neural Networks for Carbon-Efficient Climate Modeling3 Sep 2024
- 2024Quantum Artificial Intelligence: A Brief Survey20 Aug 2024
- 2024QADQN: Quantum Attention Deep Q-Network for Financial Market Prediction6 Aug 2024
- 2024Quantum Vision Transformers for Quark-Gluon Classification16 May 2024
- 2024QMViT: A Mushroom is worth 16x16 Words11 May 2024