# Quantum Self-Supervised Learning

arXiv: https://arxiv.org/abs/2103.14653 · HTML: https://mlsanity.com/paper/2103.14653/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- Builds on 26 of its 96 references that are in the map.
- First posted on arXiv 26 Mar 2021.

## Builds on (most cited first, 26 of 26)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [PyTorch: An Imperative Style, High-Performance Deep Learning Library](https://mlsanity.com/paper/1912.01703/) (2019)
- [A Simple Framework for Contrastive Learning of Visual Representations](https://mlsanity.com/paper/2002.05709/) (2020)
- [Representation Learning with Contrastive Predictive Coding](https://mlsanity.com/paper/1807.03748/) (2018)
- [Momentum Contrast for Unsupervised Visual Representation Learning](https://mlsanity.com/paper/1911.05722/) (2019)
- [node2vec: Scalable Feature Learning for Networks](https://mlsanity.com/paper/1607.00653/) (2016)
- [Variational Quantum Algorithms](https://mlsanity.com/paper/2012.09265/) (2020)
- [Data-Efficient Image Recognition with Contrastive Predictive Coding](https://mlsanity.com/paper/1905.09272/) (2019)
- [Supervised learning with quantum enhanced feature spaces](https://mlsanity.com/paper/1804.11326/) (2018)
- [The power of quantum neural networks](https://mlsanity.com/paper/2011.00027/) (2020)
- [Meta Pseudo Labels](https://mlsanity.com/paper/2003.10580/) (2020)
- [Power of data in quantum machine learning](https://mlsanity.com/paper/2011.01938/) (2020)
- [Parameterized quantum circuits as machine learning models](https://mlsanity.com/paper/1906.07682/) (2019)
- [Revisiting Self-Supervised Visual Representation Learning](https://mlsanity.com/paper/1901.09005/) (2019)
- [Variational Quantum Circuits for Deep Reinforcement Learning](https://mlsanity.com/paper/1907.00397/) (2019)
- [Efficient Learning for Deep Quantum Neural Networks](https://mlsanity.com/paper/1902.10445/) (2019)
- [Absence of Barren Plateaus in Quantum Convolutional Neural Networks](https://mlsanity.com/paper/2011.02966/) (2020)
- [Transfer learning in hybrid classical-quantum neural networks](https://mlsanity.com/paper/1912.08278/) (2019)
- [Layerwise learning for quantum neural networks](https://mlsanity.com/paper/2006.14904/) (2020)
- [Recurrent Quantum Neural Networks](https://mlsanity.com/paper/2006.14619/) (2020)
- [Reinforcement Learning with Quantum Variational Circuits](https://mlsanity.com/paper/2008.07524/) (2020)
- [TensorFlow Quantum: A Software Framework for Quantum Machine Learning](https://mlsanity.com/paper/2003.02989/) (2020)
- [Improving Generalization via Scalable Neighborhood Component Analysis](https://mlsanity.com/paper/1808.04699/) (2018)
- [Supervised Quantum Learning without Measurements](https://mlsanity.com/paper/1612.05535/) (2016)
- [Rethinking Recurrent Neural Networks and Other Improvements for Image Classification](https://mlsanity.com/paper/2007.15161/) (2020)

## Built on by (most cited first, 20 of 20)

- [Quantum Architecture Search via Deep Reinforcement Learning](https://mlsanity.com/paper/2104.07715/) (2021)
- [Variational Quantum Reinforcement Learning via Evolutionary Optimization](https://mlsanity.com/paper/2109.00540/) (2021)
- [QSAN: A Near-term Achievable Quantum Self-Attention Network](https://mlsanity.com/paper/2207.07563/) (2022)
- [Quantum Architecture Search via Continual Reinforcement Learning](https://mlsanity.com/paper/2112.05779/) (2021)
- [Let Quantum Neural Networks Choose Their Own Frequencies](https://mlsanity.com/paper/2309.03279/) (2023)
- [Problem-Dependent Power of Quantum Neural Networks on Multi-Class Classification](https://mlsanity.com/paper/2301.01597/) (2022)
- [Reservoir Computing via Quantum Recurrent Neural Networks](https://mlsanity.com/paper/2211.02612/) (2022)
- [A Leap among Quantum Computing and Quantum Neural Networks: A Survey](https://mlsanity.com/paper/2107.03313/) (2021)
- [What can we learn from quantum convolutional neural networks?](https://mlsanity.com/paper/2308.16664/) (2023)
- [Quark: A Gradient-Free Quantum Learning Framework for Classification Tasks](https://mlsanity.com/paper/2210.01311/) (2022)
- [Quantum Hamiltonian Embedding of Images for Data Reuploading Classifiers](https://mlsanity.com/paper/2407.14055/) (2024)
- [CopyQNN: Quantum Neural Network Extraction Attack under Varying Quantum Noise](https://mlsanity.com/paper/2504.00366/) (2025)
- [MerLin: A Discovery Engine for Photonic and Hybrid Quantum Machine Learning](https://mlsanity.com/paper/2602.11092/) (2026)
- [Optimizing Quantum Convolutional Neural Network Architectures for Arbitrary Data Dimension](https://mlsanity.com/paper/2403.19099/) (2024)
- [Expressivity of deterministic quantum computation with one qubit](https://mlsanity.com/paper/2411.02751/) (2024)
- [Quantum Rationale-Aware Graph Contrastive Learning for Jet Discrimination](https://mlsanity.com/paper/2411.01642/) (2024)
- [Boosting Classification with Quantum-Inspired Augmentations](https://mlsanity.com/paper/2506.22241/) (2025)
- [HQ-JEPA: Hybrid Quantum Joint-Embedding Predictive Architecture for Cross-Modal Remote Sensing Representation Learning](https://mlsanity.com/paper/2605.31068/) (2026)
- [Mitigating Measurement-Induced Training Instability in Hybrid Quantum Neural Networks for Protein Classification](https://mlsanity.com/paper/2606.22551/) (2026)
- [A Width-Matched Comparison of Hybrid Quantum-Classical Self-Supervised Learning for Fingerprint Recognition](https://mlsanity.com/paper/2609.39172/) (2026)

## Abstract (arXiv)

The resurgence of self-supervised learning, whereby a deep learning model generates its own supervisory signal from the data, promises a scalable way to tackle the dramatically increasing size of real-world data sets without human annotation. However, the staggering computational complexity of these methods is such that for state-of-the-art performance, classical hardware requirements represent a significant bottleneck to further progress. Here we take the first steps to understanding whether quantum neural networks could meet the demand for more powerful architectures and test its effectiveness in proof-of-principle hybrid experiments. Interestingly, we observe a numerical advantage for the learning of visual representations using small-scale quantum neural networks over equivalently structured classical networks, even when the quantum circuits are sampled with only 100 shots. Furthermore, we apply our best quantum model to classify unseen images on the ibmqparis quantum computer and find that current noisy devices can already achieve equal accuracy to the equivalent classical model on downstream tasks.
