# On Optimizing Hyperparameters for Quantum Neural Networks

arXiv: https://arxiv.org/abs/2403.18579 · HTML: https://mlsanity.com/paper/2403.18579/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 21 of its 64 references that are in the map.
- First posted on arXiv 27 Mar 2024.

## Builds on (most cited first, 21 of 21)

- [Llama 2: Open Foundation and Fine-Tuned Chat Models](https://mlsanity.com/paper/2307.09288/) (2023)
- [Variational Quantum Algorithms](https://mlsanity.com/paper/2012.09265/) (2020)
- [Supervised learning with quantum enhanced feature spaces](https://mlsanity.com/paper/1804.11326/) (2018)
- [Barren plateaus in quantum neural network training landscapes](https://mlsanity.com/paper/1803.11173/) (2018)
- [The effect of data encoding on the expressive power of variational quantum machine learning models](https://mlsanity.com/paper/2008.08605/) (2020)
- [Noise-Induced Barren Plateaus in Variational Quantum Algorithms](https://mlsanity.com/paper/2007.14384/) (2020)
- [Connecting ansatz expressibility to gradient magnitudes and barren plateaus](https://mlsanity.com/paper/2101.02138/) (2021)
- [Entanglement Induced Barren Plateaus](https://mlsanity.com/paper/2010.15968/) (2020)
- [Better than classical? The subtle art of benchmarking quantum machine learning models](https://mlsanity.com/paper/2403.07059/) (2024)
- [Learning to learn with quantum neural networks via classical neural networks](https://mlsanity.com/paper/1907.05415/) (2019)
- [Universal Approximation Property of Quantum Machine Learning Models in Quantum-Enhanced Feature Spaces](https://mlsanity.com/paper/2009.00298/) (2020)
- [Escaping from the Barren Plateau via Gaussian Initializations in Deep Variational Quantum Circuits](https://mlsanity.com/paper/2203.09376/) (2022)
- [BEINIT: Avoiding Barren Plateaus in Variational Quantum Algorithms](https://mlsanity.com/paper/2204.13751/) (2022)
- [Near-Term Quantum Computing Techniques: Variational Quantum Algorithms, Error Mitigation, Circuit Compilation, Benchmarking and Classical Simulation](https://mlsanity.com/paper/2211.08737/) (2022)
- [Disentangling Hype from Practicality: On Realistically Achieving Quantum Advantage](https://mlsanity.com/paper/2307.00523/) (2023)
- [Towards AutoQML: A Cloud-Based Automated Circuit Architecture Search Framework](https://mlsanity.com/paper/2202.08024/) (2022)
- [Hyperparameter Importance of Quantum Neural Networks Across Small Datasets](https://mlsanity.com/paper/2206.09992/) (2022)
- [A preprocessing perspective for quantum machine learning classification advantage using NISQ algorithms](https://mlsanity.com/paper/2208.13251/) (2022)
- [Evaluating the Performance of Some Local Optimizers for Variational Quantum Classifiers](https://mlsanity.com/paper/2102.08949/) (2021)
- [Quantum Machine Learning Applied to the Classification of Diabetes](https://mlsanity.com/paper/2301.00109/) (2022)
- [Quantum speedups of some general-purpose numerical optimisation algorithms](https://mlsanity.com/paper/2004.06521/) (2020)

## Built on by (most cited first, 1 of 1)

- [Exploring Channel Distinguishability in Local Neighborhoods of the Model Space in Quantum Neural Networks](https://mlsanity.com/paper/2410.09470/) (2024)

## Abstract (arXiv)

The increasing capabilities of Machine Learning (ML) models go hand in hand with an immense amount of data and computational power required for training. Therefore, training is usually outsourced into HPC facilities, where we have started to experience limits in scaling conventional HPC hardware, as theorized by Moore's law. Despite heavy parallelization and optimization efforts, current state-of-the-art ML models require weeks for training, which is associated with an enormous CO2 footprint. Quantum Computing, and specifically Quantum Machine Learning (QML), can offer significant theoretical speed-ups and enhanced expressive power. However, training QML models requires tuning various hyperparameters, which is a nontrivial task and suboptimal choices can highly affect the trainability and performance of the models. In this study, we identify the most impactful hyperparameters and collect data about the performance of QML models. We compare different configurations and provide researchers with performance data and concrete suggestions for hyperparameter selection.
