# Hierarchical Learning for Quantum ML: Novel Training Technique for Large-Scale Variational Quantum Circuits

arXiv: https://arxiv.org/abs/2311.12929 · HTML: https://mlsanity.com/paper/2311.12929/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 7 of its 27 references that are in the map.
- First posted on arXiv 21 Nov 2023.

## Builds on (most cited first, 7 of 7)

- [Barren plateaus in quantum neural network training landscapes](https://mlsanity.com/paper/1803.11173/) (2018)
- [Challenges and Opportunities in Quantum Machine Learning](https://mlsanity.com/paper/2303.09491/) (2023)
- [Noise-Induced Barren Plateaus in Variational Quantum Algorithms](https://mlsanity.com/paper/2007.14384/) (2020)
- [Connecting ansatz expressibility to gradient magnitudes and barren plateaus](https://mlsanity.com/paper/2101.02138/) (2021)
- [Differentiable Learning of Quantum Circuit Born Machine](https://mlsanity.com/paper/1804.04168/) (2018)
- [Trainability barriers and opportunities in quantum generative modeling](https://mlsanity.com/paper/2305.02881/) (2023)
- [Power of Quantum Generative Learning](https://mlsanity.com/paper/2205.04730/) (2022)

## Built on by (most cited first, 5 of 5)

- [Investigating and Mitigating Barren Plateaus in Variational Quantum Circuits: A Survey](https://mlsanity.com/paper/2407.17706/) (2024)
- [Enhancing the Trainability of Variational Quantum Circuits with Regularization Strategies](https://mlsanity.com/paper/2405.01606/) (2024)
- [Large Language Models Can Help Mitigate Barren Plateaus in Quantum Neural Networks](https://mlsanity.com/paper/2502.13166/) (2025)
- [Qvine: Vine Structured Quantum Circuits for Loading High Dimensional Distributions](https://mlsanity.com/paper/2604.26213/) (2026)
- [Hierarchical Fourier Approximation for Variational Quantum Distribution Learning](https://mlsanity.com/paper/2609.06307/) (2026)

## Abstract (arXiv)

We present hierarchical learning, a novel variational architecture for efficient training of large-scale variational quantum circuits. We test and benchmark our technique for distribution loading with quantum circuit born machines (QCBMs). With QCBMs, probability distributions are loaded into the squared amplitudes of computational basis vectors represented by bitstrings. Our key insight is to take advantage of the fact that the most significant (qu)bits have a greater effect on the final distribution and can be learned first. One can think of it as a generalization of layerwise learning, where some parameters of the variational circuit are learned first to prevent the phenomena of barren plateaus. We briefly review adjoint methods for computing the gradient, in particular for loss functions that are not expectation values of observables. We first compare the role of connectivity in the variational ansatz for the task of loading a Gaussian distribution on nine qubits, finding that 2D connectivity greatly outperforms qubits arranged on a line. Based on our observations, we then implement this strategy on large-scale numerical experiments with GPUs, training a QCBM to reproduce a 3-dimensional multivariate Gaussian distribution on 27 qubits up to ~4% total variation distance. Though barren plateau arguments do not strictly apply here due to the objective function not being tied to an observable, this is to our knowledge the first practical demonstration of variational learning on large numbers of qubits. We also demonstrate hierarchical learning as a resource-efficient way to load distributions for existing quantum hardware (IBM's 7 and 27 qubit devices) in tandem with Fire Opal optimizations.
