mlsanityData to 7 Oct 2026

Training-efficient density quantum machine learning

arXiv 2405.20237 ↗First posted 30 May 2024quant-ph cs.AI cs.LGcited by 10

Not on the map. Why?

Abstract (arXiv)

Quantum machine learning (QML) requires powerful, flexible and efficiently trainable models to be successful in solving challenging problems. We introduce density quantum neural networks, a model family that prepares mixtures of trainable unitaries, with a distributional constraint over coefficients. This framework balances expressivity and efficient trainability, especially on quantum hardware. For expressivity, the Hastings-Campbell Mixing lemma converts benefits from linear combination of unitaries into density models with similar performance guarantees but shallower circuits. For trainability, commuting-generator circuits enable density model construction with efficiently extractable gradients. The framework connects to various facets of QML including post-variational and measurement-based learning. In classical settings, density models naturally integrate the mixture of experts formalism, and offer natural overfitting mitigation. The framework is versatile - we uplift several quantum models into density versions to improve model performance, or trainability, or both. These include Hamming weight-preserving and equivariant models, among others. Extensive numerical experiments validate our findings.

Key facts. Cited by 10 papers in the map (data through 7 Oct 2026). Builds on 49 of its 112 references that are in the map. First posted on arXiv 30 May 2024.

Builds on

49 of 112 references.

References · 49

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
  4. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  5. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  6. 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
  7. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  8. 2024Mixtral of Expertscited by 1,785
  9. 2014Deep Learning in Neural Networks: An Overviewcited by 765
  10. 2021Scaling Vision with Sparse Mixture of Expertscited by 740
  11. 2017Mastering Chess and Shogi by Self-Play with a General Reinforcement Learning Algorithmcited by 723
  12. 2020Variational Quantum Algorithmscited by 687
37 more
  1. 2018Barren plateaus in quantum neural network training landscapescited by 624
  2. 2019Parameterized quantum circuits as machine learning modelscited by 330
  3. 2020The effect of data encoding on the expressive power of variational quantum machine learning modelscited by 328
  4. 2013Learning Factored Representations in a Deep Mixture of Expertscited by 275
  5. 2020Predicting Many Properties of a Quantum System from Very Few Measurementscited by 229
  6. 2021Generalization in quantum machine learning from few training datacited by 214
  7. 2023Challenges and Opportunities in Quantum Machine Learningcited by 202
  8. 2021Supervised quantum machine learning models are kernel methodscited by 199
  9. 2021Connecting ansatz expressibility to gradient magnitudes and barren plateauscited by 180
  10. 2022On the Representation Collapse of Sparse Mixture of Expertscited by 156
  11. 2021Theory of overparametrization in quantum neural networkscited by 100
  12. 2021Quantum machine learning beyond kernel methodscited by 91
  13. 2018Differentiable Learning of Quantum Circuit Born Machinecited by 90
  14. 2015Distributed Gaussian Processescited by 84
  15. 2023Does provable absence of barren plateaus imply classical simulability?cited by 78
  16. 2019The Born Supremacy: Quantum Advantage and Training of an Ising Born Machinecited by 75
  17. 2020TensorFlow Quantum: A Software Framework for Quantum Machine Learningcited by 72
  18. 2022Theory for Equivariant Quantum Neural Networkscited by 60
  19. 2019Stochastic gradient descent for hybrid quantum-classical optimizationcited by 59
  20. 2019Learning to learn with quantum neural networks via classical neural networkscited by 55
  21. 2022Quantum Vision Transformerscited by 48
  22. 2015Generative Image Modeling Using Spatial LSTMscited by 35
  23. 2017Information Perspective to Probabilistic Modeling: Boltzmann Machines versus Born Machinescited by 33
  24. 2023On quantum backpropagation, information reuse, and cheating measurement collapsecited by 32
  25. 2023Shadows of quantum machine learningcited by 31
  26. 2019Quantum Hamiltonian-Based Models and the Variational Quantum Thermalizer Algorithmcited by 27
  27. 2022projUNN: efficient method for training deep networks with unitary matricescited by 27
  28. 2023Quantum Deep Hedgingcited by 22
  29. 2019Optimizing quantum heuristics with meta-learningcited by 17
  30. 2020Data Normalization for Bilinear Structures in High-Frequency Financial Time-seriescited by 16
  31. 2023Improved Financial Forecasting via Quantum Machine Learningcited by 14
  32. 2022Sparse Mixers: Combining MoE and Mixing to build a more efficient BERTcited by 12
  33. 2022Quantum machine learning with subspace statescited by 11
  34. 2022Overfitting in quantum machine learning and entangling dropoutcited by 9
  35. 2023Variational measurement-based quantum computation for generative modelingcited by 6
  36. 2023Post-variational quantum neural networkscited by 3
  37. 2021Parallelized Computation and Backpropagation Under Angle-Parametrized Orthogonal Matricescited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 6.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025QMoE: A Quantum Mixture of Experts Framework for Scalable Quantum Neural Networks
  2. 2025Quantum Machine Learning: A Hands-on Tutorial for Machine Learning Practitioners and Researchers
  3. 2026Latent-Conditioned Parameterized Quantum Circuits as Universal Approximators for Distributions over Quantum States
  4. 2023Generative quantum machine learning via denoising diffusion probabilistic models
  5. 2026When Quantum Meets AI: Quantum Methods for Machine Learning and Machine Learning Methods for Quantum Systems
  6. 2023Generative Learning of Continuous Data by Tensor Networks
  7. 2023MNISQ: A Large-Scale Quantum Circuit Dataset for Machine Learning on/for Quantum Computers in the NISQ era
  8. 2025Wavefunction Flows: Efficient Quantum Simulation of Continuous Flow Models