mlsanityData to 14 Oct 2026

Deep Neural Networks as the Semi-classical Limit of Topological Quantum Neural Networks: The problem of generalisation

arXiv 2210.13741 ↗First posted 25 Oct 2022quant-ph cs.CG cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Deep Neural Networks miss a principled model of their operation. A novel framework for supervised learning based on Topological Quantum Field Theory that looks particularly well suited for implementation on quantum processors has been recently explored. We propose using this framework to understand the problem of generalisation in Deep Neural Networks. More specifically, in this approach, Deep Neural Networks are viewed as the semi-classical limit of Topological Quantum Neural Networks. A framework of this kind explains the overfitting behavior of Deep Neural Networks during the training step and the corresponding generalisation capabilities. We explore the paradigmatic case of the perceptron, which we implement as the semiclassical limit of Topological Quantum Neural Networks. We apply a novel algorithm we developed, showing that it obtains similar results to standard neural networks, but without the need for training (optimisation).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 87 references that are in the map. First posted on arXiv 25 Oct 2022.

Builds on

22 of 87 references.

References · 22

  1. 2018The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networkscited by 2,262
  2. 2016Understanding deep learning requires rethinking generalizationcited by 1,674
  3. 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,352
  4. 2017A Closer Look at Memorization in Deep Networkscited by 942
  5. 2018Reconciling modern machine learning practice and the bias-variance trade-offcited by 927
  6. 2017Exploring Generalization in Deep Learningcited by 600
  7. 2017Computing Nonvacuous Generalization Bounds for Deep (Stochastic) Neural Networks with Many More Parameters than Training Datacited by 533
  8. 2017Opening the Black Box of Deep Neural Networks via Informationcited by 503
  9. 2017Sharp Minima Can Generalize For Deep Netscited by 466
  10. 2014In Search of the Real Inductive Bias: On the Role of Implicit Regularization in Deep Learningcited by 342
  11. 2017A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networkscited by 314
  12. 2017Train longer, generalize better: closing the generalization gap in large batch training of neural networkscited by 279
10 more
  1. 2021Deep learning: a statistical viewpointcited by 240
  2. 2018To understand deep learning we need to understand kernel learningcited by 187
  3. 2017Generalization and Equilibrium in Generative Adversarial Nets (GANs)cited by 166
  4. 2019Efficient Learning for Deep Quantum Neural Networkscited by 161
  5. 2016Why does deep and cheap learning work so well?cited by 100
  6. 2017Towards Understanding Generalization of Deep Learning: Perspective of Loss Landscapescited by 84
  7. 2017Theory of Deep Learning III: explaining the non-overfitting puzzlecited by 32
  8. 2020Understanding Generalization in Deep Learning via Tensor Methodscited by 14
  9. 2021A free energy principle for generic quantum systemscited by 5
  10. 2017Deep Neural Network Capacitycited by 1

Built on by

Not cited yet.