Neural Networks Asymptotic Behaviours for the Resolution of Inverse Problems
Not on the map. Why?
Abstract (arXiv)
This paper presents a study of the effectiveness of Neural Network (NN) techniques for deconvolution inverse problems relevant for applications in Quantum Field Theory, but also in more general contexts. We consider NN's asymptotic limits, corresponding to Gaussian Processes (GPs), where non-linearities in the parameters of the NN can be neglected. Using these resulting GPs, we address the deconvolution inverse problem in the case of a quantum harmonic oscillator simulated through Monte Carlo techniques on a lattice. In this simple toy model, the results of the inversion can be compared with the known analytical solution. Our findings indicate that solving the inverse problem with a NN yields less performing results than those obtained using the GPs derived from NN's asymptotic limits. Furthermore, we observe the trained NN's accuracy approaching that of GPs with increasing layer width. Notably, one of these GPs defies interpretation as a probabilistic model, offering a novel perspective compared to established methods in the literature. Our results suggest the need for detailed studies of the training dynamics in more realistic set-ups.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 35 references that are in the map. First posted on arXiv 14 Feb 2024.
Builds on
14 of 35 references.
References · 14
- 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
- 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 732
- 2017Deep Neural Networks as Gaussian Processescited by 617
- 2018Gaussian Process Behaviour in Wide Deep Neural Networkscited by 314
- 2016Exponential expressivity in deep neural networks through transient chaoscited by 260
- 2016Deep Information Propagationcited by 194
- 2018Bayesian Deep Convolutional Networks with Many Channels are Gaussian Processescited by 164
- 2017Mean Field Residual Networks: On the Edge of Chaoscited by 83
- 2022Applications of Machine Learning to Lattice Quantum Field Theorycited by 14
- 2021Machine learning spectral functions in lattice QCDcited by 6
- 2021Reconstructing spectral functions via automatic differentiationcited by 5
- 2019Exascale Deep Learning for Scientific Inverse Problemscited by 3
Built on by
Not cited yet.