mlsanityData to 7 Oct 2026

Neural Networks Asymptotic Behaviours for the Resolution of Inverse Problems

arXiv 2402.09338 ↗First posted 14 Feb 2024physics.comp-ph cs.AI hep-latcited by 0

Not on the map. Why?

Abstract (arXiv)

This paper presents a study of the effectiveness of Neural Network (NN) techniques for deconvolution inverse problems relevant for applications in Quantum Field Theory, but also in more general contexts. We consider NN's asymptotic limits, corresponding to Gaussian Processes (GPs), where non-linearities in the parameters of the NN can be neglected. Using these resulting GPs, we address the deconvolution inverse problem in the case of a quantum harmonic oscillator simulated through Monte Carlo techniques on a lattice. In this simple toy model, the results of the inversion can be compared with the known analytical solution. Our findings indicate that solving the inverse problem with a NN yields less performing results than those obtained using the GPs derived from NN's asymptotic limits. Furthermore, we observe the trained NN's accuracy approaching that of GPs with increasing layer width. Notably, one of these GPs defies interpretation as a probabilistic model, offering a novel perspective compared to established methods in the literature. Our results suggest the need for detailed studies of the training dynamics in more realistic set-ups.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 35 references that are in the map. First posted on arXiv 14 Feb 2024.

Builds on

14 of 35 references.

References · 14

  1. 2018Neural Tangent Kernel: Convergence and Generalization in Neural Networkscited by 2,597
  2. 2019Wide Neural Networks of Any Depth Evolve as Linear Models Under Gradient Descentcited by 732
  3. 2017Deep Neural Networks as Gaussian Processescited by 617
  4. 2018Gaussian Process Behaviour in Wide Deep Neural Networkscited by 314
  5. 2016Exponential expressivity in deep neural networks through transient chaoscited by 260
  6. 2016Deep Information Propagationcited by 194
  7. 2018Bayesian Deep Convolutional Networks with Many Channels are Gaussian Processescited by 164
  8. 2017Mean Field Residual Networks: On the Edge of Chaoscited by 83
  9. 2022Applications of Machine Learning to Lattice Quantum Field Theorycited by 14
  10. 2021Machine learning spectral functions in lattice QCDcited by 6
  11. 2021Reconstructing spectral functions via automatic differentiationcited by 5
  12. 2019Exascale Deep Learning for Scientific Inverse Problemscited by 3
2 more
  1. 2021Automatic differentiation approach for reconstructing spectral functions with neural networkscited by 3
  2. 2022Neural network approach to reconstructing spectral functions and complex poles of confined particlescited by 1

Built on by

Not cited yet.