NCoder -- A Quantum Field Theory approach to encoding data
Not on the map. Why?
Abstract (arXiv)
In this paper we present a novel approach to interpretable AI inspired by Quantum Field Theory (QFT) which we call the NCoder. The NCoder is a modified autoencoder neural network whose latent layer is prescribed to be a subset of n-point correlation functions. Regarding images as draws from a lattice field theory, this architecture mimics the task of perturbatively constructing the effective action of the theory order by order in an expansion using Feynman diagrams. Alternatively, the NCoder may be regarded as simulating the procedure of statistical inference whereby high dimensional data is first summarized in terms of several lower dimensional summary statistics (here the n-point correlation functions), and subsequent out-of-sample data is generated by inferring the data generating distribution from these statistics. In this way the NCoder suggests a fascinating correspondence between perturbative renormalizability and the sufficiency of models. We demonstrate the efficacy of the NCoder by applying it to the generation of MNIST images, and find that generated images can be correctly classified using only information from the first three n-point functions of the image distribution.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Builds on 14 of its 48 references that are in the map. First posted on arXiv 1 Feb 2024.
Builds on
14 of 48 references.
References · 14
- 2017Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithmscited by 4,283
- 2014Deep Learning in Neural Networks: An Overviewcited by 765
- 2016Tutorial on Variational Autoencoderscited by 404
- 2018An elementary introduction to information geometrycited by 76
- 2020Neural Networks and Quantum Field Theorycited by 58
- 2021Symmetry-via-Duality: Invariant Neural Network Densities from Parameter-Space Correlatorscited by 28
- 2021Building Quantum Field Theories Out of Neuronscited by 27
- 2023Neural Network Field Theories: Non-Gaussianity, Actions, and Localitycited by 21
- 2023Bayesian Renormalizationcited by 13
- 2022Decomposing neural networks as mappings of correlation functionscited by 12
- 2022The Inverse of Exact Renormalization Group Flows as Statistical Inferencecited by 11
- 2022Renormalization in the neural network-quantum field theory correspondencecited by 7
2 more
- 2023Learning from Topology: Cosmological Parameter Estimation from the Large-scale Structurecited by 2
- 2022Far from Asymptopiacited by 1
Built on by
Citing papers per year: 2024: 2; 2025: 3; 2026: 2.
7 papers.
- 2024Bayesian RG Flow in Neural Network Field Theoriescited by 9
- 2024Wilsonian Renormalization of Neural Network Gaussian Processescited by 8
- 2025Fermions and Supersymmetry in Neural Network Field Theoriescited by 5
- 2026Towards Worst-Case Guarantees with Scale-Aware Interpretabilitycited by 3
- 2025Grokking vs. Learning: Same Features, Different Encodingscited by 2
- 2025Quantum Topological Graph Neural Networks for Detecting Complex Fraud Patternscited by 0
- 2026Optimal Pruning for Neural Architectures using Fisher Information Distancescited by 0
- 2026Optimal Pruning for Neural Architectures using Fisher Information Distances14 Sep 2026
- 2026Towards Worst-Case Guarantees with Scale-Aware Interpretability5 Feb 2026
- 2025Quantum Topological Graph Neural Networks for Detecting Complex Fraud Patterns3 Dec 2025
- 2025Fermions and Supersymmetry in Neural Network Field Theories20 Nov 2025
- 2025Grokking vs. Learning: Same Features, Different Encodings3 Feb 2025
- 2024Bayesian RG Flow in Neural Network Field Theories27 May 2024
- 2024Wilsonian Renormalization of Neural Network Gaussian Processes9 May 2024