Better, Faster Fermionic Neural Networks
Not on the map. Why?
Abstract (arXiv)
The Fermionic Neural Network (FermiNet) is a recently-developed neural network architecture that can be used as a wavefunction Ansatz for many-electron systems, and has already demonstrated high accuracy on small systems. Here we present several improvements to the FermiNet that allow us to set new records for speed and accuracy on challenging systems. We find that increasing the size of the network is sufficient to reach chemical accuracy on atoms as large as argon. Through a combination of implementing FermiNet in JAX and simplifying several parts of the network, we are able to reduce the number of GPU hours needed to train the FermiNet on large systems by an order of magnitude. This enables us to run the FermiNet on the challenging transition of bicyclobutane to butadiene and compare against the PauliNet on the automerization of cyclobutadiene, and we achieve results near the state of the art for both.
Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 7; 2023: 5; 2024: 4; 2025: 3; 2026: 4.
28 papers.
Sort:
By area:
- 2022A Self-Attention Ansatz for Ab-initio Quantum Chemistrycited by 45
- 2025El Agente: An Autonomous Agent for Quantum Chemistrycited by 43
- 2021Ab-Initio Potential Energy Surfaces by Pairing GNNs with Neural Wave Functionscited by 36
- 2021Provably Strict Generalisation Benefit for Invariance in Kernel Methodscited by 29
- 2022Ab-initio quantum chemistry with neural-network wavefunctionscited by 28
- 2023Generalizing Neural Wave Functionscited by 26
- 2022Gold-standard solutions to the Schr"odinger equation using deep learning: How much physics do we need?cited by 25
- 2021Solving the electronic Schr"odinger equation for multiple nuclear geometries with weight-sharing deep neural networkscited by 22
- 2022Electronic excited states in deep variational Monte Carlocited by 21
- 2022Sampling-free Inference for Ab-Initio Potential Energy Surface Networkscited by 19
- 2021Ab-initio study of interacting fermions at finite temperature with neural canonical transformationcited by 16
- 2025An ab initio foundation model of wavefunctions that accurately describes chemical bond breakingcited by 11
16 more
- 2023Variational Monte Carlo on a Budget -- Fine-tuning pre-trained Neural Wavefunctionscited by 8
- 2024Neural Pfaffians: Solving Many Many-Electron Schr"odinger Equationscited by 8
- 2025Accurate Ab-initio Neural-network Solutions to Large-Scale Electronic Structure Problemscited by 8
- 2021Rayleigh-Gauss-Newton optimization with enhanced sampling for variational Monte Carlocited by 6
- 2023Towards a Foundation Model for Neural Network Wavefunctionscited by 6
- 2023Forward Laplacian: A New Computational Framework for Neural Network-based Variational Monte Carlocited by 6
- 2022Positive-definite parametrization of mixed quantum states with deep neural networkscited by 4
- 2024Highly Accurate Real-space Electron Densities with Neural Networkscited by 4
- 2023Convergence of variational Monte Carlo simulation and scale-invariant pre-trainingcited by 2
- 2022O(N2) Universal Antisymmetry in Fermionic Neural Networkscited by 1
- 2026Excited Pfaffians: Generalized Neural Wave Functions Across Structure and Statecited by 1
- 2026Implicit Machine Learning Force Fields Accelerate Molecular Dynamics Simulationscited by 1
- 2024Open-Source Fermionic Neural Networks with Ionic Charge Initializationcited by 0
- 2024A Theoretical Framework for an Efficient Normalizing Flow-Based Solution to the Electronic Schrodinger Equationcited by 0
- 2026Uncovering Exotic Paired States in the 2D Spin-Imbalanced Fermi Gas with Neural Wave Functionscited by 0
- 2026Is Variational Monte Carlo Robust? Sharp Moment Thresholds and Heavy-tailed Stochastic Optimizationcited by 0
- 2026Implicit Machine Learning Force Fields Accelerate Molecular Dynamics Simulations31 Jul 2026
- 2026Is Variational Monte Carlo Robust? Sharp Moment Thresholds and Heavy-tailed Stochastic Optimization24 Jun 2026
- 2026Uncovering Exotic Paired States in the 2D Spin-Imbalanced Fermi Gas with Neural Wave Functions27 Apr 2026
- 2026Excited Pfaffians: Generalized Neural Wave Functions Across Structure and State15 Mar 2026
- 2025An ab initio foundation model of wavefunctions that accurately describes chemical bond breaking24 Jun 2025
- 2025El Agente: An Autonomous Agent for Quantum Chemistry5 May 2025
- 2025Accurate Ab-initio Neural-network Solutions to Large-Scale Electronic Structure Problems8 Apr 2025
- 2024Highly Accurate Real-space Electron Densities with Neural Networks2 Sep 2024
- 2024A Theoretical Framework for an Efficient Normalizing Flow-Based Solution to the Electronic Schrodinger Equation28 May 2024
- 2024Neural Pfaffians: Solving Many Many-Electron Schr"odinger Equations23 May 2024
- 2024Open-Source Fermionic Neural Networks with Ionic Charge Initialization16 Jan 2024
- 2023Forward Laplacian: A New Computational Framework for Neural Network-based Variational Monte Carlo17 Jul 2023
16 more
- 2023Variational Monte Carlo on a Budget -- Fine-tuning pre-trained Neural Wavefunctions15 Jul 2023
- 2023Convergence of variational Monte Carlo simulation and scale-invariant pre-training21 Mar 2023
- 2023Towards a Foundation Model for Neural Network Wavefunctions17 Mar 2023
- 2023Generalizing Neural Wave Functions8 Feb 2023
- 2022A Self-Attention Ansatz for Ab-initio Quantum Chemistry24 Nov 2022
- 2022Ab-initio quantum chemistry with neural-network wavefunctions26 Aug 2022
- 2022Positive-definite parametrization of mixed quantum states with deep neural networks27 Jun 2022
- 2022Sampling-free Inference for Ab-Initio Potential Energy Surface Networks30 May 2022
- 2022O(N2) Universal Antisymmetry in Fermionic Neural Networks26 May 2022
- 2022Gold-standard solutions to the Schr"odinger equation using deep learning: How much physics do we need?19 May 2022
- 2022Electronic excited states in deep variational Monte Carlo17 Mar 2022
- 2021Ab-Initio Potential Energy Surfaces by Pairing GNNs with Neural Wave Functions11 Oct 2021
- 2021Rayleigh-Gauss-Newton optimization with enhanced sampling for variational Monte Carlo19 Jun 2021
- 2021Provably Strict Generalisation Benefit for Invariance in Kernel Methods4 Jun 2021
- 2021Ab-initio study of interacting fermions at finite temperature with neural canonical transformation18 May 2021
- 2021Solving the electronic Schr"odinger equation for multiple nuclear geometries with weight-sharing deep neural networks18 May 2021
- 2025El Agente: An Autonomous Agent for Quantum Chemistrycited by 43
- 2025El Agente: An Autonomous Agent for Quantum Chemistry5 May 2025
- 2022A Self-Attention Ansatz for Ab-initio Quantum Chemistrycited by 45
- 2021Ab-Initio Potential Energy Surfaces by Pairing GNNs with Neural Wave Functionscited by 36
- 2021Provably Strict Generalisation Benefit for Invariance in Kernel Methodscited by 29
- 2022Ab-initio quantum chemistry with neural-network wavefunctionscited by 28
- 2023Generalizing Neural Wave Functionscited by 26
- 2022Gold-standard solutions to the Schr"odinger equation using deep learning: How much physics do we need?cited by 25
- 2021Solving the electronic Schr"odinger equation for multiple nuclear geometries with weight-sharing deep neural networkscited by 22
- 2022Electronic excited states in deep variational Monte Carlocited by 21
- 2022Sampling-free Inference for Ab-Initio Potential Energy Surface Networkscited by 19
- 2021Ab-initio study of interacting fermions at finite temperature with neural canonical transformationcited by 16
- 2025An ab initio foundation model of wavefunctions that accurately describes chemical bond breakingcited by 11
- 2023Variational Monte Carlo on a Budget -- Fine-tuning pre-trained Neural Wavefunctionscited by 8
12 most cited of 27 All 27 (JSON)
- 2026Implicit Machine Learning Force Fields Accelerate Molecular Dynamics Simulations31 Jul 2026
- 2026Is Variational Monte Carlo Robust? Sharp Moment Thresholds and Heavy-tailed Stochastic Optimization24 Jun 2026
- 2026Uncovering Exotic Paired States in the 2D Spin-Imbalanced Fermi Gas with Neural Wave Functions27 Apr 2026
- 2026Excited Pfaffians: Generalized Neural Wave Functions Across Structure and State15 Mar 2026
- 2025An ab initio foundation model of wavefunctions that accurately describes chemical bond breaking24 Jun 2025
- 2025Accurate Ab-initio Neural-network Solutions to Large-Scale Electronic Structure Problems8 Apr 2025
- 2024Highly Accurate Real-space Electron Densities with Neural Networks2 Sep 2024
- 2024A Theoretical Framework for an Efficient Normalizing Flow-Based Solution to the Electronic Schrodinger Equation28 May 2024
- 2024Neural Pfaffians: Solving Many Many-Electron Schr"odinger Equations23 May 2024
- 2024Open-Source Fermionic Neural Networks with Ionic Charge Initialization16 Jan 2024
- 2023Forward Laplacian: A New Computational Framework for Neural Network-based Variational Monte Carlo17 Jul 2023
- 2023Variational Monte Carlo on a Budget -- Fine-tuning pre-trained Neural Wavefunctions15 Jul 2023
12 newest of 27 All 27 (JSON)