SE(3)-equivariant prediction of molecular wavefunctions and electronic densities
Not on the map. Why?
Abstract (arXiv)
Machine learning has enabled the prediction of quantum chemical properties with high accuracy and efficiency, allowing to bypass computationally costly ab initio calculations. Instead of training on a fixed set of properties, more recent approaches attempt to learn the electronic wavefunction (or density) as a central quantity of atomistic systems, from which all other observables can be derived. This is complicated by the fact that wavefunctions transform non-trivially under molecular rotations, which makes them a challenging prediction target. To solve this issue, we introduce general SE(3)-equivariant operations and building blocks for constructing deep learning architectures for geometric point cloud data and apply them to reconstruct wavefunctions of atomistic systems with unprecedented accuracy. Our model achieves speedups of over three orders of magnitude compared to ab initio methods and reduces prediction errors by up to two orders of magnitude compared to the previous state-of-the-art. This accuracy makes it possible to derive properties such as energies and forces directly from the wavefunction in an end-to-end manner. We demonstrate the potential of our approach in a transfer learning application, where a model trained on low accuracy reference wavefunctions implicitly learns to correct for electronic many-body interactions from observables computed at a higher level of theory. Such machine-learned wavefunction surrogates pave the way towards novel semi-empirical methods, offering resolution at an electronic level while drastically decreasing computational cost. Additionally, the predicted wavefunctions can serve as initial guess in conventional ab initio methods, decreasing the number of iterations required to arrive at a converged solution, thus leading to significant speedups without any loss of accuracy or robustness.
Key facts. Cited by 67 papers in the map (data through 14 Oct 2026). Builds on 34 of its 74 references that are in the map. First posted on arXiv 4 Jun 2021.
Builds on
34 of 74 references.
References · 34
- 2017Attention Is All You Needcited by 60,361
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2017Neural Message Passing for Quantum Chemistrycited by 3,487
- 2016Identity Mappings in Deep Residual Networkscited by 1,965
- 2016Group Equivariant Convolutional Networkscited by 1,165
- 2017Sigmoid-Weighted Linear Units for Neural Network Function Approximation in Reinforcement Learningcited by 950
- 2019On the Convergence of Adam and Beyondcited by 841
- 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
- 2021E(3)-Equivariant Graph Neural Networks for Data-Efficient and Accurate Interatomic Potentialscited by 708
- 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
- 2017SchNet: A continuous-filter convolutional neural network for modeling quantum interactionscited by 571
- 2018Spherical CNNscited by 456
22 more
- 2021Equivariant message passing for the prediction of tensorial properties and molecular spectracited by 441
- 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 354
- 2016Steerable CNNscited by 305
- 2016Harmonic Networks: Deep Translation and Rotation Equivariancecited by 295
- 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 267
- 2019Cormorant: Covariant Molecular Neural Networkscited by 263
- 2020Generalizing Convolutional Neural Networks for Equivariance to Lie Groups on Arbitrary Continuous Datacited by 248
- 2018A General Theory of Equivariant CNNs on Homogeneous Spacescited by 228
- 2020Machine Learning Force Fieldscited by 207
- 2019Universal Invariant and Equivariant Graph Neural Networkscited by 183
- 2018Clebsch-Gordan Nets: a Fully Fourier Space Spherical Convolutional Neural Networkcited by 171
- 2019Deep neural network solution of the electronic Schr"odinger equationcited by 127
- 2021SpookyNet: Learning Force Fields with Electronic Degrees of Freedom and Nonlocal Effectscited by 104
- 2016Rotation equivariant vector field networkscited by 99
- 2019Unifying machine learning and quantum chemistry -- a deep neural network for molecular wavefunctionscited by 73
- 2016By-passing the Kohn-Sham equations with machine learningcited by 67
- 2020OrbNet: Deep Learning for Quantum Chemistry Using Symmetry-Adapted Atomic-Orbital Featurescited by 64
- 2018Covariant Compositional Networks For Learning Graphscited by 54
- 2015On Invariance and Selectivity in Representation Learningcited by 18
- 2020Machine learning of solvent effects on molecular spectra and reactionscited by 14
- 2018Solid Harmonic Wavelet Scattering for Predictions of Molecule Propertiescited by 12
- 2020A deep neural network for molecular wave functions in quasi-atomic minimal basis representationcited by 10
Built on by
Citing papers per year: 2021: 2; 2022: 11; 2023: 11; 2024: 19; 2025: 13; 2026: 11.
67 papers.
Sort:
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 264
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 204
- 2022Graph neural networks for materials science and chemistrycited by 182
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 44
- 2022Structure-based drug design with geometric deep learningcited by 40
- 2022So3krates: Equivariant attention for interactions on arbitrary length-scales in molecular systemscited by 39
- 2023Efficient and Equivariant Graph Networks for Predicting Quantum Hamiltoniancited by 39
- 2023Geometric Clifford Algebra Networkscited by 38
- 2024Enabling Efficient Equivariant Operations in the Fourier Basis via Gaunt Tensor Productscited by 36
- 2022SchNetPack 2.0: A neural network toolbox for atomistic machine learningcited by 29
- 2023QH9: A Quantum Hamiltonian Prediction Benchmark for QM9 Moleculescited by 26
38 more
- 2022Generative Coarse-Graining of Molecular Conformationscited by 21
- 2024Equivariance via Minimal Frame Averaging for More Symmetries and Efficiencycited by 19
- 2024Generalizing Denoising to Non-Equilibrium Structures Improves Equivariant Force Fieldscited by 18
- 2025Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular Systemscited by 14
- 2023Higher-Order Equivariant Neural Networks for Charge Density Prediction in Materialscited by 13
- 2024Self-Consistency Training for Density-Functional-Theory Hamiltonian Predictioncited by 12
- 2024Euclidean Fast Attention -- Machine Learning Global Atomic Representations at Linear Costcited by 12
- 2025HIP: Hessian Interatomic Potentials without derivativescited by 12
- 2025Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsitycited by 11
- 2025High-order Equivariant Flow Matching for Density Functional Theory Hamiltonian Predictioncited by 11
- 2026EquiformerV3: Scaling Efficient, Expressive, and General SE(3)-Equivariant Graph Attention Transformerscited by 11
- 2022Knowledge-augmented Deep Learning and Its Applications: A Surveycited by 10
- 2025How simple can you go? An off-the-shelf transformer approach to molecular dynamicscited by 10
- 2025ELECTRA: A Cartesian Network for 3D Charge Density Prediction with Floating Orbitalscited by 10
- 2022Accurate Machine Learned Quantum-Mechanical Force Fields for Biomolecular Simulationscited by 9
- 2023Variational Monte Carlo on a Budget -- Fine-tuning pre-trained Neural Wavefunctionscited by 9
- 2022Transferable E(3) equivariant parameterization for Hamiltonian of molecules and solidscited by 8
- 2023Learning Harmonic Molecular Representations on Riemannian Manifoldcited by 8
- 2024Image Super-resolution Inspired Electron Density Predictioncited by 8
- 2024Learning local equivariant representations for quantum operatorscited by 8
- 2022Algorithmic Differentiation for Automated Modeling of Machine Learned Force Fieldscited by 7
- 2023Towards a Foundation Model for Neural Network Wavefunctionscited by 7
- 2025Learning from the electronic structure of molecules across the periodic tablecited by 7
- 2024Infusing Self-Consistency into Density Functional Theory Hamiltonian Prediction via Deep Equilibrium Modelscited by 6
- 2024Equivariant Graph Network Approximations of High-Degree Polynomials for Force Field Predictioncited by 6
- 2025Learning with Exact Invariances in Polynomial Timecited by 6
- 2025Efficient Prediction of SO(3)-Equivariant Hamiltonian Matrices via SO(2) Local Framescited by 6
- 2024Reducing the Cost of Quantum Chemical Data By Backpropagating Through Density Functional Theorycited by 4
- 2024Equivariant Neural Tangent Kernelscited by 4
- 2023Equivariant Matrix Function Neural Networkscited by 3
- 2024Universal Machine Learning Kohn-Sham Hamiltonian for Materialscited by 3
- 2025Towards A Transferable Acceleration Method for Density Functional Theorycited by 3
- 2026E2Former-V2: On-the-Fly Equivariant Attention with Linear Activation Memorycited by 3
- 2023Electronic excited states from physically-constrained machine learningcited by 2
- 2024Towards Harmonization of SO(3)-Equivariance and Expressiveness: a Hybrid Deep Learning Framework for Electronic-Structure Hamiltonian Predictioncited by 2
- 2024nabla2DFT: A Universal Quantum Chemistry Dataset of Drug-Like Molecules and a Benchmark for Neural Network Potentialscited by 2
- 2025Advancing Universal Deep Learning for Electronic-Structure Hamiltonian Prediction of Materialscited by 2
- 2023Equivariant Neural Networks for Spin Dynamics Simulations of Itinerant Magnetscited by 1
50 most cited of 67 All 67 (JSON)
- 2026Physics-Aligned Electronic Ground-State Learning Improves Generalization7 Oct 2026
- 2026E3J: An Efficient and Open-Source Backend for Euclidean Equivariant Operations on GPU and TPU28 Sep 2026
- 2026Scaling Density Functional Theory with Gaussian Splatting25 Sep 2026
- 2026Coupled-cluster molecular properties across the main group that extrapolate beyond training size18 Aug 2026
- 2026Equivariant Cellular Sheaves for Molecular Electronic Structure: Bridging Sheaf Cohomology and E(3)-Equivariant Hamiltonian Learning14 Jun 2026
- 2026A Fixed-Point Neural Operator for Size- and Functional-Transferable Hamiltonian Prediction12 Jun 2026
- 2026Enhancing molecular dynamics with equivariant machine-learned densities27 Apr 2026
- 2026EquiformerV3: Scaling Efficient, Expressive, and General SE(3)-Equivariant Graph Attention Transformers10 Apr 2026
- 2026Physics-Informed Long-Range Coulomb Correction for Machine-learning Hamiltonians20 Mar 2026
- 2026Orbital Transformers for Predicting Wavefunctions in Time-Dependent Density Functional Theory3 Mar 2026
- 2026E2Former-V2: On-the-Fly Equivariant Attention with Linear Activation Memory23 Jan 2026
- 2025Learning 3D Anisotropic Noise Distributions Improves Molecular Force Field Modeling25 Oct 2025
38 more
- 2025Learning from the electronic structure of molecules across the periodic table30 Sep 2025
- 2025Towards A Transferable Acceleration Method for Density Functional Theory30 Sep 2025
- 2025HIP: Hessian Interatomic Potentials without derivatives25 Sep 2025
- 2025Advancing Universal Deep Learning for Electronic-Structure Hamiltonian Prediction of Materials24 Sep 2025
- 2025Tensor Decomposition Networks for Fast Machine Learning Interatomic Potential Computations1 Jul 2025
- 2025Efficient Prediction of SO(3)-Equivariant Hamiltonian Matrices via SO(2) Local Frames11 Jun 2025
- 2025High-order Equivariant Flow Matching for Density Functional Theory Hamiltonian Prediction24 May 2025
- 2025ELECTRA: A Cartesian Network for 3D Charge Density Prediction with Floating Orbitals11 Mar 2025
- 2025How simple can you go? An off-the-shelf transformer approach to molecular dynamics3 Mar 2025
- 2025Learning with Exact Invariances in Polynomial Time27 Feb 2025
- 2025Enhancing the Scalability and Applicability of Kohn-Sham Hamiltonians for Molecular Systems26 Feb 2025
- 2025Efficient and Scalable Density Functional Theory Hamiltonian Prediction through Adaptive Sparsity3 Feb 2025
- 2024Euclidean Fast Attention -- Machine Learning Global Atomic Representations at Linear Cost11 Dec 2024
- 2024Equivariant Graph Network Approximations of High-Degree Polynomials for Force Field Prediction6 Nov 2024
- 2024E3STO: Orbital Inspired SE(3)-Equivariant Molecular Representation for Electron Density Prediction8 Oct 2024
- 2024Learning local equivariant representations for quantum operators8 Jul 2024
- 2024NeuralSCF: Neural network self-consistent fields for density functional theory22 Jun 2024
- 2024nabla2DFT: A Universal Quantum Chemistry Dataset of Drug-Like Molecules and a Benchmark for Neural Network Potentials20 Jun 2024
- 2024Equivariance via Minimal Frame Averaging for More Symmetries and Efficiency11 Jun 2024
- 2024Equivariant Neural Tangent Kernels10 Jun 2024
- 2024Infusing Self-Consistency into Density Functional Theory Hamiltonian Prediction via Deep Equilibrium Models6 Jun 2024
- 2024Multi-task learning for molecular electronic structure approaching coupled-cluster accuracy9 May 2024
- 2024Self-Consistency Training for Density-Functional-Theory Hamiltonian Prediction14 Mar 2024
- 2024Generalizing Denoising to Non-Equilibrium Structures Improves Equivariant Force Fields14 Mar 2024
- 2024Image Super-resolution Inspired Electron Density Prediction19 Feb 2024
- 2024Universal Machine Learning Kohn-Sham Hamiltonian for Materials14 Feb 2024
- 2024Reducing the Cost of Quantum Chemical Data By Backpropagating Through Density Functional Theory6 Feb 2024
- 2024Manifold GCN: Diffusion-based Convolutional Neural Network for Manifold-valued Graphs25 Jan 2024
- 2024Enabling Efficient Equivariant Operations in the Fourier Basis via Gaunt Tensor Products18 Jan 2024
- 2024E3x: E(3)-Equivariant Deep Learning Made Easy15 Jan 2024
- 2024Towards Harmonization of SO(3)-Equivariance and Expressiveness: a Hybrid Deep Learning Framework for Electronic-Structure Hamiltonian Prediction1 Jan 2024
- 2023Higher-Order Equivariant Neural Networks for Charge Density Prediction in Materials8 Dec 2023
- 2023Electronic excited states from physically-constrained machine learning1 Nov 2023
- 2023Equivariant Matrix Function Neural Networks16 Oct 2023
- 2023Variational Monte Carlo on a Budget -- Fine-tuning pre-trained Neural Wavefunctions15 Jul 2023
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representations21 Jun 2023
- 2023QH9: A Quantum Hamiltonian Prediction Benchmark for QM9 Molecules15 Jun 2023
- 2023Efficient and Equivariant Graph Networks for Predicting Quantum Hamiltonian8 Jun 2023
50 newest of 67 All 67 (JSON)
- 2022Equiformer: Equivariant Graph Attention Transformer for 3D Atomistic Graphscited by 264
- 2023EquiformerV2: Improved Equivariant Transformer for Scaling to Higher-Degree Representationscited by 204
- 2022Graph neural networks for materials science and chemistrycited by 182
- 2021Geometric Deep Learning on Molecular Representationscited by 113
- 2021Physics-Guided Deep Learning for Dynamical Systems: A Surveycited by 44
- 2022Structure-based drug design with geometric deep learningcited by 40
- 2022So3krates: Equivariant attention for interactions on arbitrary length-scales in molecular systemscited by 39
- 2023Efficient and Equivariant Graph Networks for Predicting Quantum Hamiltoniancited by 39
- 2023Geometric Clifford Algebra Networkscited by 38
- 2024Enabling Efficient Equivariant Operations in the Fourier Basis via Gaunt Tensor Productscited by 36
- 2022SchNetPack 2.0: A neural network toolbox for atomistic machine learningcited by 29
- 2023QH9: A Quantum Hamiltonian Prediction Benchmark for QM9 Moleculescited by 26
12 most cited of 67 All 67 (JSON)
- 2026Physics-Aligned Electronic Ground-State Learning Improves Generalization7 Oct 2026
- 2026E3J: An Efficient and Open-Source Backend for Euclidean Equivariant Operations on GPU and TPU28 Sep 2026
- 2026Scaling Density Functional Theory with Gaussian Splatting25 Sep 2026
- 2026Coupled-cluster molecular properties across the main group that extrapolate beyond training size18 Aug 2026
- 2026Equivariant Cellular Sheaves for Molecular Electronic Structure: Bridging Sheaf Cohomology and E(3)-Equivariant Hamiltonian Learning14 Jun 2026
- 2026A Fixed-Point Neural Operator for Size- and Functional-Transferable Hamiltonian Prediction12 Jun 2026
- 2026Enhancing molecular dynamics with equivariant machine-learned densities27 Apr 2026
- 2026EquiformerV3: Scaling Efficient, Expressive, and General SE(3)-Equivariant Graph Attention Transformers10 Apr 2026
- 2026Physics-Informed Long-Range Coulomb Correction for Machine-learning Hamiltonians20 Mar 2026
- 2026Orbital Transformers for Predicting Wavefunctions in Time-Dependent Density Functional Theory3 Mar 2026
- 2026E2Former-V2: On-the-Fly Equivariant Attention with Linear Activation Memory23 Jan 2026
- 2025Learning 3D Anisotropic Noise Distributions Improves Molecular Force Field Modeling25 Oct 2025
12 newest of 67 All 67 (JSON)