CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Images
Not on the map. Why?
Abstract (arXiv)
Cryo-electron microscopy (cryo-EM) has become a tool of fundamental importance in structural biology, helping us understand the basic building blocks of life. The algorithmic challenge of cryo-EM is to jointly estimate the unknown 3D poses and the 3D electron scattering potential of a biomolecule from millions of extremely noisy 2D images. Existing reconstruction algorithms, however, cannot easily keep pace with the rapidly growing size of cryo-EM datasets due to their high computational and memory cost. We introduce cryoAI, an ab initio reconstruction algorithm for homogeneous conformations that uses direct gradient-based optimization of particle poses and the electron scattering potential from single-particle cryo-EM data. CryoAI combines a learned encoder that predicts the poses of each particle image with a physics-based decoder to aggregate each particle image into an implicit representation of the scattering potential volume. This volume is stored in the Fourier domain for computational efficiency and leverages a modern coordinate network architecture for memory efficiency. Combined with a symmetrized loss function, this framework achieves results of a quality on par with state-of-the-art cryo-EM solvers for both simulated and experimental data, one order of magnitude faster for large datasets and with significantly lower memory requirements than existing methods.
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 19 of its 73 references that are in the map. First posted on arXiv 15 Mar 2022.
Builds on
19 of 73 references.
References · 19
- 2017Attention Is All You Needcited by 59,932
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2019An Introduction to Variational Autoencoderscited by 997
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
- 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
- 2019Learning Shape Templates with Structured Implicit Functionscited by 242
- 2019Reconstructing continuous distributions of 3D protein structure from cryo-EM imagescited by 56
7 more
- 2022Deep Generative Modeling for Volume Reconstruction in Cryo-Electron Microscopycited by 19
- 2021Unsupervised Deep Learning Methods for Biological Image Reconstruction and Enhancementcited by 17
- 2021Inferring a Continuous Distribution of Atom Coordinates from Cryo-EM Images using VAEscited by 17
- 2019Estimation of Orientation and Camera Parameters from Cryo-Electron Microscopy Images with Variational Autoencoders and Generative Adversarial Networkscited by 11
- 2019Differentiable probabilistic models of scientific imaging with the Fourier slice theoremcited by 6
- 2019A common lines approach for ab-initio modeling of cyclically-symmetric moleculescited by 5
- 2020Joint Angular Refinement and Reconstruction for Single-Particle Cryo-EMcited by 5
Built on by
Citing papers per year: 2022: 3; 2023: 13; 2024: 4; 2025: 2; 2026: 2.
24 papers.
Sort:
- 2022Residual Multiplicative Filter Networks for Multiscale Reconstructioncited by 25
- 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EMcited by 23
- 2023Image to Sphere: Learning Equivariant Features for Efficient Pose Predictioncited by 17
- 2023MELON: NeRF with Unposed Images in SO(3)cited by 4
- 2023CryoGEM: Physics-Informed Generative Cryo-Electron Microscopycited by 4
- 2024CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inferencecited by 4
- 2023CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representationscited by 3
- 2025CryoFastAR: Fast Cryo-EM Ab Initio Reconstruction Made Easycited by 3
- 2023Recovering a Molecule's 3D Dynamics from Liquid-phase Electron Microscopy Moviescited by 2
- 2022Heterogeneous reconstruction of deformable atomic models in Cryo-EMcited by 1
- 2023Boosted ab initio Cryo-EM 3D Reconstruction with ACE-EMcited by 1
- 2023Using VAEs to Learn Latent Variables: Observations on Applications in cryo-EMcited by 1
12 more
- 2023Improved Cryo-EM Pose Estimation and 3D Classification through Latent-Space Disentanglementcited by 1
- 2024Equivariant amortized inference of poses for cryo-EMcited by 1
- 2024cryoSPHERE: Single-particle heterogeneous reconstruction from cryo EMcited by 1
- 2023Deep Neural-network Prior for Orbit Recovery from Method of Momentscited by 0
- 2023CryoChains: Heterogeneous Reconstruction of Molecular Assembly of Semi-flexible Chains from Cryo-EM Imagescited by 0
- 2023Cryo-forum: A framework for orientation recovery with uncertainty measure with the application in cryo-EM image analysiscited by 0
- 2023Augmenting x-ray single particle imaging reconstruction with self-supervised machine learningcited by 0
- 2023Scalable 3D Reconstruction From Single Particle X-Ray Diffraction Images Based on Online Machine Learningcited by 0
- 2024DualContrast: Unsupervised Disentangling of Content and Transformations with Implicit Parameterizationcited by 0
- 2025CryoSplat: Gaussian Splatting for Cryo-EM Homogeneous Reconstructioncited by 0
- 2026Unsupervised SE(3) Disentanglement for in situ Macromolecular Morphology Identification from Cryo-Electron Tomographycited by 0
- 2026ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopycited by 0
- 2026ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopy22 Aug 2026
- 2026Unsupervised SE(3) Disentanglement for in situ Macromolecular Morphology Identification from Cryo-Electron Tomography4 Jan 2026
- 2025CryoSplat: Gaussian Splatting for Cryo-EM Homogeneous Reconstruction6 Aug 2025
- 2025CryoFastAR: Fast Cryo-EM Ab Initio Reconstruction Made Easy6 Jun 2025
- 2024CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inference15 Jun 2024
- 2024Equivariant amortized inference of poses for cryo-EM1 Jun 2024
- 2024cryoSPHERE: Single-particle heterogeneous reconstruction from cryo EM29 May 2024
- 2024DualContrast: Unsupervised Disentangling of Content and Transformations with Implicit Parameterization27 May 2024
- 2023Scalable 3D Reconstruction From Single Particle X-Ray Diffraction Images Based on Online Machine Learning22 Dec 2023
- 2023CryoGEM: Physics-Informed Generative Cryo-Electron Microscopy4 Dec 2023
- 2023Augmenting x-ray single particle imaging reconstruction with self-supervised machine learning28 Nov 2023
- 2023Recovering a Molecule's 3D Dynamics from Liquid-phase Electron Microscopy Movies23 Aug 2023
12 more
- 2023Improved Cryo-EM Pose Estimation and 3D Classification through Latent-Space Disentanglement9 Aug 2023
- 2023Cryo-forum: A framework for orientation recovery with uncertainty measure with the application in cryo-EM image analysis19 Jul 2023
- 2023CryoChains: Heterogeneous Reconstruction of Molecular Assembly of Semi-flexible Chains from Cryo-EM Images12 Jun 2023
- 2023Deep Neural-network Prior for Orbit Recovery from Method of Moments28 Apr 2023
- 2023CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representations28 Mar 2023
- 2023MELON: NeRF with Unposed Images in SO(3)14 Mar 2023
- 2023Using VAEs to Learn Latent Variables: Observations on Applications in cryo-EM13 Mar 2023
- 2023Image to Sphere: Learning Equivariant Features for Efficient Pose Prediction27 Feb 2023
- 2023Boosted ab initio Cryo-EM 3D Reconstruction with ACE-EM13 Feb 2023
- 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EM13 Oct 2022
- 2022Heterogeneous reconstruction of deformable atomic models in Cryo-EM29 Sep 2022
- 2022Residual Multiplicative Filter Networks for Multiscale Reconstruction1 Jun 2022
- 2022Residual Multiplicative Filter Networks for Multiscale Reconstructioncited by 25
- 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EMcited by 23
- 2023Image to Sphere: Learning Equivariant Features for Efficient Pose Predictioncited by 17
- 2023MELON: NeRF with Unposed Images in SO(3)cited by 4
- 2023CryoGEM: Physics-Informed Generative Cryo-Electron Microscopycited by 4
- 2024CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inferencecited by 4
- 2023CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representationscited by 3
- 2025CryoFastAR: Fast Cryo-EM Ab Initio Reconstruction Made Easycited by 3
- 2023Recovering a Molecule's 3D Dynamics from Liquid-phase Electron Microscopy Moviescited by 2
- 2022Heterogeneous reconstruction of deformable atomic models in Cryo-EMcited by 1
- 2023Boosted ab initio Cryo-EM 3D Reconstruction with ACE-EMcited by 1
- 2023Using VAEs to Learn Latent Variables: Observations on Applications in cryo-EMcited by 1
12 most cited of 24 All 24 (JSON)
- 2026ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopy22 Aug 2026
- 2026Unsupervised SE(3) Disentanglement for in situ Macromolecular Morphology Identification from Cryo-Electron Tomography4 Jan 2026
- 2025CryoSplat: Gaussian Splatting for Cryo-EM Homogeneous Reconstruction6 Aug 2025
- 2025CryoFastAR: Fast Cryo-EM Ab Initio Reconstruction Made Easy6 Jun 2025
- 2024CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inference15 Jun 2024
- 2024Equivariant amortized inference of poses for cryo-EM1 Jun 2024
- 2024cryoSPHERE: Single-particle heterogeneous reconstruction from cryo EM29 May 2024
- 2024DualContrast: Unsupervised Disentangling of Content and Transformations with Implicit Parameterization27 May 2024
- 2023Scalable 3D Reconstruction From Single Particle X-Ray Diffraction Images Based on Online Machine Learning22 Dec 2023
- 2023CryoGEM: Physics-Informed Generative Cryo-Electron Microscopy4 Dec 2023
- 2023Augmenting x-ray single particle imaging reconstruction with self-supervised machine learning28 Nov 2023
- 2023Recovering a Molecule's 3D Dynamics from Liquid-phase Electron Microscopy Movies23 Aug 2023
12 newest of 24 All 24 (JSON)