mlsanityData to 7 Oct 2026

CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Images

arXiv 2203.08138 ↗First posted 15 Mar 2022cs.CV cs.LG q-bio.BMcited by 24

Not on the map. Why?

Abstract (arXiv)

Cryo-electron microscopy (cryo-EM) has become a tool of fundamental importance in structural biology, helping us understand the basic building blocks of life. The algorithmic challenge of cryo-EM is to jointly estimate the unknown 3D poses and the 3D electron scattering potential of a biomolecule from millions of extremely noisy 2D images. Existing reconstruction algorithms, however, cannot easily keep pace with the rapidly growing size of cryo-EM datasets due to their high computational and memory cost. We introduce cryoAI, an ab initio reconstruction algorithm for homogeneous conformations that uses direct gradient-based optimization of particle poses and the electron scattering potential from single-particle cryo-EM data. CryoAI combines a learned encoder that predicts the poses of each particle image with a physics-based decoder to aggregate each particle image into an implicit representation of the scattering potential volume. This volume is stored in the Fourier domain for computational efficiency and leverages a modern coordinate network architecture for memory efficiency. Combined with a symmetrized loss function, this framework achieves results of a quality on par with state-of-the-art cryo-EM solvers for both simulated and experimental data, one order of magnitude faster for large datasets and with significantly lower memory requirements than existing methods.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 19 of its 73 references that are in the map. First posted on arXiv 15 Mar 2022.

Builds on

19 of 73 references.

References · 19

  1. 2017Attention Is All You Needcited by 59,932
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,682
  5. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  6. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  7. 2019An Introduction to Variational Autoencoderscited by 997
  8. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  9. 2020Accelerating 3D Deep Learning with PyTorch3Dcited by 781
  10. 2019SAL: Sign Agnostic Learning of Shapes from Raw Datacited by 389
  11. 2019Learning Shape Templates with Structured Implicit Functionscited by 242
  12. 2019Reconstructing continuous distributions of 3D protein structure from cryo-EM imagescited by 56
7 more
  1. 2022Deep Generative Modeling for Volume Reconstruction in Cryo-Electron Microscopycited by 19
  2. 2021Unsupervised Deep Learning Methods for Biological Image Reconstruction and Enhancementcited by 17
  3. 2021Inferring a Continuous Distribution of Atom Coordinates from Cryo-EM Images using VAEscited by 17
  4. 2019Estimation of Orientation and Camera Parameters from Cryo-Electron Microscopy Images with Variational Autoencoders and Generative Adversarial Networkscited by 11
  5. 2019Differentiable probabilistic models of scientific imaging with the Fourier slice theoremcited by 6
  6. 2019A common lines approach for ab-initio modeling of cyclically-symmetric moleculescited by 5
  7. 2020Joint Angular Refinement and Reconstruction for Single-Particle Cryo-EMcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 13; 2024: 4; 2025: 2; 2026: 2.

24 papers.

Sort:

  1. 2022Residual Multiplicative Filter Networks for Multiscale Reconstructioncited by 25
  2. 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EMcited by 23
  3. 2023Image to Sphere: Learning Equivariant Features for Efficient Pose Predictioncited by 17
  4. 2023MELON: NeRF with Unposed Images in SO(3)cited by 4
  5. 2023CryoGEM: Physics-Informed Generative Cryo-Electron Microscopycited by 4
  6. 2024CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inferencecited by 4
  7. 2023CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representationscited by 3
  8. 2025CryoFastAR: Fast Cryo-EM Ab Initio Reconstruction Made Easycited by 3
  9. 2023Recovering a Molecule's 3D Dynamics from Liquid-phase Electron Microscopy Moviescited by 2
  10. 2022Heterogeneous reconstruction of deformable atomic models in Cryo-EMcited by 1
  11. 2023Boosted ab initio Cryo-EM 3D Reconstruction with ACE-EMcited by 1
  12. 2023Using VAEs to Learn Latent Variables: Observations on Applications in cryo-EMcited by 1
12 more
  1. 2023Improved Cryo-EM Pose Estimation and 3D Classification through Latent-Space Disentanglementcited by 1
  2. 2024Equivariant amortized inference of poses for cryo-EMcited by 1
  3. 2024cryoSPHERE: Single-particle heterogeneous reconstruction from cryo EMcited by 1
  4. 2023Deep Neural-network Prior for Orbit Recovery from Method of Momentscited by 0
  5. 2023CryoChains: Heterogeneous Reconstruction of Molecular Assembly of Semi-flexible Chains from Cryo-EM Imagescited by 0
  6. 2023Cryo-forum: A framework for orientation recovery with uncertainty measure with the application in cryo-EM image analysiscited by 0
  7. 2023Augmenting x-ray single particle imaging reconstruction with self-supervised machine learningcited by 0
  8. 2023Scalable 3D Reconstruction From Single Particle X-Ray Diffraction Images Based on Online Machine Learningcited by 0
  9. 2024DualContrast: Unsupervised Disentangling of Content and Transformations with Implicit Parameterizationcited by 0
  10. 2025CryoSplat: Gaussian Splatting for Cryo-EM Homogeneous Reconstructioncited by 0
  11. 2026Unsupervised SE(3) Disentanglement for in situ Macromolecular Morphology Identification from Cryo-Electron Tomographycited by 0
  12. 2026ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopycited by 0