mlsanityData to 7 Oct 2026

Amortized Inference for Heterogeneous Reconstruction in Cryo-EM

arXiv 2210.07387 ↗First posted 13 Oct 2022cs.CV cs.LG q-bio.BMcited by 23

Not on the map. Why?

Abstract (arXiv)

Cryo-electron microscopy (cryo-EM) is an imaging modality that provides unique insights into the dynamics of proteins and other building blocks of life. The algorithmic challenge of jointly estimating the poses, 3D structure, and conformational heterogeneity of a biomolecule from millions of noisy and randomly oriented 2D projections in a computationally efficient manner, however, remains unsolved. Our method, cryoFIRE, performs ab initio heterogeneous reconstruction with unknown poses in an amortized framework, thereby avoiding the computationally expensive step of pose search while enabling the analysis of conformational heterogeneity. Poses and conformation are jointly estimated by an encoder while a physics-based decoder aggregates the images into an implicit neural representation of the conformational space. We show that our method can provide one order of magnitude speedup on datasets containing millions of images without any loss of accuracy. We validate that the joint estimation of poses and conformations can be amortized over the size of the dataset. For the first time, we prove that an amortized method can extract interpretable dynamic information from experimental datasets.

Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 12 of its 45 references that are in the map. First posted on arXiv 13 Oct 2022.

Builds on

12 of 45 references.

References · 12

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,170
  4. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  5. 2019An Introduction to Variational Autoencoderscited by 997
  6. 2019Reconstructing continuous distributions of 3D protein structure from cryo-EM imagescited by 56
  7. 2019Explicitly disentangling image content from translation and rotation with spatial-VAEcited by 28
  8. 2022CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Imagescited by 24
  9. 2022Deep Generative Modeling for Volume Reconstruction in Cryo-Electron Microscopycited by 19
  10. 2021Inferring a Continuous Distribution of Atom Coordinates from Cryo-EM Images using VAEscited by 17
  11. 2019Estimation of Orientation and Camera Parameters from Cryo-Electron Microscopy Images with Variational Autoencoders and Generative Adversarial Networkscited by 11
  12. 2019Hyper-Molecules: on the Representation and Recovery of Dynamical Structures, with Application to Flexible Macro-Molecular Structures in Cryo-EMcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 10; 2024: 5; 2025: 6; 2026: 2.

23 papers.

Sort:

By area:

  1. 2023Variational Bayesian Imaging with an Efficient Surrogate Score-based Priorcited by 16
  2. 2024CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EMcited by 15
  3. 2023Capturing dynamical correlations using implicit neural representationscited by 6
  4. 2023MELON: NeRF with Unposed Images in SO(3)cited by 4
  5. 2023CryoGEM: Physics-Informed Generative Cryo-Electron Microscopycited by 4
  6. 2024CryoSPIN: Improving Ab-Initio Cryo-EM Reconstruction with Semi-Amortized Pose Inferencecited by 4
  7. 2023CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representationscited by 3
  8. 2025CryoFastAR: Fast Cryo-EM Ab Initio Reconstruction Made Easycited by 3
  9. 2023Recovering a Molecule's 3D Dynamics from Liquid-phase Electron Microscopy Moviescited by 2
  10. 2024Mixture of neural fields for heterogeneous reconstruction in cryo-EMcited by 2
  11. 2023Using VAEs to Learn Latent Variables: Observations on Applications in cryo-EMcited by 1
  12. 2023Improved Cryo-EM Pose Estimation and 3D Classification through Latent-Space Disentanglementcited by 1
11 more
  1. 2024Equivariant amortized inference of poses for cryo-EMcited by 1
  2. 2025CryoCCD: Conditional Cycle-consistent Diffusion with Biophysical Modeling for Cryo-EM Synthesiscited by 1
  3. 2025Reconstructing Heterogeneous Biomolecules via Hierarchical Gaussian Mixtures and Part Discoverycited by 1
  4. 2025CryoHype: Reconstructing a thousand cryo-EM structures with transformer-based hypernetworkscited by 1
  5. 2023Cryo-forum: A framework for orientation recovery with uncertainty measure with the application in cryo-EM image analysiscited by 0
  6. 2023Scalable 3D Reconstruction From Single Particle X-Ray Diffraction Images Based on Online Machine Learningcited by 0
  7. 2024DualContrast: Unsupervised Disentangling of Content and Transformations with Implicit Parameterizationcited by 0
  8. 2025Joint Denoising of Cryo-EM Projection Images using Polar Transformerscited by 0
  9. 2025CryoSplat: Gaussian Splatting for Cryo-EM Homogeneous Reconstructioncited by 0
  10. 2026Protein Graph Neural Networks for Heterogeneous Cryo-EM Reconstructioncited by 0
  11. 2026ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopycited by 0