Deep Generative Modeling for Volume Reconstruction in Cryo-Electron Microscopy
Not on the map. Why?
Abstract (arXiv)
Recent breakthroughs in high-resolution imaging of biomolecules in solution with cryo-electron microscopy (cryo-EM) have unlocked new doors for the reconstruction of molecular volumes, thereby promising further advances in biology, chemistry, and pharmacological research. Recent next-generation volume reconstruction algorithms that combine generative modeling with end-to-end unsupervised deep learning techniques have shown promising preliminary results, but still face considerable technical and theoretical hurdles when applied to experimental cryo-EM images. In light of the proliferation of such methods, we propose here a critical review of recent advances in the field of deep generative modeling for cryo-EM volume reconstruction. The present review aims to (i) unify and compare these new methods using a consistent statistical framework, (ii) present them using a terminology familiar to machine learning researchers and computational biologists with no specific background in cryo-EM, and (iii) provide the necessary perspective on current advances to highlight their relative strengths and weaknesses, along with outstanding bottlenecks and avenues for improvements in the field. This review might also raise the interest of computer vision practitioners, as it highlights significant limits of deep generative models in low signal-to-noise regimes -- therefore emphasizing a need for new theoretical and methodological developments.
Key facts. Cited by 19 papers in the map (data through 7 Oct 2026). Builds on 12 of its 66 references that are in the map. First posted on arXiv 8 Jan 2022.
Builds on
12 of 66 references.
References · 12
- 2021Convex optimizationcited by 2,479
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2019Machine learning for molecular simulationcited by 109
- 2020Review: Deep Learning in Electron Microscopycited by 20
- 2021Inferring a Continuous Distribution of Atom Coordinates from Cryo-EM Images using VAEscited by 17
- 2019Estimation of Orientation and Camera Parameters from Cryo-Electron Microscopy Images with Variational Autoencoders and Generative Adversarial Networkscited by 11
- 2018Variational Selection of Features for Molecular Kineticscited by 8
- 2019Method of moments for 3-D single particle ab initio modeling with non-uniform distribution of viewing anglescited by 8
- 2019Differentiable probabilistic models of scientific imaging with the Fourier slice theoremcited by 6
- 2021Deep learning based mixed-dimensional GMM for characterizing variability in CryoEMcited by 4
- 2021End-to-End Simultaneous Learning of Single-particle Orientation and 3D Map Reconstruction from Cryo-electron Microscopy Datacited by 3
- 2021Artificial Intelligence Advances for De Novo Molecular Structure Modeling in Cryo-EMcited by 2
Built on by
Citing papers per year: 2022: 5; 2023: 7; 2024: 3; 2025: 1; 2026: 3.
19 papers.
Sort:
By area:
- 2022CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Imagescited by 24
- 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EMcited by 23
- 2024CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EMcited by 15
- 2022Latent Space Diffusion Models of Cryo-EM Structurescited by 6
- 2023CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representationscited by 3
- 2025Cryo-em images are intrinsically low dimensionalcited by 2
- 2022Heterogeneous reconstruction of deformable atomic models in Cryo-EMcited by 1
- 2023Boosted ab initio Cryo-EM 3D Reconstruction with ACE-EMcited by 1
- 2023Using VAEs to Learn Latent Variables: Observations on Applications in cryo-EMcited by 1
- 2023Improved Cryo-EM Pose Estimation and 3D Classification through Latent-Space Disentanglementcited by 1
- 2024Equivariant amortized inference of poses for cryo-EMcited by 1
- 2024cryoSPHERE: Single-particle heterogeneous reconstruction from cryo EMcited by 1
7 more
- 2026Three-dimensional visualization of X-ray micro-CT with large-scale datasets: Efficiency and accuracy for real-time interactioncited by 1
- 2022Defining an action of SO(d)-rotations on images generated by projections of d-dimensional objects: Applications to pose inference with Geometric VAEscited by 0
- 2023CryoChains: Heterogeneous Reconstruction of Molecular Assembly of Semi-flexible Chains from Cryo-EM Imagescited by 0
- 2023Cryo-forum: A framework for orientation recovery with uncertainty measure with the application in cryo-EM image analysiscited by 0
- 2023Augmenting x-ray single particle imaging reconstruction with self-supervised machine learningcited by 0
- 2026SOLVAR: Fast covariance-based heterogeneity analysis with pose refinement for cryo-EMcited by 0
- 2026A meta-algorithm for ab initio reconstruction of complex mixtures in cryo-EMcited by 0
- 2026A meta-algorithm for ab initio reconstruction of complex mixtures in cryo-EM26 Aug 2026
- 2026SOLVAR: Fast covariance-based heterogeneity analysis with pose refinement for cryo-EM19 Feb 2026
- 2026Three-dimensional visualization of X-ray micro-CT with large-scale datasets: Efficiency and accuracy for real-time interaction21 Jan 2026
- 2025Cryo-em images are intrinsically low dimensional15 Apr 2025
- 2024CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EM10 Aug 2024
- 2024Equivariant amortized inference of poses for cryo-EM1 Jun 2024
- 2024cryoSPHERE: Single-particle heterogeneous reconstruction from cryo EM29 May 2024
- 2023Augmenting x-ray single particle imaging reconstruction with self-supervised machine learning28 Nov 2023
- 2023Improved Cryo-EM Pose Estimation and 3D Classification through Latent-Space Disentanglement9 Aug 2023
- 2023Cryo-forum: A framework for orientation recovery with uncertainty measure with the application in cryo-EM image analysis19 Jul 2023
- 2023CryoChains: Heterogeneous Reconstruction of Molecular Assembly of Semi-flexible Chains from Cryo-EM Images12 Jun 2023
- 2023CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representations28 Mar 2023
7 more
- 2023Using VAEs to Learn Latent Variables: Observations on Applications in cryo-EM13 Mar 2023
- 2023Boosted ab initio Cryo-EM 3D Reconstruction with ACE-EM13 Feb 2023
- 2022Latent Space Diffusion Models of Cryo-EM Structures25 Nov 2022
- 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EM13 Oct 2022
- 2022Heterogeneous reconstruction of deformable atomic models in Cryo-EM29 Sep 2022
- 2022Defining an action of SO(d)-rotations on images generated by projections of d-dimensional objects: Applications to pose inference with Geometric VAEs23 Jul 2022
- 2022CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Images15 Mar 2022
- 2022Latent Space Diffusion Models of Cryo-EM Structurescited by 6
- 2022Latent Space Diffusion Models of Cryo-EM Structures25 Nov 2022
- 2022CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Imagescited by 24
- 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EMcited by 23
- 2024CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EMcited by 15
- 2023CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representationscited by 3
- 2025Cryo-em images are intrinsically low dimensionalcited by 2
- 2022Heterogeneous reconstruction of deformable atomic models in Cryo-EMcited by 1
- 2023Boosted ab initio Cryo-EM 3D Reconstruction with ACE-EMcited by 1
- 2023Using VAEs to Learn Latent Variables: Observations on Applications in cryo-EMcited by 1
- 2023Improved Cryo-EM Pose Estimation and 3D Classification through Latent-Space Disentanglementcited by 1
- 2024Equivariant amortized inference of poses for cryo-EMcited by 1
- 2024cryoSPHERE: Single-particle heterogeneous reconstruction from cryo EMcited by 1
- 2026Three-dimensional visualization of X-ray micro-CT with large-scale datasets: Efficiency and accuracy for real-time interactioncited by 1
12 most cited of 18 All 18 (JSON)
- 2026A meta-algorithm for ab initio reconstruction of complex mixtures in cryo-EM26 Aug 2026
- 2026SOLVAR: Fast covariance-based heterogeneity analysis with pose refinement for cryo-EM19 Feb 2026
- 2026Three-dimensional visualization of X-ray micro-CT with large-scale datasets: Efficiency and accuracy for real-time interaction21 Jan 2026
- 2025Cryo-em images are intrinsically low dimensional15 Apr 2025
- 2024CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EM10 Aug 2024
- 2024Equivariant amortized inference of poses for cryo-EM1 Jun 2024
- 2024cryoSPHERE: Single-particle heterogeneous reconstruction from cryo EM29 May 2024
- 2023Augmenting x-ray single particle imaging reconstruction with self-supervised machine learning28 Nov 2023
- 2023Improved Cryo-EM Pose Estimation and 3D Classification through Latent-Space Disentanglement9 Aug 2023
- 2023Cryo-forum: A framework for orientation recovery with uncertainty measure with the application in cryo-EM image analysis19 Jul 2023
- 2023CryoChains: Heterogeneous Reconstruction of Molecular Assembly of Semi-flexible Chains from Cryo-EM Images12 Jun 2023
- 2023CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representations28 Mar 2023
12 newest of 18 All 18 (JSON)