Reconstructing continuous distributions of 3D protein structure from cryo-EM images
Not on the map. Why?
Abstract (arXiv)
Cryo-electron microscopy (cryo-EM) is a powerful technique for determining the structure of proteins and other macromolecular complexes at near-atomic resolution. In single particle cryo-EM, the central problem is to reconstruct the three-dimensional structure of a macromolecule from 104-7 noisy and randomly oriented two-dimensional projections. However, the imaged protein complexes may exhibit structural variability, which complicates reconstruction and is typically addressed using discrete clustering approaches that fail to capture the full range of protein dynamics. Here, we introduce a novel method for cryo-EM reconstruction that extends naturally to modeling continuous generative factors of structural heterogeneity. This method encodes structures in Fourier space using coordinate-based deep neural networks, and trains these networks from unlabeled 2D cryo-EM images by combining exact inference over image orientation with variational inference for structural heterogeneity. We demonstrate that the proposed method, termed cryoDRGN, can perform ab initio reconstruction of 3D protein complexes from simulated and real 2D cryo-EM image data. To our knowledge, cryoDRGN is the first neural network-based approach for cryo-EM reconstruction and the first end-to-end method for directly reconstructing continuous ensembles of protein structures from cryo-EM images.
Key facts. Cited by 56 papers in the map (data through 14 Oct 2026). First posted on arXiv 11 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 12; 2023: 15; 2024: 13; 2025: 8.
56 papers.
Sort:
By area:
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
- 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimizationcited by 73
- 2021A Review of Location Encoding for GeoAI: Methods and Applicationscited by 54
- 2022Generalizable Implicit Neural Representations via Instance Pattern Composerscited by 39
- 2023Sphere2Vec: A General-Purpose Location Representation Learning over a Spherical Surface for Large-Scale Geospatial Predictionscited by 39
- 2021Rethinking Positional Encodingcited by 37
- 2024Improved Implicit Neural Representation with Fourier Reparameterized Trainingcited by 36
- 2024TorchSpatial: A Location Encoding Framework and Benchmark for Spatial Representation Learningcited by 31
- 2023ResFields: Residual Neural Fields for Spatiotemporal Signalscited by 27
- 2022CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Imagescited by 24
38 more
- 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EMcited by 23
- 2022Theoretical Perspectives on Deep Learning Methods in Inverse Problemscited by 22
- 2021Spline Positional Encoding for Learning 3D Implicit Signed Distance Fieldscited by 21
- 2021Reproducing Activation Function for Deep Learningcited by 19
- 2022PINs: Progressive Implicit Networks for Multi-Scale Neural Representationscited by 19
- 2022Trading Positional Complexity vs. Deepness in Coordinate Networkscited by 16
- 2024Quantum Implicit Neural Representationscited by 16
- 2024CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EMcited by 15
- 2022TINC: Tree-structured Implicit Neural Compressioncited by 14
- 2022Streamable Neural Fieldscited by 13
- 2022SCI: A Spectrum Concentrated Implicit Neural Compression for Biomedical Datacited by 13
- 2024Poly2Vec: Polymorphic Fourier-Based Encoding of Geospatial Objects for GeoAI Applicationscited by 13
- 2023Implicit neural representations for unsupervised super-resolution and denoising of 4D flow MRIcited by 9
- 2022Track Targets by Dense Spatio-Temporal Position Encodingcited by 8
- 2025Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Explorationcited by 8
- 2021Learning Positional Embeddings for Coordinate-MLPscited by 7
- 2022Latent Space Diffusion Models of Cryo-EM Structurescited by 6
- 2023Equivariant Single View Pose Prediction Via Induced and Restricted Representationscited by 6
- 2023Teaching Robots to Build Simulations of Themselvescited by 6
- 2024MicroDiffusion: Implicit Representation-Guided Diffusion for 3D Reconstruction from Limited 2D Microscopy Projectionscited by 6
- 2023Robust Point Cloud Processing through Positional Embeddingcited by 5
- 2024Frequency-adaptive Multi-scale Deep Neural Networkscited by 5
- 20243D Equivariant Pose Regression via Direct Wigner-D Harmonics Predictioncited by 4
- 2023CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representationscited by 3
- 2023CoNeS: Conditional neural fields with shift modulation for multi-sequence MRI translationcited by 3
- 2025Integrating Predictive and Generative Capabilities by Latent Space Design via the DKL-VAE Modelcited by 3
- 2022Sphere2Vec: Multi-Scale Representation Learning over a Spherical Surface for Geospatial Predictionscited by 2
- 2023Recovering a Molecule's 3D Dynamics from Liquid-phase Electron Microscopy Moviescited by 2
- 2023SSIF: Learning Continuous Image Representation for Spatial-Spectral Super-Resolutioncited by 2
- 2024NeST: Neural Stress Tensor Tomography by leveraging 3D Photoelasticitycited by 2
- 2024Mixture of neural fields for heterogeneous reconstruction in cryo-EMcited by 2
- 2025I-INR: Iterative Implicit Neural Representationscited by 2
- 2023Boosted ab initio Cryo-EM 3D Reconstruction with ACE-EMcited by 1
- 2023Improved Cryo-EM Pose Estimation and 3D Classification through Latent-Space Disentanglementcited by 1
- 2023Equivariant Scalar Fields for Molecular Docking with Fast Fourier Transformscited by 1
- 2024cryoSPHERE: Single-particle heterogeneous reconstruction from cryo EMcited by 1
- 2025CryoHype: Reconstructing a thousand cryo-EM structures with transformer-based hypernetworkscited by 1
- 2023Univariate Radial Basis Function Layers: Brain-inspired Deep Neural Layers for Low-Dimensional Inputscited by 0
50 most cited of 56 All 56 (JSON)
- 2025CryoHype: Reconstructing a thousand cryo-EM structures with transformer-based hypernetworks6 Dec 2025
- 2025SBS: Enhancing Parameter-Efficiency of Neural Representations for Neural Networks via Spectral Bias Suppression9 Sep 2025
- 2025Frequency-adaptive tensor neural networks for high-dimensional multi-scale problems21 Aug 2025
- 2025Demystify Protein Generation with Hierarchical Conditional Diffusion Models24 Jul 2025
- 2025Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition26 Jun 2025
- 2025I-INR: Iterative Implicit Neural Representations24 Apr 2025
- 2025Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Exploration1 Apr 2025
- 2025Integrating Predictive and Generative Capabilities by Latent Space Design via the DKL-VAE Model4 Mar 2025
- 2024Mixture of neural fields for heterogeneous reconstruction in cryo-EM12 Dec 2024
- 20243D Equivariant Pose Regression via Direct Wigner-D Harmonics Prediction1 Nov 2024
- 2024MING: A Functional Approach to Learning Molecular Generative Models16 Oct 2024
- 2024Frequency-adaptive Multi-scale Deep Neural Networks28 Sep 2024
38 more
- 2024Poly2Vec: Polymorphic Fourier-Based Encoding of Geospatial Objects for GeoAI Applications27 Aug 2024
- 2024CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EM10 Aug 2024
- 2024TorchSpatial: A Location Encoding Framework and Benchmark for Spatial Representation Learning21 Jun 2024
- 2024NeST: Neural Stress Tensor Tomography by leveraging 3D Photoelasticity14 Jun 2024
- 2024Quantum Implicit Neural Representations6 Jun 2024
- 2024cryoSPHERE: Single-particle heterogeneous reconstruction from cryo EM29 May 2024
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization11 Apr 2024
- 2024MicroDiffusion: Implicit Representation-Guided Diffusion for 3D Reconstruction from Limited 2D Microscopy Projections16 Mar 2024
- 2024Improved Implicit Neural Representation with Fourier Reparameterized Training15 Jan 2024
- 2023Equivariant Scalar Fields for Molecular Docking with Fast Fourier Transforms7 Dec 2023
- 2023VerA: Versatile Anonymization Applicable to Clinical Facial Photographs4 Dec 2023
- 2023Teaching Robots to Build Simulations of Themselves20 Nov 2023
- 2023Univariate Radial Basis Function Layers: Brain-inspired Deep Neural Layers for Low-Dimensional Inputs7 Nov 2023
- 2023SSIF: Learning Continuous Image Representation for Spatial-Spectral Super-Resolution30 Sep 2023
- 2023CoNeS: Conditional neural fields with shift modulation for multi-sequence MRI translation6 Sep 2023
- 2023ResFields: Residual Neural Fields for Spatiotemporal Signals6 Sep 2023
- 2023Robust Point Cloud Processing through Positional Embedding1 Sep 2023
- 2023Recovering a Molecule's 3D Dynamics from Liquid-phase Electron Microscopy Movies23 Aug 2023
- 2023Improved Cryo-EM Pose Estimation and 3D Classification through Latent-Space Disentanglement9 Aug 2023
- 2023Equivariant Single View Pose Prediction Via Induced and Restricted Representations7 Jul 2023
- 2023Sphere2Vec: A General-Purpose Location Representation Learning over a Spherical Surface for Large-Scale Geospatial Predictions30 Jun 2023
- 2023CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representations28 Mar 2023
- 2023Implicit neural representations for unsupervised super-resolution and denoising of 4D flow MRI24 Feb 2023
- 2023Boosted ab initio Cryo-EM 3D Reconstruction with ACE-EM13 Feb 2023
- 2022Latent Space Diffusion Models of Cryo-EM Structures25 Nov 2022
- 2022Generalizable Implicit Neural Representations via Instance Pattern Composers23 Nov 2022
- 2022TINC: Tree-structured Implicit Neural Compression12 Nov 2022
- 2022Track Targets by Dense Spatio-Temporal Position Encoding17 Oct 2022
- 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EM13 Oct 2022
- 2022SCI: A Spectrum Concentrated Implicit Neural Compression for Biomedical Data30 Sep 2022
- 2022Streamable Neural Fields20 Jul 2022
- 2022Theoretical Perspectives on Deep Learning Methods in Inverse Problems29 Jun 2022
- 2022Trading Positional Complexity vs. Deepness in Coordinate Networks18 May 2022
- 2022CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Images15 Mar 2022
- 2022PINs: Progressive Implicit Networks for Multi-Scale Neural Representations9 Feb 2022
- 2022Sphere2Vec: Multi-Scale Representation Learning over a Spherical Surface for Geospatial Predictions25 Jan 2022
- 2021Learning Positional Embeddings for Coordinate-MLPs21 Dec 2021
- 2021Neural Fields in Visual Computing and Beyond22 Nov 2021
50 newest of 56 All 56 (JSON)
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimizationcited by 73
- 2022Latent Space Diffusion Models of Cryo-EM Structurescited by 6
- 2024MicroDiffusion: Implicit Representation-Guided Diffusion for 3D Reconstruction from Limited 2D Microscopy Projectionscited by 6
- 2025Demystify Protein Generation with Hierarchical Conditional Diffusion Modelscited by 0
- 2025Demystify Protein Generation with Hierarchical Conditional Diffusion Models24 Jul 2025
- 2024An Overview of Diffusion Models: Applications, Guided Generation, Statistical Rates and Optimization11 Apr 2024
- 2024MicroDiffusion: Implicit Representation-Guided Diffusion for 3D Reconstruction from Limited 2D Microscopy Projections16 Mar 2024
- 2022Latent Space Diffusion Models of Cryo-EM Structures25 Nov 2022
- 2021Neural Fields in Visual Computing and Beyondcited by 540
- 2021FastNeRF: High-Fidelity Neural Rendering at 200FPScited by 511
- 20213D Infomax improves GNNs for Molecular Property Predictioncited by 146
- 2021A Review of Location Encoding for GeoAI: Methods and Applicationscited by 54
- 2022Generalizable Implicit Neural Representations via Instance Pattern Composerscited by 39
- 2023Sphere2Vec: A General-Purpose Location Representation Learning over a Spherical Surface for Large-Scale Geospatial Predictionscited by 39
- 2021Rethinking Positional Encodingcited by 37
- 2024Improved Implicit Neural Representation with Fourier Reparameterized Trainingcited by 36
- 2024TorchSpatial: A Location Encoding Framework and Benchmark for Spatial Representation Learningcited by 31
- 2023ResFields: Residual Neural Fields for Spatiotemporal Signalscited by 27
- 2022CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Imagescited by 24
- 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EMcited by 23
12 most cited of 52 All 52 (JSON)
- 2025CryoHype: Reconstructing a thousand cryo-EM structures with transformer-based hypernetworks6 Dec 2025
- 2025SBS: Enhancing Parameter-Efficiency of Neural Representations for Neural Networks via Spectral Bias Suppression9 Sep 2025
- 2025Frequency-adaptive tensor neural networks for high-dimensional multi-scale problems21 Aug 2025
- 2025Topology-Aware Modeling for Unsupervised Simulation-to-Reality Point Cloud Recognition26 Jun 2025
- 2025I-INR: Iterative Implicit Neural Representations24 Apr 2025
- 2025Explorable INR: An Implicit Neural Representation for Ensemble Simulation Enabling Efficient Spatial and Parameter Exploration1 Apr 2025
- 2025Integrating Predictive and Generative Capabilities by Latent Space Design via the DKL-VAE Model4 Mar 2025
- 2024Mixture of neural fields for heterogeneous reconstruction in cryo-EM12 Dec 2024
- 20243D Equivariant Pose Regression via Direct Wigner-D Harmonics Prediction1 Nov 2024
- 2024MING: A Functional Approach to Learning Molecular Generative Models16 Oct 2024
- 2024Frequency-adaptive Multi-scale Deep Neural Networks28 Sep 2024
- 2024Poly2Vec: Polymorphic Fourier-Based Encoding of Geospatial Objects for GeoAI Applications27 Aug 2024
12 newest of 52 All 52 (JSON)