Improved Cryo-EM Pose Estimation and 3D Classification through Latent-Space Disentanglement
Not on the map. Why?
Abstract (arXiv)
Due to the extremely low signal-to-noise ratio (SNR) and unknown poses (projection angles and image shifts) in cryo-electron microscopy (cryo-EM) experiments, reconstructing 3D volumes from 2D images is very challenging. In addition to these challenges, heterogeneous cryo-EM reconstruction requires conformational classification. In popular cryo-EM reconstruction algorithms, poses and conformation classification labels must be predicted for every input cryo-EM image, which can be computationally costly for large datasets. An emerging class of methods adopted the amortized inference approach. In these methods, only a subset of the input dataset is needed to train neural networks for the estimation of poses and conformations. Once trained, these neural networks can make pose/conformation predictions and 3D reconstructions at low cost for the entire dataset during inference. Unfortunately, when facing heterogeneous reconstruction tasks, it is hard for current amortized-inference-based methods to effectively estimate the conformational distribution and poses from entangled latent variables. Here, we propose a self-supervised variational autoencoder architecture called "HetACUMN" based on amortized inference. We employed an auxiliary conditional pose prediction task by inverting the order of encoder-decoder to explicitly enforce the disentanglement of conformation and pose predictions. Results on simulated datasets show that HetACUMN generated more accurate conformational classifications than other amortized or non-amortized methods. Furthermore, we show that HetACUMN is capable of performing heterogeneous 3D reconstructions of a real experimental dataset.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 30 references that are in the map. First posted on arXiv 9 Aug 2023.
Builds on
9 of 30 references.
References · 9
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2019Reconstructing continuous distributions of 3D protein structure from cryo-EM imagescited by 56
- 2022CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Imagescited by 24
- 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EMcited by 23
- 2022Deep Generative Modeling for Volume Reconstruction in Cryo-Electron Microscopycited by 19
- 2021Inferring a Continuous Distribution of Atom Coordinates from Cryo-EM Images using VAEscited by 17
- 2019Differentiable probabilistic models of scientific imaging with the Fourier slice theoremcited by 6
- 2019Hyper-Molecules: on the Representation and Recovery of Dynamical Structures, with Application to Flexible Macro-Molecular Structures in Cryo-EMcited by 4
Built on by
Citing papers per year: 2023: 1.
1 paper.