mlsanityData to 14 Oct 2026

Improved Cryo-EM Pose Estimation and 3D Classification through Latent-Space Disentanglement

arXiv 2308.04956 ↗First posted 9 Aug 2023eess.IV cs.CV q-bio.BMcited by 1

Not on the map. Why?

Abstract (arXiv)

Due to the extremely low signal-to-noise ratio (SNR) and unknown poses (projection angles and image shifts) in cryo-electron microscopy (cryo-EM) experiments, reconstructing 3D volumes from 2D images is very challenging. In addition to these challenges, heterogeneous cryo-EM reconstruction requires conformational classification. In popular cryo-EM reconstruction algorithms, poses and conformation classification labels must be predicted for every input cryo-EM image, which can be computationally costly for large datasets. An emerging class of methods adopted the amortized inference approach. In these methods, only a subset of the input dataset is needed to train neural networks for the estimation of poses and conformations. Once trained, these neural networks can make pose/conformation predictions and 3D reconstructions at low cost for the entire dataset during inference. Unfortunately, when facing heterogeneous reconstruction tasks, it is hard for current amortized-inference-based methods to effectively estimate the conformational distribution and poses from entangled latent variables. Here, we propose a self-supervised variational autoencoder architecture called "HetACUMN" based on amortized inference. We employed an auxiliary conditional pose prediction task by inverting the order of encoder-decoder to explicitly enforce the disentanglement of conformation and pose predictions. Results on simulated datasets show that HetACUMN generated more accurate conformational classifications than other amortized or non-amortized methods. Furthermore, we show that HetACUMN is capable of performing heterogeneous 3D reconstructions of a real experimental dataset.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 9 of its 30 references that are in the map. First posted on arXiv 9 Aug 2023.

Builds on

9 of 30 references.

References · 9

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  3. 2019Reconstructing continuous distributions of 3D protein structure from cryo-EM imagescited by 56
  4. 2022CryoAI: Amortized Inference of Poses for Ab Initio Reconstruction of 3D Molecular Volumes from Real Cryo-EM Imagescited by 24
  5. 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EMcited by 23
  6. 2022Deep Generative Modeling for Volume Reconstruction in Cryo-Electron Microscopycited by 19
  7. 2021Inferring a Continuous Distribution of Atom Coordinates from Cryo-EM Images using VAEscited by 17
  8. 2019Differentiable probabilistic models of scientific imaging with the Fourier slice theoremcited by 6
  9. 2019Hyper-Molecules: on the Representation and Recovery of Dynamical Structures, with Application to Flexible Macro-Molecular Structures in Cryo-EMcited by 4

Built on by

Cited by year

Citing papers per year: 2023: 1.

1 paper.