mlsanityData to 14 Oct 2026

Mixture of neural fields for heterogeneous reconstruction in cryo-EM

arXiv 2412.09420 ↗First posted 12 Dec 2024cs.LGcited by 2

Not on the map. Why?

Abstract (arXiv)

Cryo-electron microscopy (cryo-EM) is an experimental technique for protein structure determination that images an ensemble of macromolecules in near-physiological contexts. While recent advances enable the reconstruction of dynamic conformations of a single biomolecular complex, current methods do not adequately model samples with mixed conformational and compositional heterogeneity. In particular, datasets containing mixtures of multiple proteins require the joint inference of structure, pose, compositional class, and conformational states for 3D reconstruction. Here, we present Hydra, an approach that models both conformational and compositional heterogeneity fully ab initio by parameterizing structures as arising from one of K neural fields. We employ a new likelihood-based loss function and demonstrate the effectiveness of our approach on synthetic datasets composed of mixtures of proteins with large degrees of conformational variability. We additionally demonstrate Hydra on an experimental dataset of a cellular lysate containing a mixture of different protein complexes. Hydra expands the expressivity of heterogeneous reconstruction methods and thus broadens the scope of cryo-EM to increasingly complex samples.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 26 of its 69 references that are in the map. First posted on arXiv 12 Dec 2024.

Builds on

26 of 69 references.

References · 26

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2019DeepSDF: Learning Continuous Signed Distance Functions for Shape Representationcited by 2,689
  3. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  4. 2018Occupancy Networks: Learning 3D Reconstruction in Function Spacecited by 2,041
  5. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  6. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  7. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  8. 2018Learning Implicit Fields for Generative Shape Modelingcited by 1,060
  9. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  10. 2020Convolutional Occupancy Networkscited by 761
  11. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
  12. 2022Block-NeRF: Scalable Large Scene Neural View Synthesiscited by 724
14 more
  1. 2021KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPscited by 673
  2. 2020Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Dynamic Scene From Monocular Videocited by 471
  3. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
  4. 2021Neural Geometric Level of Detail: Real-time Rendering with Implicit 3D Shapescited by 426
  5. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  6. 2018DeepVoxels: Learning Persistent 3D Feature Embeddingscited by 405
  7. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 332
  8. 2020Neural Scene Graphs for Dynamic Scenescited by 298
  9. 2020DeRF: Decomposed Radiance Fieldscited by 163
  10. 2019Reconstructing continuous distributions of 3D protein structure from cryo-EM imagescited by 56
  11. 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EMcited by 23
  12. 2021Inferring a Continuous Distribution of Atom Coordinates from Cryo-EM Images using VAEscited by 17
  13. 2019Cryo-EM reconstruction of continuous heterogeneity by Laplacian spectral volumescited by 5
  14. 2017Continuously heterogeneous hyper-objects in cryo-EM and 3-D movies of many temporal dimensionscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.