CryoHype: Reconstructing a thousand cryo-EM structures with transformer-based hypernetworks
Not on the map. Why?
Abstract (arXiv)
Cryo-electron microscopy (cryo-EM) is an indispensable technique for determining the 3D structures of dynamic biomolecular complexes. While typically applied to image a single molecular species, cryo-EM has the potential for structure determination of many targets simultaneously in a high-throughput fashion. However, existing methods typically focus on modeling conformational heterogeneity within a single or a few structures and are not designed to resolve compositional heterogeneity arising from mixtures of many distinct molecular species. To address this challenge, we propose CryoHype, a transformer-based hypernetwork for cryo-EM reconstruction that dynamically adjusts the weights of an implicit neural representation. Using CryoHype, we achieve state-of-the-art results on a challenging benchmark dataset containing 100 structures. We further demonstrate that CryoHype scales to the reconstruction of 1,000 distinct structures from unlabeled cryo-EM images in the fixed-pose setting.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 61 references that are in the map. First posted on arXiv 6 Dec 2025.
Builds on
26 of 61 references.
References · 26
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
- 2016HyperNetworkscited by 1,003
- 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
- 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
- 2021Neural Fields in Visual Computing and Beyondcited by 539
- 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
- 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 240
14 more
- 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
- 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
- 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
- 2019Association of genomic subtypes of lower-grade gliomas with shape features automatically extracted by a deep learning algorithmcited by 76
- 2019Reconstructing continuous distributions of 3D protein structure from cryo-EM imagescited by 56
- 2022Generalizable Implicit Neural Representations via Instance Pattern Composerscited by 38
- 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EMcited by 23
- 2023Locality-Aware Generalizable Implicit Neural Representationcited by 16
- 2024CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EMcited by 15
- 2023Magnitude Invariant Parametrizations Improve Hypernetwork Learningcited by 14
- 2024Learning Transferable Features for Implicit Neural Representationscited by 14
- 2023Generalizable Neural Fields as Partially Observed Neural Processescited by 7
- 2025Foundation Models Secretly Understand Neural Network Weights: Enhancing Hypernetwork Architectures with Foundation Modelscited by 6
- 2024Mixture of neural fields for heterogeneous reconstruction in cryo-EMcited by 2
Built on by
Citing papers per year: 2026: 1.
1 paper.