mlsanityData to 7 Oct 2026

CryoHype: Reconstructing a thousand cryo-EM structures with transformer-based hypernetworks

arXiv 2512.06332 ↗First posted 6 Dec 2025cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Cryo-electron microscopy (cryo-EM) is an indispensable technique for determining the 3D structures of dynamic biomolecular complexes. While typically applied to image a single molecular species, cryo-EM has the potential for structure determination of many targets simultaneously in a high-throughput fashion. However, existing methods typically focus on modeling conformational heterogeneity within a single or a few structures and are not designed to resolve compositional heterogeneity arising from mixtures of many distinct molecular species. To address this challenge, we propose CryoHype, a transformer-based hypernetwork for cryo-EM reconstruction that dynamically adjusts the weights of an implicit neural representation. Using CryoHype, we achieve state-of-the-art results on a challenging benchmark dataset containing 100 structures. We further demonstrate that CryoHype scales to the reconstruction of 1,000 distinct structures from unlabeled cryo-EM images in the fixed-pose setting.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 26 of its 61 references that are in the map. First posted on arXiv 6 Dec 2025.

Builds on

26 of 61 references.

References · 26

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  4. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,841
  5. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  6. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  7. 2016HyperNetworkscited by 1,003
  8. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  9. 2020pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesiscited by 708
  10. 2021Neural Fields in Visual Computing and Beyondcited by 539
  11. 2021Light Field Networks: Neural Scene Representations with Single-Evaluation Renderingcited by 330
  12. 2020Learned Initializations for Optimizing Coordinate-Based Neural Representationscited by 240
14 more
  1. 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
  2. 2021Modulated Periodic Activations for Generalizable Local Functional Representationscited by 140
  3. 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
  4. 2019Association of genomic subtypes of lower-grade gliomas with shape features automatically extracted by a deep learning algorithmcited by 76
  5. 2019Reconstructing continuous distributions of 3D protein structure from cryo-EM imagescited by 56
  6. 2022Generalizable Implicit Neural Representations via Instance Pattern Composerscited by 38
  7. 2022Amortized Inference for Heterogeneous Reconstruction in Cryo-EMcited by 23
  8. 2023Locality-Aware Generalizable Implicit Neural Representationcited by 16
  9. 2024CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EMcited by 15
  10. 2023Magnitude Invariant Parametrizations Improve Hypernetwork Learningcited by 14
  11. 2024Learning Transferable Features for Implicit Neural Representationscited by 14
  12. 2023Generalizable Neural Fields as Partially Observed Neural Processescited by 7
  13. 2025Foundation Models Secretly Understand Neural Network Weights: Enhancing Hypernetwork Architectures with Foundation Modelscited by 6
  14. 2024Mixture of neural fields for heterogeneous reconstruction in cryo-EMcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.