mlsanityData to 14 Oct 2026

Atelier: Learning Local Self-Supervised Features for CryoEM Volumes via Hypernetworks

arXiv 2609.30569 ↗First posted 24 Sep 2026cs.AI stat.MLcited by 0

Not on the map. Why?

Abstract (arXiv)

CryoEM map interpretation requires features that are spatially localized, consistent across samples, and informative across spatial scales. Most deep learning methods for map annotation extract features from fixed voxel grids. However, implicit neural representations (INRs) are able to model volumetric data as scale-agnostic, coordinate-conditioned functions. INRs are therefore attractive for cryoEM, but fitting a separate INR for each map is too expensive for large-scale feature extraction and produces representations that are not aligned across samples. We introduce Atelier, a self-supervised framework that amortizes INR fitting for reconstructed cryoEM maps. Pretrained on 5,439 Electron Microscopy Data Bank maps, Atelier is a transformer-based hypernetwork that generates high-fidelity reconstructions across a wide range of protein structures, including large multi-subunit assemblies. Beyond reconstruction, the INR generated by the pretrained transformer exposes a continuous, local feature field through its intermediate activations at any spatial query point, a property that voxel grid and patch-tokenizer architectures do not naturally provide. Used as auxiliary channels to a 3D nested U-Net annotation head trained from scratch, these coordinate-conditioned features improve performance on eight voxel-level property prediction tasks over a volume-only baseline. Our results demonstrate that amortized implicit neural representations are an effective primitive for geometry-aware analysis of cryoEM data.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 24 of its 64 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

24 of 64 references.

References · 24

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  4. 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
  5. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  6. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  7. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  8. 2016HyperNetworkscited by 1,027
  9. 2019Scene Representation Networks: Continuous 3D-Structure-Aware Neural Scene Representationscited by 864
  10. 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 586
  11. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
  12. 2013DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognitioncited by 424
12 more
  1. 2022Decomposing NeRF for Editing via Feature Field Distillationcited by 371
  2. 2020MetaSDF: Meta-learning Signed Distance Functionscited by 214
  3. 2022From data to functa: Your data point is a function and you can treat it like onecited by 187
  4. 2020Adversarial Generation of Continuous Imagescited by 135
  5. 2022Transformers as Meta-Learners for Implicit Neural Representationscited by 79
  6. 2024CryoBench: Diverse and challenging datasets for the heterogeneity problem in cryo-EMcited by 15
  7. 2023Magnitude Invariant Parametrizations Improve Hypernetwork Learningcited by 14
  8. 2023Hypernetworks build Implicit Neural Representations of Soundscited by 11
  9. 2023Pearson-Matthews correlation coefficients for binary and multinary classification and hypothesis testingcited by 4
  10. 2022A Graph Neural Network Approach to Automated Model Building in Cryo-EM Mapscited by 3
  11. 2025Acquiring and Adapting Priors for Novel Tasks via Neural Meta-Architecturescited by 2
  12. 2025CryoHype: Reconstructing a thousand cryo-EM structures with transformer-based hypernetworkscited by 1

Built on by

Not cited yet.