mlsanityData to 14 Oct 2026

Towards Foundation Models for Cryo-ET Subtomogram Analysis

arXiv 2509.24311 ↗First posted 29 Sep 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Cryo-electron tomography (cryo-ET) enables in situ visualization of macromolecular structures, where subtomogram analysis tasks such as classification, alignment, and averaging are critical for structural determination. However, effective analysis is hindered by scarce annotations, severe noise, and poor generalization. To address these challenges, we take the first step towards foundation models for cryo-ET subtomograms. First, we introduce CryoEngine, a large-scale synthetic data generator that produces over 904k subtomograms from 452 particle classes for pretraining. Second, we design an Adaptive Phase Tokenization-enhanced Vision Transformer (APT-ViT), which incorporates adaptive phase tokenization as an equivariance-enhancing module that improves robustness to both geometric and semantic variations. Third, we introduce a Noise-Resilient Contrastive Learning (NRCL) strategy to stabilize representation learning under severe noise conditions. Evaluations across 24 synthetic and real datasets demonstrate state-of-the-art (SOTA) performance on all three major subtomogram tasks and strong generalization to unseen datasets, advancing scalable and robust subtomogram analysis in cryo-ET.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 52 of its 109 references that are in the map. First posted on arXiv 29 Sep 2025.

Builds on

52 of 109 references.

References · 52

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  5. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,513
  7. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
  8. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  9. 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,750
  10. 2020Training data-efficient image transformers & distillation through attentioncited by 4,586
  11. 2022A ConvNet for the 2020scited by 3,579
  12. 2020Unsupervised Learning of Visual Features by Contrasting Cluster Assignmentscited by 2,857
38 more
  1. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  2. 2021An Empirical Study of Training Self-Supervised Vision Transformerscited by 1,616
  3. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,214
  4. 2016Group Equivariant Convolutional Networkscited by 1,165
  5. 2021Transformers in Vision: A Surveycited by 1,013
  6. 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 751
  7. 2018Tensor field networks: Rotation- and translation-equivariant neural networks for 3D point cloudscited by 746
  8. 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
  9. 2020SE(3)-Transformers: 3D Roto-Translation Equivariant Attention Networkscited by 607
  10. 2021Conditional Positional Encodings for Vision Transformerscited by 406
  11. 20183D Steerable CNNs: Learning Rotationally Equivariant Features in Volumetric Datacited by 354
  12. 2018On the Generalization of Equivariance and Convolution in Neural Networks to the Action of Compact Groupscited by 300
  13. 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 207
  14. 2018Why do deep convolutional networks generalize so poorly to small image transformations?cited by 198
  15. 2017Learning Steerable Filters for Rotation Equivariant CNNscited by 194
  16. 2020An Analysis of SVD for Deep Rotation Estimationcited by 86
  17. 2021Deep Regression on Manifolds: A 3D Rotation Case Studycited by 67
  18. 2024A Clinical Benchmark of Public Self-Supervised Pathology Foundation Modelscited by 66
  19. 2020Truly shift-invariant convolutional neural networkscited by 53
  20. 2021Fine-Tuning and Training of DenseNet for Histopathology Image Representation Using TCGA Diagnostic Slidescited by 52
  21. 2021Leveraging SE(3) Equivariance for Self-Supervised Category-Level Object Pose Estimationcited by 45
  22. 2022Robust Contrastive Learning against Noisy Viewscited by 45
  23. 2024Learning with 3D rotations, a hitchhiker's guide to SO(3)cited by 42
  24. 2022ConDor: Self-Supervised Canonicalization of 3D Pose for Partial Shapescited by 31
  25. 2022SE(3)-Equivariant Attention Networks for Shape Reconstruction in Function Spacecited by 27
  26. 2022VN-Transformer: Rotation-Equivariant Attention for Vector Neuronscited by 27
  27. 2023Anatomical Invariance Modeling and Semantic Alignment for Self-supervised Learning in 3D Medical Image Analysiscited by 26
  28. 2022Vision Transformers in Medical Computer Vision -- A Contemplative Retrospectioncited by 22
  29. 2022Recent Advances in Vision Transformer: A Survey and Outlook of Recent Workcited by 21
  30. 2022Learnable Polyphase Sampling for Shift Invariant and Equivariant Convolutional Networkscited by 18
  31. 2023Making Vision Transformers Truly Shift-Equivariantcited by 16
  32. 2023Reviving Shift Equivariance in Vision Transformerscited by 9
  33. 2022Self-Supervised Visual Representation Learning via Residual Momentumcited by 7
  34. 2019A complete data processing workflow for CryoET and subtomogram averagingcited by 5
  35. 2024Denoising-Aware Contrastive Learning for Noisy Time Seriescited by 5
  36. 2024SE(3)-bi-equivariant Transformers for Point Cloud Assemblycited by 4
  37. 2024CryoFM: A Flow-based Foundation Model for Cryo-EM Densitiescited by 4
  38. 2024DRACO: A Denoising-Reconstruction Autoencoder for Cryo-EMcited by 4

50 most cited of 52 All 52 (JSON)

Built on by

Not cited yet.