CryoFM: A Flow-based Foundation Model for Cryo-EM Densities
Not on the map. Why?
Abstract (arXiv)
Cryo-electron microscopy (cryo-EM) is a powerful technique in structural biology and drug discovery, enabling the study of biomolecules at high resolution. Significant advancements by structural biologists using cryo-EM have led to the production of over 38,626 protein density maps at various resolutions1. However, cryo-EM data processing algorithms have yet to fully benefit from our knowledge of biomolecular density maps, with only a few recent models being data-driven but limited to specific tasks. In this study, we present CryoFM, a foundation model designed as a generative model, learning the distribution of high-quality density maps and generalizing effectively to downstream tasks. Built on flow matching, CryoFM is trained to accurately capture the prior distribution of biomolecular density maps. Furthermore, we introduce a flow posterior sampling method that leverages CRYOFM as a flexible prior for several downstream tasks in cryo-EM and cryo-electron tomography (cryo-ET) without the need for fine-tuning, achieving state-of-the-art performance on most tasks and demonstrating its potential as a foundational model for broader applications in these fields.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 47 of its 106 references that are in the map. First posted on arXiv 11 Oct 2024.
Builds on
47 of 106 references.
References · 47
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023GPT-4 Technical Reportcited by 18,396
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2017Neural Discrete Representation Learningcited by 4,712
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2018Neural Ordinary Differential Equationscited by 3,779
35 more
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Elucidating the Design Space of Diffusion-Based Generative Modelscited by 3,045
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2023Stable Video Diffusion: Scaling Latent Video Diffusion Models to Large Datasetscited by 2,581
- 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,488
- 2022Diffusion Posterior Sampling for General Noisy Inverse Problemscited by 1,416
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
- 2022Denoising Diffusion Restoration Modelscited by 963
- 2016Pixel Recurrent Neural Networkscited by 816
- 2018FFJORD: Free-form Continuous Dynamics for Scalable Reversible Generative Modelscited by 594
- 2017The Perception-Distortion Tradeoffcited by 587
- 2021Solving Inverse Problems in Medical Imaging with Score-Based Generative Modelscited by 521
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 483
- 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 470
- 2023Simple diffusion: End-to-end diffusion for high resolution imagescited by 422
- 2019DeblurGAN-v2: Deblurring (Orders-of-Magnitude) Faster and Bettercited by 362
- 2018Deep Back-Projection Networks For Super-Resolutioncited by 225
- 2023SE(3) diffusion model with application to protein backbone generationcited by 219
- 2021SNIPS: Solving Noisy Inverse Problems Stochasticallycited by 191
- 2023Flow Matching in Latent Spacecited by 160
- 2016Semantic Image Inpainting with Deep Generative Modelscited by 157
- 2023SE(3)-Stochastic Flow Matching for Protein Backbone Generationcited by 150
- 2022Solving 3D Inverse Problems using Pre-trained 2D Diffusion Modelscited by 132
- 2019Noisier2Noise: Learning to Denoise from Unpaired Noisy Datacited by 126
- 2024Scalable High-Resolution Pixel-Space Image Synthesis with Hourglass Diffusion Transformerscited by 118
- 2022Parallel Diffusion Models of Operator and Image for Blind Inverse Problemscited by 113
- 2021Hierarchical Transformers Are More Efficient Language Modelscited by 102
- 2024Diffusion Language Models Are Versatile Protein Learnerscited by 98
- 2018Theory and Experiments on Vector Quantized Autoencoderscited by 55
- 2023MAS: Multi-view Ancestral Sampling for 3D motion generation using 2D diffusioncited by 37
- 2023Fast Diffusion EM: a diffusion model for blind inverse problems with application to deconvolutioncited by 36
- 2024Solving Inverse Problems in Protein Space Using Diffusion-Based Priorscited by 13
- 2023Block Coordinate Plug-and-Play Methods for Blind Inverse Problemscited by 8
- 2022Latent Space Diffusion Models of Cryo-EM Structurescited by 6
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Towards Foundation Models for Cryo-ET Subtomogram Analysiscited by 0
- 2026CryoLVM: Self-supervised Learning from Cryo-EM Density Maps with Large Vision Modelscited by 0
- 2026CryoProt: A Protein Pretraining Framework with Cross-Box Interactions on Cryo-EM Density Mapscited by 0
- 2026ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopycited by 0
- 2026ARCHER: Amortized cross-specimen pose estimation for cryo-electron microscopy22 Aug 2026
- 2026CryoProt: A Protein Pretraining Framework with Cross-Box Interactions on Cryo-EM Density Maps31 May 2026
- 2026CryoLVM: Self-supervised Learning from Cryo-EM Density Maps with Large Vision Models2 Feb 2026
- 2025Towards Foundation Models for Cryo-ET Subtomogram Analysis29 Sep 2025
Similar, not cited
Close in wording, no citation either way
- 2025CryoCCD: Conditional Cycle-consistent Diffusion with Biophysical Modeling for Cryo-EM Synthesis
- 2025cryoSENSE: Compressive Sensing Enables High-throughput Microscopy with Sparse and Generative Priors on the Protein Cryo-EM Image Manifold
- 2026CryoNet.Refine: A One-step Diffusion Model for Rapid Refinement of Structural Models with Cryo-EM Density Map Restraints
- 2025SemiETPicker: Fast and Label-Efficient Particle Picking for CryoET Tomography Using Semi-Supervised Learning
- 2026Cryo-SWAN: the Multi-Scale Wavelet-decomposition-inspired Autoencoder Network for molecular density representation of molecular volumes
- 2026Few-step Cofolding with All-Atom Flow Maps
- 2026Robust Inference-Time Steering of Protein Diffusion Models via Embedding Optimization
- 2024AlphaFold Meets Flow Matching for Generating Protein Ensembles