Cryo-SWAN: the Multi-Scale Wavelet-decomposition-inspired Autoencoder Network for molecular density representation of molecular volumes
Not on the map. Why?
Abstract (arXiv)
Learning robust representations of 3D shapes from voxelized data is essential for advancing AI methods in biomedical imaging. However, most contemporary 3D computer vision approaches operate on point clouds, meshes, or octrees, while volumetric density maps, the native format of structural biology and cryo-EM, remain comparatively underexplored. We present Cryo-SWAN, a voxel-based variational autoencoder inspired by multi-scale wavelet decomposition. The model performs conditional coarse-to-fine latent encoding and recursive residual quantization across perception scales, enabling accurate capture of both global geometry and high-frequency structural detail in molecular density volumes. Evaluated on ModelNet40, BuildingNet, and a newly curated dataset of cryo-EM volumes, ProteinNet3D, Cryo-SWAN consistently improves reconstruction quality over state-of-the-art 3D autoencoders. We demonstrate that the molecular densities organize in learned latent space according to shared geometric features, while integration with diffusion models enables denoising and conditional shape generation. Together, Cryo-SWAN is a practical framework for data-driven structural biology and volumetric imaging.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 52 references that are in the map. First posted on arXiv 18 Feb 2026.
Builds on
27 of 52 references.
References · 27
- 2017Attention Is All You Needcited by 59,932
- 2022Generative Adversarial Networkscited by 5,603
- 2017Neural Discrete Representation Learningcited by 4,650
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2023Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Modelscited by 1,465
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,376
- 2018On the Spectral Bias of Neural Networkscited by 1,321
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,005
- 2021Multi-Stage Progressive Image Restorationcited by 813
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 756
- 2022Autoregressive Image Generation using Residual Quantizationcited by 706
- 2020Transformer Interpretability Beyond Attention Visualizationcited by 620
15 more
- 2022SDFusion: Multimodal 3D Shape Completion, Reconstruction, and Generationcited by 287
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 225
- 2022AutoSDF: Shape Priors for 3D Completion, Reconstruction and Generationcited by 208
- 2023XCube: Large-Scale 3D Generative Modeling using Sparse Voxel Hierarchiescited by 183
- 2024Dora: Sampling and Benchmarking for 3D Shape Variational Auto-Encoderscited by 93
- 2024Advances in 3D Generation: A Surveycited by 62
- 2024OctFusion: Octree-based Diffusion Models for 3D Shape Generationcited by 40
- 2021BuildingNet: Learning to Label 3D Buildingscited by 33
- 2023HQ-VAE: Hierarchical Discrete Representation Learning with Variational Bayescited by 27
- 2019Tutorial: Deriving the Standard Variational Autoencoder (VAE) Loss Functioncited by 26
- 2018BCR-Net: a neural network based on the nonstandard wavelet formcited by 18
- 2023ViT-AE++: Improving Vision Transformer Autoencoder for Self-supervised Medical Image Representationscited by 12
- 2022Unsupervised Object Representation Learning using Translation and Rotation Group Equivariant VAEcited by 8
- 2023A Deep Learning Method for Simultaneous Denoising and Missing Wedge Reconstruction in Cryogenic Electron Tomographycited by 7
- 2024Solving the inverse problem of microscopy deconvolution with a residual Beylkin-Coifman-Rokhlin neural networkcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2022Latent Space Diffusion Models of Cryo-EM Structures
- 2024CryoFM: A Flow-based Foundation Model for Cryo-EM Densities
- 2025cryoSENSE: Compressive Sensing Enables High-throughput Microscopy with Sparse and Generative Priors on the Protein Cryo-EM Image Manifold
- 2026SinAE: A Single-Architecture Flow-Matching Autoencoder for Cross-Domain Atomic Systems
- 2025Compressing Biology: Evaluating the Stable Diffusion VAE for Phenotypic Drug Discovery
- 2025ProteinAE: Protein Diffusion Autoencoders for Structure Encoding
- 2026CryoNet.Refine: A One-step Diffusion Model for Rapid Refinement of Structural Models with Cryo-EM Density Map Restraints
- 2025Unified Cross-Scale 3D Generation and Understanding via Autoregressive Modeling