mlsanityData to 7 Oct 2026

Frequency-Aware Dual-Stream Learning for Balanced Realism and Fidelity in Electron Microscopy Imaging

arXiv 2607.22765 ↗First posted 24 Jul 2026eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Electron microscopy enables nanoscale cellular visualization but faces a trade-off between imaging resolution and acquisition speed. Existing learning-based methods rely on single-stream architectures that struggle to balance perceptual realism and quantitative fidelity, either over-smoothing details or generating unrealistic hallucinations. This work introduces a frequency-adaptive dual-stream architecture to resolve this conflict. Using discrete wavelet transform, we decompose images into low-frequency structures and high-frequency details, then employ a conditional diffusion model for realistic global synthesis and a transformer network for precise detail recovery. Experiments on the EMDiffuse dataset show the method achieves superior LPIPS and resolution ratio, substantially outperforming existing approaches. The method also shows strong generalization across diverse biological samples, supporting fast and reliable electron microscopy imaging for structural biology and nanotechnology applications. The source code and associated dataset are publicly available to facilitate further research.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 61 references that are in the map. First posted on arXiv 24 Jul 2026.

Builds on

23 of 61 references.

References · 23

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
  6. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  7. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  8. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  9. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  10. 2016Beyond a Gaussian Denoiser: Residual Learning of Deep CNN for Image Denoisingcited by 1,352
  11. 2018On the Spectral Bias of Neural Networkscited by 1,321
  12. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
11 more
  1. 2022Denoising Diffusion Restoration Modelscited by 951
  2. 2015Accurate Image Super-Resolution Using Very Deep Convolutional Networkscited by 902
  3. 2021SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Modelscited by 415
  4. 2023Low-Light Image Enhancement with Wavelet-based Diffusion Modelscited by 126
  5. 2023Dual Aggregation Transformer for Image Super-Resolutioncited by 124
  6. 2022Wavelet Diffusion Models are fast and scalable Image Generatorscited by 116
  7. 2024Wavelet Convolutions for Large Receptive Fieldscited by 74
  8. 2024LiteVAE: Lightweight and Efficient Variational Autoencoders for Latent Diffusion Modelscited by 22
  9. 2021SWAGAN: A Style-based Wavelet-driven Generative Modelcited by 17
  10. 2022Wavelet Feature Maps Compression for Image-to-Image CNNscited by 16
  11. 2024CDFormer:When Degradation Prediction Embraces Diffusion Model for Blind Image Super-Resolutioncited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Reference-Free Isotropic 3D EM Reconstruction using Diffusion Models
  2. 2026A Mixture of Experts Foundation Model for Scanning Electron Microscopy Image Analysis
  3. 2026High-Fidelity Synthetic Transmission Electron Microscopy Image Generation Using Diffusion Probabilistic Models for Data-Limited Semiconductor Metrology
  4. 2024From Diffusion to Resolution: Leveraging 2D Diffusion Models for 3D Super-Resolution Task
  5. 2026SkelEM: Training-Signal Decoupling of Skeleton and Diffusion for Self-supervised Axial Super-Resolution in Volume Microscopy
  6. 2024Multi-scale Conditional Generative Modeling for Microscopic Image Restoration
  7. 2026STEMGym: Benchmarking Sequential Decision-Making under Dose Budgets in Autonomous Electron Microscopy
  8. 2025Iterative Inference-time Scaling with Adaptive Frequency Steering for Image Super-Resolution