mlsanityData to 7 Oct 2026

A Unified Framework for Microscopy Defocus Deblur with Multi-Pyramid Transformer and Contrastive Learning

arXiv 2403.02611 ↗First posted 5 Mar 2024cs.CV cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

Defocus blur is a persistent problem in microscope imaging that poses harm to pathology interpretation and medical intervention in cell microscopy and microscope surgery. To address this problem, a unified framework including the multi-pyramid transformer (MPT) and extended frequency contrastive regularization (EFCR) is proposed to tackle two outstanding challenges in microscopy deblur: longer attention span and data deficiency. The MPT employs an explicit pyramid structure at each network stage that integrates the cross-scale window attention (CSWA), the intra-scale channel attention (ISCA), and the feature-enhancing feed-forward network (FEFN) to capture long-range cross-scale spatial interaction and global channel context. The EFCR addresses the data deficiency problem by exploring latent deblur signals from different frequency bands. It also enables deblur knowledge transfer to learn cross-domain information from extra data, improving deblur performance for labeled and unlabeled data. Extensive experiments and downstream task validation show the framework achieves state-of-the-art performance across multiple datasets. Project page: https://github.com/PieceZhang/MPT-CataBlur.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 42 of its 97 references that are in the map. First posted on arXiv 5 Mar 2024.

Builds on

42 of 97 references.

References · 42

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  6. 2016Layer Normalizationcited by 5,579
  7. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
  8. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  9. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
  10. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  11. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
  12. 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
30 more
  1. 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
  2. 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
  3. 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
  4. 2021Rethinking Coarse-to-Fine Approach in Single Image Deblurringcited by 324
  5. 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
  6. 2022Vision Transformer with Deformable Attentioncited by 293
  7. 2021Scaling Local Self-Attention for Parameter Efficient Visual Backbonescited by 220
  8. 2018Cell Detection with Star-convex Polygonscited by 182
  9. 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
  10. 2020Defocus Deblurring Using Dual-Pixel Datacited by 138
  11. 2023Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Groupingcited by 92
  12. 2021Iterative Filter Adaptive Network for Single Image Defocus Deblurringcited by 85
  13. 2023Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Modelcited by 69
  14. 2023Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objectscited by 56
  15. 2021Single Image Defocus Deblurring Using Kernel-Sharing Parallel Atrous Convolutionscited by 54
  16. 2022Learning to Deblur using Light Field Generated and Real Defocus Imagescited by 46
  17. 2022MSSNet: Multi-Scale-Stage Network for Single Image Deblurringcited by 31
  18. 2021A Practical Contrastive Learning Framework for Single-Image Super-Resolutioncited by 30
  19. 2022Benchmarking the Robustness of Deep Neural Networks to Common Corruptions in Digital Pathologycited by 26
  20. 2021Gaussian Kernel Mixture Network for Single Image Defocus Deblurringcited by 20
  21. 2022FCL-GAN: A Lightweight and Real-Time Baseline for Unsupervised Blind Image Deblurringcited by 18
  22. 2022Multi-scale frequency separation network for image deblurringcited by 18
  23. 2022CellTranspose: Few-shot Domain Adaptation for Cellular Instance Segmentationcited by 11
  24. 2021EDPN: Enhanced Deep Pyramid Network for Blurry Image Restorationcited by 9
  25. 2019A New Deep Learning Method for Image Deblurring in Optical Microscopic Systemscited by 7
  26. 2020Blind deblurring for microscopic pathology images using deep learning networkscited by 6
  27. 2021TDACNN: Target-domain-free Domain Adaptation Convolutional Neural Network for Drift Compensation in Gas Sensorscited by 4
  28. 2020Deep learning Framework for Mobile Microscopycited by 3
  29. 2023Hierarchical Contrastive Learning for Pattern-Generalizable Image Corruption Detectioncited by 3
  30. 2022Defocus Deblur Microscopy via Head-to-Tail Cross-scale Fusioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 6; 2026: 3.

13 papers.

Sort:

By area: