A Unified Framework for Microscopy Defocus Deblur with Multi-Pyramid Transformer and Contrastive Learning
Not on the map. Why?
Abstract (arXiv)
Defocus blur is a persistent problem in microscope imaging that poses harm to pathology interpretation and medical intervention in cell microscopy and microscope surgery. To address this problem, a unified framework including the multi-pyramid transformer (MPT) and extended frequency contrastive regularization (EFCR) is proposed to tackle two outstanding challenges in microscopy deblur: longer attention span and data deficiency. The MPT employs an explicit pyramid structure at each network stage that integrates the cross-scale window attention (CSWA), the intra-scale channel attention (ISCA), and the feature-enhancing feed-forward network (FEFN) to capture long-range cross-scale spatial interaction and global channel context. The EFCR addresses the data deficiency problem by exploring latent deblur signals from different frequency bands. It also enables deblur knowledge transfer to learn cross-domain information from extra data, improving deblur performance for labeled and unlabeled data. Extensive experiments and downstream task validation show the framework achieves state-of-the-art performance across multiple datasets. Project page: https://github.com/PieceZhang/MPT-CataBlur.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 42 of its 97 references that are in the map. First posted on arXiv 5 Mar 2024.
Builds on
42 of 97 references.
References · 42
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2016Layer Normalizationcited by 5,579
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2016Gaussian Error Linear Units (GELUs)cited by 3,431
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,618
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
30 more
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
- 2021Uformer: A General U-Shaped Transformer for Image Restorationcited by 864
- 2019Segmentation Transformer: Object-Contextual Representations for Semantic Segmentationcited by 573
- 2021Rethinking Coarse-to-Fine Approach in Single Image Deblurringcited by 324
- 2021CMT: Convolutional Neural Networks Meet Vision Transformerscited by 310
- 2022Vision Transformer with Deformable Attentioncited by 293
- 2021Scaling Local Self-Attention for Parameter Efficient Visual Backbonescited by 220
- 2018Cell Detection with Star-convex Polygonscited by 182
- 2023Efficient and Explicit Modelling of Image Hierarchies for Image Restorationcited by 145
- 2020Defocus Deblurring Using Dual-Pixel Datacited by 138
- 2023Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Groupingcited by 92
- 2021Iterative Filter Adaptive Network for Single Image Defocus Deblurringcited by 85
- 2023Reti-Diff: Illumination Degradation Image Restoration with Retinex-based Latent Diffusion Modelcited by 69
- 2023Strategic Preys Make Acute Predators: Enhancing Camouflaged Object Detectors by Generating Camouflaged Objectscited by 56
- 2021Single Image Defocus Deblurring Using Kernel-Sharing Parallel Atrous Convolutionscited by 54
- 2022Learning to Deblur using Light Field Generated and Real Defocus Imagescited by 46
- 2022MSSNet: Multi-Scale-Stage Network for Single Image Deblurringcited by 31
- 2021A Practical Contrastive Learning Framework for Single-Image Super-Resolutioncited by 30
- 2022Benchmarking the Robustness of Deep Neural Networks to Common Corruptions in Digital Pathologycited by 26
- 2021Gaussian Kernel Mixture Network for Single Image Defocus Deblurringcited by 20
- 2022FCL-GAN: A Lightweight and Real-Time Baseline for Unsupervised Blind Image Deblurringcited by 18
- 2022Multi-scale frequency separation network for image deblurringcited by 18
- 2022CellTranspose: Few-shot Domain Adaptation for Cellular Instance Segmentationcited by 11
- 2021EDPN: Enhanced Deep Pyramid Network for Blurry Image Restorationcited by 9
- 2019A New Deep Learning Method for Image Deblurring in Optical Microscopic Systemscited by 7
- 2020Blind deblurring for microscopic pathology images using deep learning networkscited by 6
- 2021TDACNN: Target-domain-free Domain Adaptation Convolutional Neural Network for Drift Compensation in Gas Sensorscited by 4
- 2020Deep learning Framework for Mobile Microscopycited by 3
- 2023Hierarchical Contrastive Learning for Pattern-Generalizable Image Corruption Detectioncited by 3
- 2022Defocus Deblur Microscopy via Head-to-Tail Cross-scale Fusioncited by 2
Built on by
Citing papers per year: 2024: 4; 2025: 6; 2026: 3.
13 papers.
Sort:
By area:
- 2024Real-world Image Dehazing with Coherence-based Pseudo Labeling and Cooperative Unfolding Networkcited by 26
- 2025Integrating Extra Modality Helps Segmentor Find Camouflaged Objects Wellcited by 14
- 2024Motion-Guided Dual-Camera Tracker for Endoscope Tracking and Motion Analysis in a Mechanical Gastric Simulatorcited by 10
- 2024MambaXCTrack: Mamba-based Tracker with SSM Cross-correlation and Motion Prompt for Ultrasound Needle Trackingcited by 4
- 2025Generative Refocusing: Flexible Defocus Control from a Single Imagecited by 3
- 2024Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairscited by 2
- 2025MrTrack: Register Mamba for Needle Tracking with Rapid Reciprocating Motion during Ultrasound-Guided Aspiration Biopsycited by 2
- 2025DeshadowMamba: Deshadowing as 1D Sequential Similaritycited by 1
- 2026A Vision-Language-Action Model for Adaptive Ultrasound-Guided Needle Insertion and Needle Trackingcited by 1
- 2025Pathology Image Restoration via Mixture of Promptscited by 0
- 2025Joint Deblurring and 3D Reconstruction for Macrophotographycited by 0
- 2026Discontinuous Galerkin Neural Operator for Pathology Defocus Deblurringcited by 0
1 more
- 2026ErA: Error-Aware Deep Unrolling Network for Single Image Defocus Deblurring4 Jun 2026
- 2026Discontinuous Galerkin Neural Operator for Pathology Defocus Deblurring22 May 2026
- 2026A Vision-Language-Action Model for Adaptive Ultrasound-Guided Needle Insertion and Needle Tracking22 Apr 2026
- 2025Generative Refocusing: Flexible Defocus Control from a Single Image18 Dec 2025
- 2025DeshadowMamba: Deshadowing as 1D Sequential Similarity28 Oct 2025
- 2025Joint Deblurring and 3D Reconstruction for Macrophotography2 Oct 2025
- 2025MrTrack: Register Mamba for Needle Tracking with Rapid Reciprocating Motion during Ultrasound-Guided Aspiration Biopsy14 May 2025
- 2025Pathology Image Restoration via Mixture of Prompts16 Mar 2025
- 2025Integrating Extra Modality Helps Segmentor Find Camouflaged Objects Well20 Feb 2025
- 2024MambaXCTrack: Mamba-based Tracker with SSM Cross-correlation and Motion Prompt for Ultrasound Needle Tracking13 Nov 2024
- 2024Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairs26 Sep 2024
- 2024Real-world Image Dehazing with Coherence-based Pseudo Labeling and Cooperative Unfolding Network12 Jun 2024
- 2024MambaXCTrack: Mamba-based Tracker with SSM Cross-correlation and Motion Prompt for Ultrasound Needle Trackingcited by 4
- 2025MrTrack: Register Mamba for Needle Tracking with Rapid Reciprocating Motion during Ultrasound-Guided Aspiration Biopsycited by 2
- 2025DeshadowMamba: Deshadowing as 1D Sequential Similaritycited by 1
- 2025DeshadowMamba: Deshadowing as 1D Sequential Similarity28 Oct 2025
- 2025MrTrack: Register Mamba for Needle Tracking with Rapid Reciprocating Motion during Ultrasound-Guided Aspiration Biopsy14 May 2025
- 2024MambaXCTrack: Mamba-based Tracker with SSM Cross-correlation and Motion Prompt for Ultrasound Needle Tracking13 Nov 2024
- 2024Real-world Image Dehazing with Coherence-based Pseudo Labeling and Cooperative Unfolding Networkcited by 26
- 2025Integrating Extra Modality Helps Segmentor Find Camouflaged Objects Wellcited by 14
- 2024Motion-Guided Dual-Camera Tracker for Endoscope Tracking and Motion Analysis in a Mechanical Gastric Simulatorcited by 10
- 2025Generative Refocusing: Flexible Defocus Control from a Single Imagecited by 3
- 2024Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairscited by 2
- 2026A Vision-Language-Action Model for Adaptive Ultrasound-Guided Needle Insertion and Needle Trackingcited by 1
- 2025Pathology Image Restoration via Mixture of Promptscited by 0
- 2025Joint Deblurring and 3D Reconstruction for Macrophotographycited by 0
- 2026Discontinuous Galerkin Neural Operator for Pathology Defocus Deblurringcited by 0
- 2026ErA: Error-Aware Deep Unrolling Network for Single Image Defocus Deblurringcited by 0
- 2026ErA: Error-Aware Deep Unrolling Network for Single Image Defocus Deblurring4 Jun 2026
- 2026Discontinuous Galerkin Neural Operator for Pathology Defocus Deblurring22 May 2026
- 2026A Vision-Language-Action Model for Adaptive Ultrasound-Guided Needle Insertion and Needle Tracking22 Apr 2026
- 2025Generative Refocusing: Flexible Defocus Control from a Single Image18 Dec 2025
- 2025Joint Deblurring and 3D Reconstruction for Macrophotography2 Oct 2025
- 2025Pathology Image Restoration via Mixture of Prompts16 Mar 2025
- 2025Integrating Extra Modality Helps Segmentor Find Camouflaged Objects Well20 Feb 2025
- 2024Reblurring-Guided Single Image Defocus Deblurring: A Learning Framework with Misaligned Training Pairs26 Sep 2024
- 2024Real-world Image Dehazing with Coherence-based Pseudo Labeling and Cooperative Unfolding Network12 Jun 2024
- 2024Motion-Guided Dual-Camera Tracker for Endoscope Tracking and Motion Analysis in a Mechanical Gastric Simulator8 Mar 2024