# Self-similarity-based super-resolution of photoacoustic angiography from hand-drawn doodles

arXiv: https://arxiv.org/abs/2305.01165 · HTML: https://mlsanity.com/paper/2305.01165/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 36 references that are in the map.
- First posted on arXiv 2 May 2023.

## Builds on (most cited first, 12 of 12)

- [Denoising Diffusion Probabilistic Models](https://mlsanity.com/paper/2006.11239/) (2020)
- [Microsoft COCO: Common Objects in Context](https://mlsanity.com/paper/1405.0312/) (2014)
- [Deep Unsupervised Learning using Nonequilibrium Thermodynamics](https://mlsanity.com/paper/1503.03585/) (2015)
- [SwinIR: Image Restoration Using Swin Transformer](https://mlsanity.com/paper/2108.10257/) (2021)
- [Image Super-Resolution via Iterative Refinement](https://mlsanity.com/paper/2104.07636/) (2021)
- [SRDiff: Single Image Super-Resolution with Diffusion Probabilistic Models](https://mlsanity.com/paper/2104.14951/) (2021)
- [Pros and Cons of GAN Evaluation Measures: New Developments](https://mlsanity.com/paper/2103.09396/) (2021)
- [SwinFIR: Revisiting the SwinIR with Fast Fourier Convolution and Improved Training for Image Super-Resolution](https://mlsanity.com/paper/2208.11247/) (2022)
- [Model based learning for accelerated, limited-view 3D photoacoustic tomography](https://mlsanity.com/paper/1708.09832/) (2017)
- [Reconstructing undersampled photoacoustic microscopy images using deep learning](https://mlsanity.com/paper/2006.00251/) (2020)
- [Enhancing Mechanical Metamodels with a Generative Model-Based Augmented Training Dataset](https://mlsanity.com/paper/2203.04183/) (2022)
- [Simultaneous Denoising and Localization Network for Photoacoustic Target Localization](https://mlsanity.com/paper/2104.14713/) (2021)

## Built on by (most cited first, 1 of 1)

- [Iterative-in-Iterative Super-Resolution Biomedical Imaging Using One Real Image](https://mlsanity.com/paper/2306.14487/) (2023)

## Abstract (arXiv)

Deep-learning-based super-resolution photoacoustic angiography (PAA) is a powerful tool that restores blood vessel images from under-sampled images to facilitate disease diagnosis. Nonetheless, due to the scarcity of training samples, PAA super-resolution models often exhibit inadequate generalization capabilities, particularly in the context of continuous monitoring tasks. To address this challenge, we propose a novel approach that employs a super-resolution PAA method trained with forged PAA images. We start by generating realistic PAA images of human lips from hand-drawn curves using a diffusion-based image generation model. Subsequently, we train a self-similarity-based super-resolution model with these forged PAA images. Experimental results show that our method outperforms the super-resolution model trained with authentic PAA images in both original-domain and cross-domain tests. Specially, our approach boosts the quality of super-resolution reconstruction using the images forged by the deep learning model, indicating that the collaboration between deep learning models can facilitate generalization, despite limited initial dataset. This approach shows promising potential for exploring zero-shot learning neural networks for vision tasks.
