Scale-Equivariant Imaging: Self-Supervised Learning for Image Super-Resolution and Deblurring
Not on the map. Why?
Abstract (arXiv)
Self-supervised methods have recently proved to be nearly as effective as supervised ones in various imaging inverse problems, paving the way for learning-based approaches in scientific and medical imaging applications where ground truth data is hard or expensive to obtain. These methods critically rely on invariance to translations and/or rotations of the image distribution to learn from incomplete measurement data alone. However, existing approaches fail to obtain competitive performances in the problems of image super-resolution and deblurring, which play a key role in most imaging systems. In this work, we show that invariance to roto-translations is insufficient to learn from measurements that only contain low-frequency information. Instead, we propose scale-equivariant imaging, a new self-supervised approach that leverages the fact that many image distributions are approximately scale-invariant, enabling the recovery of high-frequency information lost in the measurement process. We demonstrate throughout a series of experiments on real datasets that the proposed method outperforms other self-supervised approaches, and obtains performances on par with fully supervised learning.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Builds on 26 of its 60 references that are in the map. First posted on arXiv 18 Dec 2023.
Builds on
26 of 60 references.
References · 26
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2020Bootstrap your own latent: A new approach to self-supervised Learningcited by 4,712
- 2020Exploring Simple Siamese Representation Learningcited by 2,853
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2017Deep Image Priorcited by 1,097
- 2018Noise2Noise: Learning Image Restoration without Clean Datacited by 526
- 2020Plug-and-Play Image Restoration with Deep Denoiser Priorcited by 467
- 2017Learning Deep CNN Denoiser Prior for Image Restorationcited by 407
- 2018Noise2Void - Learning Denoising from Single Noisy Imagescited by 359
- 2023Denoising Diffusion Models for Plug-and-Play Image Restorationcited by 335
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 290
14 more
- 2017"Zero-Shot" Super-Resolution using Deep Internal Learningcited by 285
- 2019Noise2Self: Blind Denoising by Self-Supervisioncited by 274
- 2023DDFM: Denoising Diffusion Model for Multi-Modality Image Fusioncited by 153
- 2019Neural Blind Deconvolution Using Deep Priorscited by 113
- 2023Equivariant Multi-Modality Image Fusioncited by 98
- 2022Plug-and-Play Methods for Integrating Physical and Learned Models in Computational Imagingcited by 94
- 2022Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesiscited by 85
- 2019DeepRED: Deep Image Prior Powered by REDcited by 84
- 2021Equivariant Imaging: Learning Beyond the Range Spacecited by 83
- 2021Discrete Cosine Transform Network for Guided Depth Map Super-Resolutioncited by 71
- 2021Robust Equivariant Imaging: a fully unsupervised framework for learning to image from noisy and partial measurementscited by 56
- 2018Unsupervised Learning with Stein's Unbiased Risk Estimatorcited by 47
- 2022Sensing Theorems for Unsupervised Learning in Linear Inverse Problemscited by 28
- 2022Nonlinear Equivariant Imaging: Learning Multi-Parametric Tissue Mapping without Ground Truth for Compressive Quantitative MRIcited by 3
Built on by
Citing papers per year: 2024: 5; 2025: 3; 2026: 6.
14 papers.
Sort:
By area:
- 2024Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models Trained on Corrupted Datacited by 32
- 2024Perspective-Equivariance for Unsupervised Imaging with Camera Geometrycited by 5
- 2024Equivariant Imaging for Self-supervised Hyperspectral Image Inpaintingcited by 5
- 2024Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimationcited by 3
- 2025Self-supervised conformal prediction for uncertainty quantification in Poisson imaging problemscited by 1
- 2025EquiReg: Equivariance Regularized Diffusion for Inverse Problemscited by 1
- 2025Equivariant Splitting: Self-supervised learning from incomplete datacited by 1
- 2026SHARE: A Fully Unsupervised Framework for Single Hyperspectral Image Restorationcited by 1
- 2024Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problemscited by 0
- 2026Learning to reconstruct from saturated data: audio declipping and high-dynamic range imagingcited by 0
- 2026UNet-AF: Alias-free UNet architecturescited by 0
- 2026Self-Supervised Super-Resolution for Sentinel-5P Hyperspectral Imagescited by 0
- 2026Hyperspectral Diffusion Equivariant Imaging (HyDiff-EI): A Self-supervised Framework for Hyperspectral Image Inpainting27 Aug 2026
- 2026Frozen CLIP Priors for Robust Self-Supervised Poisson Inverse Problems20 Aug 2026
- 2026Self-Supervised Super-Resolution for Sentinel-5P Hyperspectral Images19 Apr 2026
- 2026UNet-AF: Alias-free UNet architectures11 Mar 2026
- 2026Learning to reconstruct from saturated data: audio declipping and high-dynamic range imaging25 Feb 2026
- 2026SHARE: A Fully Unsupervised Framework for Single Hyperspectral Image Restoration20 Jan 2026
- 2025Equivariant Splitting: Self-supervised learning from incomplete data1 Oct 2025
- 2025EquiReg: Equivariance Regularized Diffusion for Inverse Problems29 May 2025
- 2025Self-supervised conformal prediction for uncertainty quantification in Poisson imaging problems26 Feb 2025
- 2024Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problems8 Nov 2024
- 2024Equivariant Imaging for Self-supervised Hyperspectral Image Inpainting19 Apr 2024
- 2024Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimation8 Apr 2024
- 2024Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models Trained on Corrupted Datacited by 32
- 2025EquiReg: Equivariance Regularized Diffusion for Inverse Problemscited by 1
- 2026UNet-AF: Alias-free UNet architecturescited by 0
- 2026Hyperspectral Diffusion Equivariant Imaging (HyDiff-EI): A Self-supervised Framework for Hyperspectral Image Inpaintingcited by 0
- 2026Hyperspectral Diffusion Equivariant Imaging (HyDiff-EI): A Self-supervised Framework for Hyperspectral Image Inpainting27 Aug 2026
- 2026UNet-AF: Alias-free UNet architectures11 Mar 2026
- 2025EquiReg: Equivariance Regularized Diffusion for Inverse Problems29 May 2025
- 2024Ambient Diffusion Posterior Sampling: Solving Inverse Problems with Diffusion Models Trained on Corrupted Data13 Mar 2024
- 2024Perspective-Equivariance for Unsupervised Imaging with Camera Geometrycited by 5
- 2024Equivariant Imaging for Self-supervised Hyperspectral Image Inpaintingcited by 5
- 2024Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimationcited by 3
- 2025Self-supervised conformal prediction for uncertainty quantification in Poisson imaging problemscited by 1
- 2025Equivariant Splitting: Self-supervised learning from incomplete datacited by 1
- 2026SHARE: A Fully Unsupervised Framework for Single Hyperspectral Image Restorationcited by 1
- 2024Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problemscited by 0
- 2026Learning to reconstruct from saturated data: audio declipping and high-dynamic range imagingcited by 0
- 2026Self-Supervised Super-Resolution for Sentinel-5P Hyperspectral Imagescited by 0
- 2026Frozen CLIP Priors for Robust Self-Supervised Poisson Inverse Problemscited by 0
- 2026Frozen CLIP Priors for Robust Self-Supervised Poisson Inverse Problems20 Aug 2026
- 2026Self-Supervised Super-Resolution for Sentinel-5P Hyperspectral Images19 Apr 2026
- 2026Learning to reconstruct from saturated data: audio declipping and high-dynamic range imaging25 Feb 2026
- 2026SHARE: A Fully Unsupervised Framework for Single Hyperspectral Image Restoration20 Jan 2026
- 2025Equivariant Splitting: Self-supervised learning from incomplete data1 Oct 2025
- 2025Self-supervised conformal prediction for uncertainty quantification in Poisson imaging problems26 Feb 2025
- 2024Equivariant Test-Time Training with Operator Sketching for Imaging Inverse Problems8 Nov 2024
- 2024Equivariant Imaging for Self-supervised Hyperspectral Image Inpainting19 Apr 2024
- 2024Unsupervised Training of Convex Regularizers using Maximum Likelihood Estimation8 Apr 2024
- 2024Perspective-Equivariance for Unsupervised Imaging with Camera Geometry14 Mar 2024