DIPLI: Deep Image Prior Lucky Imaging for Blind Astronomical Image Restoration
Not on the map. Why?
Abstract (arXiv)
Modern image restoration and super-resolution methods utilize deep learning due to its superior performance compared to traditional algorithms. However, deep learning typically requires large labeled training datasets, which are rarely available in astrophotography. Deep Image Prior (DIP) bypasses this constraint by performing unsupervised optimization on a single image without training data; however, DIP often suffers from overfitting, artifact generation, and instability. This work proposes DIPLI - a framework designed specifically for resolved, high-contrast astronomical targets that shifts from single-frame to multi-frame processing using the Back Projection technique, combined with dense optical flow estimation via the TVNet model, and replaces deterministic predictions with Monte Carlo estimation obtained through Stochastic Gradient Langevin Dynamics (SGLD). A comprehensive evaluation compares the method against the original DIP, the transformer-based model RVRT, and the diffusion-based model DiffIR2VR-Zero on synthetic data with ground truth, while comparing qualitatively against Lucky Imaging on real astronomical data. On synthetic datasets, DIPLI achieves the best perceptual fidelity scores (LPIPS in 12/12 and DISTS in 10/12 scenarios), while the diffusion-based DiffIR2VR-Zero achieves the best pixel-level distortion scores (PSNR in 9/12 and SSIM in 8/12 scenarios), consistent with the well-known perceptual-distortion trade-off in image restoration. Compared to classical Lucky Imaging, the model requires far fewer input frames (7-13 versus thousands) and avoids the need for early stopping that limits standard DIP. Qualitative evaluation on real-world data of resolved solar-system objects, where ground truth is unavailable and domain shifts typically hinder generalization, suggests that the method appears to preserve fine detail while suppressing noise and artifacts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 64 references that are in the map. First posted on arXiv 20 Mar 2025.
Builds on
23 of 64 references.
References · 23
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2019Certified Adversarial Robustness via Randomized Smoothingcited by 1,340
- 2017Deep Image Priorcited by 1,098
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2017The Perception-Distortion Tradeoffcited by 587
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 291
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 170
- 2018Deep Decoder: Concise Image Representations from Untrained Non-convolutional Networkscited by 120
- 2017A Review of Convolutional Neural Networks for Inverse Problems in Imagingcited by 81
- 2020Blind Video Temporal Consistency via Deep Video Priorcited by 76
- 2019A Bayesian Perspective on the Deep Image Priorcited by 52
11 more
- 2018End-to-End Learning of Motion Representation for Video Understandingcited by 43
- 2024DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Modelscited by 34
- 2021Deep Matching Prior: Test-Time Optimization for Dense Correspondencecited by 30
- 2020Guided Deep Decoder: Unsupervised Image Pair Fusioncited by 20
- 2020NAS-DIP: Learning Deep Image Prior with Neural Architecture Searchcited by 20
- 2021Untrained Graph Neural Networks for Denoisingcited by 15
- 2020Neural Architecture Search for Deep Image Priorcited by 14
- 2020Deep Variational Network Toward Blind Image Restorationcited by 14
- 2021ISNAS-DIP: Image-Specific Neural Architecture Search for Deep Image Priorcited by 12
- 2023Convergence Analysis of Stochastic Gradient Descent with MCMC Estimatorscited by 3
- 2019A Projectional Ansatz to Reconstructioncited by 2
Built on by
Not cited yet.