mlsanityData to 14 Oct 2026

Imaging Signal Recovery Using Neural Network Priors Under Uncertain Forward Model Parameters

arXiv 2405.02944 ↗First posted 5 May 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Inverse imaging problems (IIPs) arise in various applications, with the main objective of reconstructing an image from its compressed measurements. This problem is often ill-posed for being under-determined with multiple interchangeably consistent solutions. The best solution inherently depends on prior knowledge or assumptions, such as the sparsity of the image. Furthermore, the reconstruction process for most IIPs relies significantly on the imaging (i.e. forward model) parameters, which might not be fully known, or the measurement device may undergo calibration drifts. These uncertainties in the forward model create substantial challenges, where inaccurate reconstructions usually happen when the postulated parameters of the forward model do not fully match the actual ones. In this work, we devoted to tackling accurate reconstruction under the context of a set of possible forward model parameters that exist. Here, we propose a novel Moment-Aggregation (MA) framework that is compatible with the popular IIP solution by using a neural network prior. Specifically, our method can reconstruct the signal by considering all candidate parameters of the forward model simultaneously during the update of the neural network. We theoretically demonstrate the convergence of the MA framework, which has a similar complexity with reconstruction under the known forward model parameters. Proof-of-concept experiments demonstrate that the proposed MA achieves performance comparable to the forward model with the known precise parameter in reconstruction across both compressive sensing and phase retrieval applications, with a PSNR gap of 0.17 to 1.94 over various datasets, including MNIST, X-ray, Glas, and MoNuseg. This highlights our method's significant potential in reconstruction under an uncertain forward model.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 45 references that are in the map. First posted on arXiv 5 May 2024.

Builds on

18 of 45 references.

References · 18

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  3. 2017Deep Image Priorcited by 1,098
  4. 2017Compressed Sensing using Generative Modelscited by 339
  5. 2021Robust Compressed Sensing MRI with Deep Generative Priorscited by 286
  6. 2016Gland Segmentation in Colon Histology Images: The GlaS Challenge Contestcited by 203
  7. 2018"Double-DIP": Unsupervised Image Decomposition via Coupled Deep-Image-Priorscited by 114
  8. 2014From Denoising to Compressed Sensingcited by 68
  9. 2018Solving Linear Inverse Problems Using GAN Priors: An Algorithm with Provable Guaranteescited by 58
  10. 2018Compressed Sensing with Deep Image Prior and Learned Regularizationcited by 47
  11. 2020Compressive sensing with un-trained neural networks: Gradient descent finds the smoothest approximationcited by 39
  12. 2019Algorithmic Guarantees for Inverse Imaging with Untrained Network Priorscited by 32
6 more
  1. 2022Theoretical Perspectives on Deep Learning Methods in Inverse Problemscited by 22
  2. 2021Provable Compressed Sensing with Generative Priors via Langevin Dynamicscited by 14
  3. 2021Untrained networks for compressive lensless photographycited by 13
  4. 2018Algorithmic Aspects of Inverse Problems Using Generative Modelscited by 8
  5. 2020Deep DIH : Statistically Inferred Reconstruction of Digital In-Line Holography by Deep Learningcited by 6
  6. 2022Scan-specific Self-supervised Bayesian Deep Non-linear Inversion for Undersampled MRI Reconstructioncited by 4

Built on by

Not cited yet.