mlsanityData to 14 Oct 2026

Oracle Supervision Transfers for Hyperparameter Prediction in Model-Based Image Denoising

arXiv 2605.20479 ↗First posted 19 May 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Hyperparameter prediction is a critical practical bottleneck for model-based image denoisers, ranging from classical TV/TGV variational solvers to modern diffusion-based models such as DiffPIR. While existing learned predictors can achieve near-oracle performance, this approach scales poorly: each new configuration conventionally requires its own oracle-labeled training set, and each label requires a hierarchical grid search evaluated against clean ground truth. We therefore ask whether oracle supervision collected on source configurations can transfer to target configurations with few or no target oracle labels. We propose HyperDn, a single configuration-conditioned predictor that pools oracle supervision across source configurations and predicts heterogeneous hyperparameters for new denoiser--noise configurations. In a cross-paradigm experiment, HyperDn transfers from relatively cheap TV/TGV variational sources to more expensive diffusion-based DiffPIR. With only 2 target oracle labels, it reaches 30.23,dB, within 0.90,dB of the oracle, and outperforms the 64-label per-configuration predictor trained from scratch, using 1/32 as many target labels as that baseline point. Without any target oracle labels, HyperDn also reaches near-oracle PSNR on two unseen mixtures of seen noise types and on transfer from relatively cheap 96× 96 source images to 512× 768 targets. Together, these results show that expensive oracle supervision for hyperparameter prediction can be transferred from source to new target configurations, reducing the need to rebuild oracle labels for each new denoising configuration.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 29 references that are in the map. First posted on arXiv 19 May 2026.

Builds on

15 of 29 references.

References · 15

  1. 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
  2. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
  3. 2016HyperNetworkscited by 1,027
  4. 2018On First-Order Meta-Learning Algorithmscited by 1,018
  5. 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
  6. 2023Denoising Diffusion Models for Plug-and-Play Image Restorationcited by 340
  7. 2016Dynamic Filter Networkscited by 319
  8. 2022Towards Learning Universal Hyperparameter Optimizers with Transformerscited by 81
  9. 2021Few-Shot Bayesian Optimization with Deep Kernel Surrogatescited by 71
  10. 2020Tuning-free Plug-and-Play Proximal Algorithm for Inverse Imaging Problemscited by 38
  11. 2018Practical Transfer Learning for Bayesian Optimizationcited by 26
  12. 2021Learning Regularization Parameters of Inverse Problems via Deep Neural Networkscited by 19
3 more
  1. 2015Bilevel parameter learning for higher-order total variation regularisation modelscited by 14
  2. 2022Computing Multiple Image Reconstructions with a Single Hypernetworkcited by 8
  3. 2025Deep unrolling for learning optimal spatially varying regularisation parameters for Total Generalised Variationcited by 3

Built on by

Not cited yet.