mlsanityData to 7 Oct 2026

A Reference-Free Framework for Evaluating Single-Frame ISP Pipelines

arXiv 2607.23321 ↗First posted 25 Jul 2026eess.IV cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Evaluating camera image signal processing (ISP) pipelines requires measuring low-level artifacts introduced by operations such as denoising, demosaicing, tone mapping, and compression. Blind image quality assessment (IQA) techniques can grade visual quality without a reference, but they typically focus on semantic and high-level visual cues or human perceptual scores rather than the low-level image-processing artifacts introduced by camera pipelines. In contrast, full-reference metrics such as PSNR and SSIM measure pixel-level differences and structural similarity, while LPIPS measures perceptual similarity in deep feature space. However, these metrics require perfectly aligned image pairs, which are difficult to collect in practical settings. We propose a reference-free learning framework that estimates full-reference image quality metrics from a processed sRGB image and its ISO metadata. Our method predicts a proxy sRGB reference, which is then compared with the processed image to compute PSNR, SSIM, and LPIPS in their standard full-reference form. Our experiments show that the proxy-reference model can be learned from synthetic data and applied to real camera data. We further show that lightweight LoRA fine-tuning enables efficient adaptation when ISP components or pipeline configurations are changed. The proposed method outperforms direct metric regression in estimating metric values and achieves higher agreement with full-reference rankings than conventional blind IQA methods. These results demonstrate the feasibility of reference-free estimation of full-reference metrics for practical camera-pipeline evaluation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 51 of its 88 references that are in the map. First posted on arXiv 25 Jul 2026.

Builds on

51 of 88 references.

References · 51

  1. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  6. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
  7. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  8. 2021Image Super-Resolution via Iterative Refinementcited by 1,506
  9. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  10. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  11. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  12. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
38 more
  1. 2022Denoising Diffusion Restoration Modelscited by 951
  2. 2017The Perception-Distortion Tradeoffcited by 582
  3. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  4. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
  5. 2018Learning to See in the Darkcited by 459
  6. 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
  7. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 251
  8. 2018Unprocessing Images for Learned Raw Denoisingcited by 250
  9. 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
  10. 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 224
  11. 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
  12. 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
  13. 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
  14. 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 150
  15. 2020A Physics-based Noise Formation Model for Extreme Low-light Raw Denoisingcited by 138
  16. 2020Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wildcited by 134
  17. 2023DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Modelscited by 121
  18. 2020Structure-Preserving Super Resolution with Gradient Guidancecited by 116
  19. 2021Image Quality Assessment using Contrastive Learningcited by 95
  20. 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 87
  21. 2019Handheld Multi-Frame Super-Resolutioncited by 85
  22. 2022Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesiscited by 85
  23. 2024Tracking Meets LoRA: Faster Training, Larger Model, Stronger Performancecited by 70
  24. 2021Rethinking Noise Synthesis and Modeling in Raw Denoisingcited by 62
  25. 2018Hallucinated-IQA: No-Reference Image Quality Assessment via Adversarial Learningcited by 49
  26. 2021Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessmentcited by 41
  27. 2020DeepFL-IQA: Weak Supervision for Deep IQA Feature Learningcited by 29
  28. 2022Fast Two-step Blind Optical Aberration Correctioncited by 20
  29. 2023Human Guided Ground-truth Generation for Realistic Image Super-resolutioncited by 20
  30. 2018KonIQ-10k: Towards an ecologically valid and large-scale IQA databasecited by 14
  31. 2017RAN4IQA: Restorative Adversarial Nets for No-Reference Image Quality Assessmentcited by 13
  32. 2024Parameter-Efficient Fine-Tuning of State Space Modelscited by 11
  33. 2024A Note on LoRAcited by 10
  34. 2017FSITM: A Feature Similarity Index For Tone-Mapped Imagescited by 8
  35. 2020Deep Cyclic Generative Adversarial Residual Convolutional Networks for Real Image Super-Resolutioncited by 7
  36. 2025Augmenting Perceptual Super-Resolution via Image Quality Predictorscited by 7
  37. 2024Quality Prediction of AI Generated Images and Videos: Emerging Trends and Opportunitiescited by 3
  38. 2018No-reference Image Denoising Quality Assessmentcited by 2

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.