A Reference-Free Framework for Evaluating Single-Frame ISP Pipelines
Not on the map. Why?
Abstract (arXiv)
Evaluating camera image signal processing (ISP) pipelines requires measuring low-level artifacts introduced by operations such as denoising, demosaicing, tone mapping, and compression. Blind image quality assessment (IQA) techniques can grade visual quality without a reference, but they typically focus on semantic and high-level visual cues or human perceptual scores rather than the low-level image-processing artifacts introduced by camera pipelines. In contrast, full-reference metrics such as PSNR and SSIM measure pixel-level differences and structural similarity, while LPIPS measures perceptual similarity in deep feature space. However, these metrics require perfectly aligned image pairs, which are difficult to collect in practical settings. We propose a reference-free learning framework that estimates full-reference image quality metrics from a processed sRGB image and its ISO metadata. Our method predicts a proxy sRGB reference, which is then compared with the processed image to compute PSNR, SSIM, and LPIPS in their standard full-reference form. Our experiments show that the proxy-reference model can be learned from synthetic data and applied to real camera data. We further show that lightweight LoRA fine-tuning enables efficient adaptation when ISP components or pipeline configurations are changed. The proposed method outperforms direct metric regression in estimating metric values and achieves higher agreement with full-reference rankings than conventional blind IQA methods. These results demonstrate the feasibility of reference-free estimation of full-reference metrics for practical camera-pipeline evaluation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 51 of its 88 references that are in the map. First posted on arXiv 25 Jul 2026.
Builds on
51 of 88 references.
References · 51
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
- 2021Image Super-Resolution via Iterative Refinementcited by 1,506
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
38 more
- 2022Denoising Diffusion Restoration Modelscited by 951
- 2017The Perception-Distortion Tradeoffcited by 582
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 486
- 2018Learning to See in the Darkcited by 459
- 2019Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Networkcited by 301
- 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylizationcited by 251
- 2018Unprocessing Images for Learned Raw Denoisingcited by 250
- 2020Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulationcited by 225
- 2016Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessmentcited by 224
- 2019From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Qualitycited by 221
- 2015Massive Online Crowdsourced Study of Subjective and Objective Picture Qualitycited by 208
- 2021No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistencycited by 165
- 2017RankIQA: Learning from Rankings for No-reference Image Quality Assessmentcited by 150
- 2020A Physics-based Noise Formation Model for Extreme Low-light Raw Denoisingcited by 138
- 2020Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wildcited by 134
- 2023DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Modelscited by 121
- 2020Structure-Preserving Super Resolution with Gradient Guidancecited by 116
- 2021Image Quality Assessment using Contrastive Learningcited by 95
- 2023ARNIQA: Learning Distortion Manifold for Image Quality Assessmentcited by 87
- 2019Handheld Multi-Frame Super-Resolutioncited by 85
- 2022Practical Blind Image Denoising via Swin-Conv-UNet and Data Synthesiscited by 85
- 2024Tracking Meets LoRA: Faster Training, Larger Model, Stronger Performancecited by 70
- 2021Rethinking Noise Synthesis and Modeling in Raw Denoisingcited by 62
- 2018Hallucinated-IQA: No-Reference Image Quality Assessment via Adversarial Learningcited by 49
- 2021Learning Conditional Knowledge Distillation for Degraded-Reference Image Quality Assessmentcited by 41
- 2020DeepFL-IQA: Weak Supervision for Deep IQA Feature Learningcited by 29
- 2022Fast Two-step Blind Optical Aberration Correctioncited by 20
- 2023Human Guided Ground-truth Generation for Realistic Image Super-resolutioncited by 20
- 2018KonIQ-10k: Towards an ecologically valid and large-scale IQA databasecited by 14
- 2017RAN4IQA: Restorative Adversarial Nets for No-Reference Image Quality Assessmentcited by 13
- 2024Parameter-Efficient Fine-Tuning of State Space Modelscited by 11
- 2024A Note on LoRAcited by 10
- 2017FSITM: A Feature Similarity Index For Tone-Mapped Imagescited by 8
- 2020Deep Cyclic Generative Adversarial Residual Convolutional Networks for Real Image Super-Resolutioncited by 7
- 2025Augmenting Perceptual Super-Resolution via Image Quality Predictorscited by 7
- 2024Quality Prediction of AI Generated Images and Videos: Emerging Trends and Opportunitiescited by 3
- 2018No-reference Image Denoising Quality Assessmentcited by 2
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.