Visual Autoregressive Priors for RAW-to-sRGB Image Signal Processing
Not on the map. Why?
Abstract (arXiv)
RAW-to-sRGB image signal processing (ISP) must recover perceptually faithful colors and fine details from sensor measurements, often under imperfect spatial alignment and missing camera metadata. This paper presents, to the best of our knowledge, the first application of visual autoregressive (VAR) next-scale prediction over a discrete image codebook to the RAW-to-sRGB ISP task. We adapt a frozen 1.10,B-parameter VAR backbone for RAW-conditioned ISP with only 32.93,M trainable parameters (2.99%), and propose a frequency-decomposed color loss that separately supervises low-frequency tone via wavelet LL cosine similarity and chromatic edges via detail-band ℓ1. On the Zurich RAW-to-sRGB benchmark, the method improves PSNR-Y from 21.31 to 21.89,dB and reduces LPIPS from 0.276 to 0.218 on the full 1,204-image test set. Diagnostic experiments show that the VAR prior preserves structure well, but continuous color transfer remains the dominant bottleneck: oracle affine correction recovers 3.8,dB, while learned color heads yield marginal gains.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 16 references that are in the map. First posted on arXiv 16 Sep 2026.
Builds on
14 of 16 references.
References · 14
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2017Neural Discrete Representation Learningcited by 4,712
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2020Replacing Mobile Camera ISP with a Single Deep Learning Modelcited by 108
- 2020AIM 2020 Challenge on Learned Image Signal Processing Pipelinecited by 44
- 2021Learning RAW-to-sRGB Mappings with Inaccurately Aligned Supervisioncited by 43
- 2020AWNet: Attentive Wavelet Network for Image ISPcited by 38
- 2025Visual Autoregressive Modeling for Image Super-Resolutioncited by 36
- 2021Learned Smartphone ISP on Mobile NPUs with Deep Learning, Mobile AI 2021 Challenge: Reportcited by 34
- 2025RestoreVAR: Visual Autoregressive Generation for All-in-One Image Restorationcited by 15
- 2024Enhancing RAW-to-sRGB with Decoupled Style Structure in Fourier Domaincited by 14
- 2019W-Net: Two-stage U-Net with misaligned data for raw-to-RGB mappingcited by 7
Built on by
Not cited yet.