mlsanityData to 7 Oct 2026

ColorVideoVDP: A visual difference predictor for image, video and display distortions

arXiv 2401.11485 ↗First posted 21 Jan 2024cs.CV cs.GR eess.IVcited by 32

Not on the map. Why?

Abstract (arXiv)

ColorVideoVDP is a video and image quality metric that models spatial and temporal aspects of vision, for both luminance and color. The metric is built on novel psychophysical models of chromatic spatiotemporal contrast sensitivity and cross-channel contrast masking. It accounts for the viewing conditions, geometric, and photometric characteristics of the display. It was trained to predict common video streaming distortions (e.g. video compression, rescaling, and transmission errors), and also 8 new distortion types related to AR/VR displays (e.g. light source and waveguide non-uniformities). To address the latter application, we collected our novel XR-Display-Artifact-Video quality dataset (XR-DAVID), comprised of 336 distorted videos. Extensive testing on XR-DAVID, as well as several datasets from the literature, indicate a significant gain in prediction performance compared to existing metrics. ColorVideoVDP opens the doors to many novel applications which require the joint automated spatiotemporal assessment of luminance and color distortions, including video streaming, display specification and design, visual comparison of results, and perceptually-guided quality optimization.

Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Builds on 10 of its 79 references that are in the map. First posted on arXiv 21 Jan 2024.

Builds on

10 of 79 references.

References · 10

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  2. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  3. 2016Training Deep Nets with Sublinear Memory Costcited by 825
  4. 2018PieAPP: Perceptual Image-Error Assessment through Pairwise Preferencecited by 158
  5. 2021Perceptual Image Quality Assessment with Transformerscited by 54
  6. 2023HDR-VDP-3: A multi-metric for predicting image differences, quality and contrast distortions in high dynamic range and regular contentcited by 41
  7. 2020Active Sampling for Pairwise Comparisons via Approximate Message Passing and Information Gain Maximizationcited by 17
  8. 2022Subjective Assessment of High Dynamic Range Videos Under Different Ambient Conditionscited by 12
  9. 2020Consolidated Dataset and Metrics for High-Dynamic-Range Image Qualitycited by 10
  10. 2022FUNQUE: Fusion of Unified Quality Evaluatorscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 12; 2026: 16.

32 papers.

Sort:

By area:

  1. 2025DiffusionRenderer: Neural Inverse and Forward Rendering with Video Diffusion Modelscited by 55
  2. 2024Video Seal: Open and Efficient Video Watermarkingcited by 45
  3. 2025Pixel Seal: Adversarial-only training for invisible image and video watermarkingcited by 14
  4. 2025Do computer vision foundation models learn the low-level characteristics of the human visual system?cited by 12
  5. 2026X2HDR: HDR Image Generation in a Perceptually Uniform Spacecited by 7
  6. 2024Puzzle Similarity: A Perceptually-guided Cross-Reference Metric for Artifact Detection in 3D Scene Reconstructionscited by 3
  7. 2025Subjective Visual Quality Assessment for High-Fidelity Learning-Based Image Compressioncited by 3
  8. 2025Capturing Stable HDR Videos Using a Dual-Camera Systemcited by 3
  9. 2025Evaluating quality metrics through the lenses of psychophysical measurements of low-level visioncited by 2
  10. 2026HDR Video Generation via Latent Alignment with Logarithmic Encodingcited by 2
  11. 2024Deep chroma compression of tone-mapped imagescited by 1
  12. 2025Fine-Grained HDR Image Quality Assessment From Noticeably Distorted to Very High Fidelitycited by 1
20 more
  1. 2025ICME 2025 Generalizable HDR and SDR Video Quality Measurement Grand Challengecited by 1
  2. 2025CameraVDP: Perceptual Display Assessment with Uncertainty Estimation via Camera and Visual Difference Predictioncited by 1
  3. 2025D-PerceptCT: Deep Perceptual Enhancement for Low-Dose CT Imagescited by 1
  4. 2024Human Vision Constrained Super-Resolutioncited by 0
  5. 2025Collaborative Texture Filteringcited by 0
  6. 2025LCS: An AI-based Low-Complexity Scaler for Power-Efficient Super-Resolution of Game Contentcited by 0
  7. 2026FDIM: A Feature-distance-based Generic Video Quality Metric for Versatile Codecscited by 0
  8. 2026Velox: Learning Representations of 4D Geometry and Appearancecited by 0
  9. 2026Streaming of rendered content with adaptive frame rate and resolutioncited by 0
  10. 2026Generating HDR Video from SDR Videocited by 0
  11. 2026How Accurate are Video Quality Models for Diffusion-Based Video Super-Resolution?cited by 0
  12. 2026Towards Standardized Light Field Quality Assessment: Hybrid Subjective Benchmarking and Objective Metric Evaluationcited by 0
  13. 2026Learning Flexible Generalization in Video Quality Assessment by Bringing Device and Viewing Condition Distributionscited by 0
  14. 2026JPEG AIC2026: A large-scale dataset for fine-grained assessment of image codingcited by 0
  15. 2026Hologram Representation via Quadratic Phase Gaussian Splattingcited by 0
  16. 2026Recurrent Dynamic Range Extensioncited by 0
  17. 2026An Efficient and Effective Watermarking Scheme for the Protection of the Intellectual Property Rights of Video Generative Modelscited by 0
  18. 2026Ultra-fast Neural Inference for Stochastic Gaussian Splatting Denoisingcited by 0
  19. 2026ControlGS: Conditioning Neural Gaussians for Downstream-Processing-Aware XR Renderingcited by 0
  20. 2026Multidimensional Observer Model and Perceptual Dimensions of Human Image Quality Assessmentcited by 0