# An Image Quality Assessment Dataset for Portraits

arXiv: https://arxiv.org/abs/2304.05772 · HTML: https://mlsanity.com/paper/2304.05772/

## Key facts

- Cited by 14 papers in the map (data through 14 Oct 2026).
- Builds on 24 of its 76 references that are in the map.
- First posted on arXiv 12 Apr 2023.

## Builds on (most cited first, 24 of 24)

- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [The Unreasonable Effectiveness of Deep Features as a Perceptual Metric](https://mlsanity.com/paper/1801.03924/) (2018)
- [Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semantics](https://mlsanity.com/paper/1705.07115/) (2017)
- [MUSIQ: Multi-scale Image Quality Transformer](https://mlsanity.com/paper/2108.05997/) (2021)
- [MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment](https://mlsanity.com/paper/2204.08958/) (2022)
- [KonIQ-10k: An ecologically valid database for deep learning of blind image quality assessment](https://mlsanity.com/paper/1910.06180/) (2019)
- [Blind Image Quality Assessment Using A Deep Bilinear Convolutional Neural Network](https://mlsanity.com/paper/1907.02665/) (2019)
- [From Patches to Pictures (PaQ-2-PiQ): Mapping the Perceptual Space of Picture Quality](https://mlsanity.com/paper/1912.10088/) (2019)
- [Massive Online Crowdsourced Study of Subjective and Objective Picture Quality](https://mlsanity.com/paper/1511.02919/) (2015)
- [No-Reference Image Quality Assessment via Transformers, Relative Ranking, and Self-Consistency](https://mlsanity.com/paper/2108.06858/) (2021)
- [Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and Wild](https://mlsanity.com/paper/2005.13983/) (2020)
- [Face Image Quality Assessment: A Literature Survey](https://mlsanity.com/paper/2009.01103/) (2020)
- [Transformer for Image Quality Assessment](https://mlsanity.com/paper/2101.01097/) (2020)
- [Perceptual Quality Prediction on Authentically Distorted Images Using a Bag of Features Approach](https://mlsanity.com/paper/1609.04757/) (2016)
- [Blind Quality Assessment for in-the-Wild Images via Hierarchical Feature Fusion and Iterative Mixed Database Training](https://mlsanity.com/paper/2105.14550/) (2021)
- [SDD-FIQA: Unsupervised Face Image Quality Assessment with Similarity Distribution Distance](https://mlsanity.com/paper/2103.05977/) (2021)
- [FaceQnet: Quality Assessment for Face Recognition based on Deep Learning](https://mlsanity.com/paper/1904.01740/) (2019)
- [PPR10K: A Large-Scale Portrait Photo Retouching Dataset with Human-Region Mask and Group-Level Consistency](https://mlsanity.com/paper/2105.09180/) (2021)
- [A practical guide and software for analysing pairwise comparison experiments](https://mlsanity.com/paper/1712.03686/) (2017)
- [Active Sampling for Pairwise Comparisons via Approximate Message Passing and Information Gain Maximization](https://mlsanity.com/paper/2004.05691/) (2020)
- [Learning to Blindly Assess Image Quality in the Laboratory and Wild](https://mlsanity.com/paper/1907.00516/) (2019)
- [The Beauty of Capturing Faces: Rating the Quality of Digital Portraits](https://mlsanity.com/paper/1501.07304/) (2015)
- [A multiple attributes image quality database for smartphone camera photo quality assessment](https://mlsanity.com/paper/2003.01299/) (2020)
- [Multi-task deep CNN model for no-reference image quality assessment on smartphone camera photos](https://mlsanity.com/paper/2008.11961/) (2020)

## Built on by (most cited first, 14 of 14)

- [DSL-FIQA: Assessing Facial Image Quality via Dual-Set Degradation Learning and Landmark-Guided Transformer](https://mlsanity.com/paper/2406.09622/) (2024)
- [AGHI-QA: A Subjective-Aligned Dataset and Metric for AI-Generated Human Images](https://mlsanity.com/paper/2504.21308/) (2025)
- [F-Bench: Rethinking Human Preference Evaluation Metrics for Benchmarking Face Generation, Customization, and Restoration](https://mlsanity.com/paper/2412.13155/) (2024)
- [Dual-Branch Network for Portrait Image Quality Assessment](https://mlsanity.com/paper/2405.08555/) (2024)
- [Deep Portrait Quality Assessment. A NTIRE 2024 Challenge Survey](https://mlsanity.com/paper/2404.11159/) (2024)
- [Generalized Portrait Quality Assessment](https://mlsanity.com/paper/2402.09178/) (2024)
- [Efficient Face Image Quality Assessment via Self-training and Knowledge Distillation](https://mlsanity.com/paper/2507.15709/) (2025)
- [Statistical Challenges with Dataset Construction: Why You Will Never Have Enough Images](https://mlsanity.com/paper/2408.11160/) (2024)
- [Q-Bench-Portrait: Benchmarking Multimodal Large Language Models on Portrait Image Quality Perception](https://mlsanity.com/paper/2601.18346/) (2026)
- [Pairwise Comparisons Are All You Need](https://mlsanity.com/paper/2403.09746/) (2024)
- [Surveillance Facial Image Quality Assessment: A Multi-dimensional Dataset and Lightweight Model](https://mlsanity.com/paper/2602.07403/) (2026)
- [PortraitCraft: A Benchmark for Portrait Composition Understanding and Generation](https://mlsanity.com/paper/2604.03611/) (2026)
- [Facial Attractiveness Prediction in Live Streaming: A New Benchmark and Multi-modal Method](https://mlsanity.com/paper/2501.02509/) (2025)
- [PortraitAes: Intent-Conditioned Structured Portrait Aesthetic Assessment](https://mlsanity.com/paper/2610.05010/) (2026)

## Abstract (arXiv)

Year after year, the demand for ever-better smartphone photos continues to grow, in particular in the domain of portrait photography. Manufacturers thus use perceptual quality criteria throughout the development of smartphone cameras. This costly procedure can be partially replaced by automated learning-based methods for image quality assessment (IQA). Due to its subjective nature, it is necessary to estimate and guarantee the consistency of the IQA process, a characteristic lacking in the mean opinion scores (MOS) widely used for crowdsourcing IQA. In addition, existing blind IQA (BIQA) datasets pay little attention to the difficulty of cross-content assessment, which may degrade the quality of annotations. This paper introduces PIQ23, a portrait-specific IQA dataset of 5116 images of 50 predefined scenarios acquired by 100 smartphones, covering a high variety of brands, models, and use cases. The dataset includes individuals of various genders and ethnicities who have given explicit and informed consent for their photographs to be used in public research. It is annotated by pairwise comparisons (PWC) collected from over 30 image quality experts for three image attributes: face detail preservation, face target exposure, and overall image quality. An in-depth statistical analysis of these annotations allows us to evaluate their consistency over PIQ23. Finally, we show through an extensive comparison with existing baselines that semantic information (image context) can be used to improve IQA predictions. The dataset along with the proposed statistical analysis and BIQA algorithms are available: https://github.com/DXOMARK-Research/PIQ2023
