# THQA: A Perceptual Quality Assessment Database for Talking Heads

arXiv: https://arxiv.org/abs/2404.09003 · HTML: https://mlsanity.com/paper/2404.09003/

## Key facts

- Cited by 8 papers in the map (data through 14 Oct 2026).
- Builds on 24 of its 41 references that are in the map.
- First posted on arXiv 13 Apr 2024.

## Builds on (most cited first, 24 of 24)

- [A Style-Based Generator Architecture for Generative Adversarial Networks](https://mlsanity.com/paper/1812.04948/) (2018)
- [A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild](https://mlsanity.com/paper/2008.10010/) (2020)
- [SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation](https://mlsanity.com/paper/2211.12194/) (2022)
- [MakeItTalk: Speaker-Aware Talking-Head Animation](https://mlsanity.com/paper/2004.12992/) (2020)
- [FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Sampling](https://mlsanity.com/paper/2207.02595/) (2022)
- [Quality Assessment of In-the-Wild Videos](https://mlsanity.com/paper/1908.00375/) (2019)
- [Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion](https://mlsanity.com/paper/2107.09293/) (2021)
- [AGIQA-3K: An Open Database for AI-Generated Image Quality Assessment](https://mlsanity.com/paper/2306.04717/) (2023)
- [UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content](https://mlsanity.com/paper/2005.14354/) (2020)
- [A Deep Learning based No-reference Quality Assessment Model for UGC Videos](https://mlsanity.com/paper/2204.14047/) (2022)
- [VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild](https://mlsanity.com/paper/2211.14758/) (2022)
- [RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Content](https://mlsanity.com/paper/2101.10955/) (2021)
- [Identity-Preserving Talking Face Generation with Landmark and Appearance Priors](https://mlsanity.com/paper/2305.08293/) (2023)
- [Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perception](https://mlsanity.com/paper/2108.08505/) (2021)
- [Towards Open-ended Visual Quality Comparison](https://mlsanity.com/paper/2402.16641/) (2024)
- [DINet: Deformation Inpainting Network for Realistic Face Visually Dubbing on High Resolution Video](https://mlsanity.com/paper/2303.03988/) (2023)
- [Advancing Zero-Shot Digital Human Quality Assessment through Text-Prompted Evaluation](https://mlsanity.com/paper/2307.02808/) (2023)
- [Subjective and Objective Quality Assessment for in-the-Wild Computer Graphics Images](https://mlsanity.com/paper/2303.08050/) (2023)
- [StableVQA: A Deep No-Reference Quality Assessment Model for Video Stability](https://mlsanity.com/paper/2308.04904/) (2023)
- [Perceptual Quality Assessment for Digital Human Heads](https://mlsanity.com/paper/2209.09489/) (2022)
- [Light-VQA: A Multi-Dimensional Quality Assessment Model for Low-Light Video Enhancement](https://mlsanity.com/paper/2305.09512/) (2023)
- [DDH-QA: A Dynamic Digital Humans Quality Assessment Database](https://mlsanity.com/paper/2212.12734/) (2022)
- [A No-Reference Quality Assessment Method for Digital Human Head](https://mlsanity.com/paper/2310.16732/) (2023)
- [An Implementation of Multimodal Fusion System for Intelligent Digital Human Generation](https://mlsanity.com/paper/2310.20251/) (2023)

## Built on by (most cited first, 8 of 8)

- [Quality Assessment in the Era of Large Models: A Survey](https://mlsanity.com/paper/2409.00031/) (2024)
- [G-Refine: A General Quality Refiner for Text-to-Image Generation](https://mlsanity.com/paper/2404.18343/) (2024)
- [Dual-Branch Network for Portrait Image Quality Assessment](https://mlsanity.com/paper/2405.08555/) (2024)
- [3DGCQA: A Quality Assessment Database for 3D AI-Generated Contents](https://mlsanity.com/paper/2409.07236/) (2024)
- [Advancing Talking Head Generation: A Comprehensive Survey of Multi-Modal Methodologies, Datasets, Evaluation Metrics, and Loss Functions](https://mlsanity.com/paper/2507.02900/) (2025)
- [EvalTalker: Learning to Evaluate Real-Portrait-Driven Multi-Subject Talking Humans](https://mlsanity.com/paper/2512.01340/) (2025)
- [Who is a Better Talker: Subjective and Objective Quality Assessment for AI-Generated Talking Heads](https://mlsanity.com/paper/2507.23343/) (2025)
- [AU-IQA: A Benchmark Dataset for Perceptual Quality Assessment of AI-Enhanced User-Generated Content](https://mlsanity.com/paper/2508.05016/) (2025)

## Abstract (arXiv)

In the realm of media technology, digital humans have gained prominence due to rapid advancements in computer technology. However, the manual modeling and control required for the majority of digital humans pose significant obstacles to efficient development. The speech-driven methods offer a novel avenue for manipulating the mouth shape and expressions of digital humans. Despite the proliferation of driving methods, the quality of many generated talking head (TH) videos remains a concern, impacting user visual experiences. To tackle this issue, this paper introduces the Talking Head Quality Assessment (THQA) database, featuring 800 TH videos generated through 8 diverse speech-driven methods. Extensive experiments affirm the THQA database's richness in character and speech features. Subsequent subjective quality assessment experiments analyze correlations between scoring results and speech-driven methods, ages, and genders. In addition, experimental results show that mainstream image and video quality assessment methods have limitations for the THQA database, underscoring the imperative for further research to enhance TH video quality assessment. The THQA database is publicly accessible at https://github.com/zyj-2000/THQA.
