mlsanityData to 7 Oct 2026

THQA: A Perceptual Quality Assessment Database for Talking Heads

arXiv 2404.09003 ↗First posted 13 Apr 2024cs.CV eess.IVcited by 8

Not on the map. Why?

Abstract (arXiv)

In the realm of media technology, digital humans have gained prominence due to rapid advancements in computer technology. However, the manual modeling and control required for the majority of digital humans pose significant obstacles to efficient development. The speech-driven methods offer a novel avenue for manipulating the mouth shape and expressions of digital humans. Despite the proliferation of driving methods, the quality of many generated talking head (TH) videos remains a concern, impacting user visual experiences. To tackle this issue, this paper introduces the Talking Head Quality Assessment (THQA) database, featuring 800 TH videos generated through 8 diverse speech-driven methods. Extensive experiments affirm the THQA database's richness in character and speech features. Subsequent subjective quality assessment experiments analyze correlations between scoring results and speech-driven methods, ages, and genders. In addition, experimental results show that mainstream image and video quality assessment methods have limitations for the THQA database, underscoring the imperative for further research to enhance TH video quality assessment. The THQA database is publicly accessible at https://github.com/zyj-2000/THQA.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 24 of its 41 references that are in the map. First posted on arXiv 13 Apr 2024.

Builds on

24 of 41 references.

References · 24

  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  2. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
  3. 2022SadTalker: Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animationcited by 380
  4. 2020MakeItTalk: Speaker-Aware Talking-Head Animationcited by 310
  5. 2022FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Samplingcited by 179
  6. 2019Quality Assessment of In-the-Wild Videoscited by 164
  7. 2021Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motioncited by 148
  8. 2023AGIQA-3K: An Open Database for AI-Generated Image Quality Assessmentcited by 142
  9. 2020UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Contentcited by 140
  10. 2022A Deep Learning based No-reference Quality Assessment Model for UGC Videoscited by 128
  11. 2022VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wildcited by 106
  12. 2021RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Contentcited by 100
12 more
  1. 2021Blindly Assess Quality of In-the-Wild Videos via Quality-aware Pre-training and Motion Perceptioncited by 97
  2. 2023Identity-Preserving Talking Face Generation with Landmark and Appearance Priorscited by 97
  3. 2024Towards Open-ended Visual Quality Comparisoncited by 85
  4. 2023DINet: Deformation Inpainting Network for Realistic Face Visually Dubbing on High Resolution Videocited by 73
  5. 2023Advancing Zero-Shot Digital Human Quality Assessment through Text-Prompted Evaluationcited by 27
  6. 2023Subjective and Objective Quality Assessment for in-the-Wild Computer Graphics Imagescited by 21
  7. 2023StableVQA: A Deep No-Reference Quality Assessment Model for Video Stabilitycited by 15
  8. 2022Perceptual Quality Assessment for Digital Human Headscited by 13
  9. 2023Light-VQA: A Multi-Dimensional Quality Assessment Model for Low-Light Video Enhancementcited by 12
  10. 2022DDH-QA: A Dynamic Digital Humans Quality Assessment Databasecited by 9
  11. 2023A No-Reference Quality Assessment Method for Digital Human Headcited by 6
  12. 2023An Implementation of Multimodal Fusion System for Intelligent Digital Human Generationcited by 6

Built on by

Cited by year

Citing papers per year: 2024: 4; 2025: 4.

8 papers.