A Camera-Native Talking-Head Video Dataset for Various Computer Vision Tasks
Not on the map. Why?
Abstract (arXiv)
Talking-head videos constitute a predominant content type in real-time communication, yet publicly available datasets for video processing research in this domain remain scarce and limited in signal fidelity. In this paper, we open-source a camera-native dataset of 838 talking-head recordings (approximately 210 minutes), each 15s in duration, captured from 799 participants across 443 camera-code categories in their natural environments. All recordings are stored using the FFV1 lossless codec, preserving the camera-native signal---uncompressed (24.7%) or MJPEG-encoded (75.3%)---without additional lossy processing. Each recording is annotated with a Mean Opinion Score (MOS) and ten perceptual quality tokens that jointly explain 64.4% of the MOS variance. From this corpus, we curate a stratified benchmarking subset of 120 clips in three content conditions: original, background blur, and background replacement. Codec efficiency evaluation across four datasets and four codecs, namely H.264, H.265, H.266, and AV1, yields VMAF BD-rate savings up to -71.3% (H.266) relative to H.264, with significant encoder×dataset (ηp2 = .112) and encoder×content condition (ηp2 = .149) interactions, demonstrating that both content type and background processing affect compression efficiency. A preliminary super-resolution evaluation with four SR models confirms that the dataset significantly affects absolute performance while preserving model rankings, demonstrating applicability beyond codec benchmarking. The dataset offers 5× the scale of the largest prior talking-head webcam dataset (838 vs. 160 clips) and preserves the camera-native signal without additional lossy compression, establishing a resource for benchmarking video compression, super-resolution, quality assessment, and enhancement models in real-time communication.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 42 references that are in the map. First posted on arXiv 23 Mar 2026.
Builds on
16 of 42 references.
References · 16
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2019FaceForensics++: Learning to Detect Manipulated Facial Imagescited by 1,101
- 2018VoxCeleb2: Deep Speaker Recognitioncited by 875
- 2017VoxCeleb: a large-scale speaker identification datasetcited by 732
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
- 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
- 2022CelebV-HQ: A Large-Scale Video Facial Attributes Datasetcited by 250
- 2022VFHQ: A High-Quality Dataset and Benchmark for Video Face Super-Resolutioncited by 176
- 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 134
- 2020A Technical Overview of AV1cited by 47
- 2023Generative Face Video Coding Techniques and Standardization Efforts: A Reviewcited by 19
4 more
- 2024DH-FaceVid-1K: A Large-Scale High-Quality Dataset for Face Video Generationcited by 9
- 2022A crowdsourcing approach to video quality assessmentcited by 8
- 2022Gemino: Practical and Robust Neural Compression for Video Conferencingcited by 8
- 2023VCD: A Video Conferencing Dataset for Video Compressioncited by 8
Built on by
Not cited yet.