Demographic Attributes Prediction from Speech Using WavLM Embeddings
Not on the map. Why?
Abstract (arXiv)
This paper introduces a general classifier based on WavLM features, to infer demographic characteristics, such as age, gender, native language, education, and country, from speech. Demographic feature prediction plays a crucial role in applications like language learning, accessibility, and digital forensics, enabling more personalized and inclusive technologies. Leveraging pretrained models for embedding extraction, the proposed framework identifies key acoustic and linguistic fea-tures associated with demographic attributes, achieving a Mean Absolute Error (MAE) of 4.94 for age prediction and over 99.81% accuracy for gender classification across various datasets. Our system improves upon existing models by up to relative 30% in MAE and up to relative 10% in accuracy and F1 scores across tasks, leveraging a diverse range of datasets and large pretrained models to ensure robustness and generalizability. This study offers new insights into speaker diversity and provides a strong foundation for future research in speech-based demographic profiling.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 16 of its 35 references that are in the map. First posted on arXiv 17 Feb 2025.
Builds on
16 of 35 references.
References · 16
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,777
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2016Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learningcited by 1,512
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2021Self-Supervised Representation Learning: Introduction, Advances and Challengescited by 148
- 2023Whisper-AT: Noise-Robust Automatic Speech Recognizers are Also Strong General Audio Event Taggerscited by 72
- 2020End-to-End Speaker Diarization for an Unknown Number of Speakers with Encoder-Decoder Based Attractorscited by 71
- 2022A General Survey on Attention Mechanisms in Deep Learningcited by 64
- 2021VoxCeleb Enrichment for Age and Gender Recognitioncited by 20
- 2020AutoSpeech: Neural Architecture Search for Speaker Recognitioncited by 17
- 2021A Simple Standard for Sharing Ontological Mappings (SSSOM)cited by 13
4 more
- 2024EMO-SUPERB: An In-depth Look at Speech Emotion Recognitioncited by 10
- 2022MLP-ASR: Sequence-length agnostic all-MLP architectures for speech recognitioncited by 3
- 2022Statistical and Neural Methods for Cross-lingual Entity Label Mapping in Knowledge Graphscited by 2
- 2024Investigation of Speaker Representation for Target-Speaker Speech Processingcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025Enhancing Dialogue Annotation with Speaker Characteristics Leveraging a Frozen LLMcited by 3
- 2026Causally Disentangled Contrastive Learning for Multilingual Speaker Embeddingscited by 2
- 2026Emputation: Identification-Guided Neural Imputation Frameworkcited by 0
- 2026Beyond EER: Multi-Dimensional Evaluation of Information Leakage in Speaker De-Identificationcited by 0
- 2026Beyond EER: Multi-Dimensional Evaluation of Information Leakage in Speaker De-Identification16 Sep 2026
- 2026Emputation: Identification-Guided Neural Imputation Framework6 Jul 2026
- 2026Causally Disentangled Contrastive Learning for Multilingual Speaker Embeddings1 Feb 2026
- 2025Enhancing Dialogue Annotation with Speaker Characteristics Leveraging a Frozen LLM6 Aug 2025