Probing the Information Encoded in X-vectors
Not on the map. Why?
Abstract (arXiv)
Deep neural network based speaker embeddings, such as x-vectors, have been shown to perform well in text-independent speaker recognition/verification tasks. In this paper, we use simple classifiers to investigate the contents encoded by x-vector embeddings. We probe these embeddings for information related to the speaker, channel, transcription (sentence, words, phones), and meta information about the utterance (duration and augmentation type), and compare these with the information encoded by i-vectors across a varying number of dimensions. We also study the effect of data augmentation during extractor training on the information captured by x-vectors. Experiments on the RedDots data set show that x-vectors capture spoken content and channel-related information, while performing well on speaker verification tasks.
Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 13 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 1; 2023: 2; 2024: 3; 2025: 3; 2026: 4.
18 papers.
Sort:
- 2021What all do audio transformer models hear? Probing Acoustic Representations for Language Delivery and its Structurecited by 52
- 2021VoxCeleb Enrichment for Age and Gender Recognitioncited by 20
- 2022Are disentangled representations all you need to build speaker anonymization systems?cited by 10
- 2021Data Quality as Predictor of Voice Anti-Spoofing Generalizationcited by 6
- 2025Layer-wise Minimal Pair Probing Reveals Contextual Grammatical-Conceptual Hierarchy in Speech Representationscited by 5
- 2026Causal Tracing of Audio-Text Fusion in Large Audio Language Modelscited by 4
- 2021Classification of Emotions and Evaluation of Customer Satisfaction from Speech in Real World Acoustic Environmentscited by 3
- 2025LASPA: Language Agnostic Speaker Disentanglement with Prefix-Tuned Cross-Attentioncited by 2
- 2025The Impact of Automatic Speech Transcription on Speaker Attributioncited by 2
- 2026Causally Disentangled Contrastive Learning for Multilingual Speaker Embeddingscited by 2
- 2023On the Impact of Voice Anonymization on Speech Diagnostic Applications: a Case Study on COVID-19 Detectioncited by 1
- 2024Probing the Information Encoded in Neural-based Acoustic Models of Automatic Speech Recognition Systemscited by 1
6 more
- 2024Discrete Unit based Masking for Improving Disentanglement in Voice Conversioncited by 1
- 2026Probing Low-Level Acoustic Attribute Encoding in CLAP Audio Embeddingscited by 1
- 2021Domain-Dependent Speaker Diarization for the Third DIHARD Challengecited by 0
- 2023An analysis on the effects of speaker embedding choice in non auto-regressive TTScited by 0
- 2024Leveraging Speaker Embeddings in End-to-End Neural Diarization for Two-Speaker Scenarioscited by 0
- 2026The Voiceprint Fallacy: Why Voices Are Not Unique Biometric Imprintscited by 0
- 2026The Voiceprint Fallacy: Why Voices Are Not Unique Biometric Imprints8 Aug 2026
- 2026Probing Low-Level Acoustic Attribute Encoding in CLAP Audio Embeddings4 Jul 2026
- 2026Causal Tracing of Audio-Text Fusion in Large Audio Language Models14 Mar 2026
- 2026Causally Disentangled Contrastive Learning for Multilingual Speaker Embeddings1 Feb 2026
- 2025Layer-wise Minimal Pair Probing Reveals Contextual Grammatical-Conceptual Hierarchy in Speech Representations19 Sep 2025
- 2025The Impact of Automatic Speech Transcription on Speaker Attribution11 Jul 2025
- 2025LASPA: Language Agnostic Speaker Disentanglement with Prefix-Tuned Cross-Attention2 Jun 2025
- 2024Discrete Unit based Masking for Improving Disentanglement in Voice Conversion17 Sep 2024
- 2024Leveraging Speaker Embeddings in End-to-End Neural Diarization for Two-Speaker Scenarios1 Jul 2024
- 2024Probing the Information Encoded in Neural-based Acoustic Models of Automatic Speech Recognition Systems29 Feb 2024
- 2023An analysis on the effects of speaker embedding choice in non auto-regressive TTS19 Jul 2023
- 2023On the Impact of Voice Anonymization on Speech Diagnostic Applications: a Case Study on COVID-19 Detection5 Apr 2023
6 more
- 2022Are disentangled representations all you need to build speaker anonymization systems?22 Aug 2022
- 2021VoxCeleb Enrichment for Age and Gender Recognition28 Sep 2021
- 2021Classification of Emotions and Evaluation of Customer Satisfaction from Speech in Real World Acoustic Environments26 Aug 2021
- 2021Data Quality as Predictor of Voice Anti-Spoofing Generalization26 Mar 2021
- 2021Domain-Dependent Speaker Diarization for the Third DIHARD Challenge25 Jan 2021
- 2021What all do audio transformer models hear? Probing Acoustic Representations for Language Delivery and its Structure2 Jan 2021
- 2021What all do audio transformer models hear? Probing Acoustic Representations for Language Delivery and its Structurecited by 52
- 2021VoxCeleb Enrichment for Age and Gender Recognitioncited by 20
- 2022Are disentangled representations all you need to build speaker anonymization systems?cited by 10
- 2021Data Quality as Predictor of Voice Anti-Spoofing Generalizationcited by 6
- 2025Layer-wise Minimal Pair Probing Reveals Contextual Grammatical-Conceptual Hierarchy in Speech Representationscited by 5
- 2026Causal Tracing of Audio-Text Fusion in Large Audio Language Modelscited by 4
- 2021Classification of Emotions and Evaluation of Customer Satisfaction from Speech in Real World Acoustic Environmentscited by 3
- 2025LASPA: Language Agnostic Speaker Disentanglement with Prefix-Tuned Cross-Attentioncited by 2
- 2025The Impact of Automatic Speech Transcription on Speaker Attributioncited by 2
- 2026Causally Disentangled Contrastive Learning for Multilingual Speaker Embeddingscited by 2
- 2023On the Impact of Voice Anonymization on Speech Diagnostic Applications: a Case Study on COVID-19 Detectioncited by 1
- 2024Probing the Information Encoded in Neural-based Acoustic Models of Automatic Speech Recognition Systemscited by 1
12 most cited of 18 All 18 (JSON)
- 2026The Voiceprint Fallacy: Why Voices Are Not Unique Biometric Imprints8 Aug 2026
- 2026Probing Low-Level Acoustic Attribute Encoding in CLAP Audio Embeddings4 Jul 2026
- 2026Causal Tracing of Audio-Text Fusion in Large Audio Language Models14 Mar 2026
- 2026Causally Disentangled Contrastive Learning for Multilingual Speaker Embeddings1 Feb 2026
- 2025Layer-wise Minimal Pair Probing Reveals Contextual Grammatical-Conceptual Hierarchy in Speech Representations19 Sep 2025
- 2025The Impact of Automatic Speech Transcription on Speaker Attribution11 Jul 2025
- 2025LASPA: Language Agnostic Speaker Disentanglement with Prefix-Tuned Cross-Attention2 Jun 2025
- 2024Discrete Unit based Masking for Improving Disentanglement in Voice Conversion17 Sep 2024
- 2024Leveraging Speaker Embeddings in End-to-End Neural Diarization for Two-Speaker Scenarios1 Jul 2024
- 2024Probing the Information Encoded in Neural-based Acoustic Models of Automatic Speech Recognition Systems29 Feb 2024
- 2023An analysis on the effects of speaker embedding choice in non auto-regressive TTS19 Jul 2023
- 2023On the Impact of Voice Anonymization on Speech Diagnostic Applications: a Case Study on COVID-19 Detection5 Apr 2023
12 newest of 18 All 18 (JSON)