# Unsupervised Approaches for Global Prosodic Embedding Extraction

arXiv: https://arxiv.org/abs/2606.14004 · HTML: https://mlsanity.com/paper/2606.14004/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 12 Jun 2026.

## Built on by (most cited first, 1 of 1)

- [A study on human-agent teaming through spoken interaction: the impact of human individual traits and agent characteristics](https://mlsanity.com/paper/2610.04079/) (2026)

## Abstract (arXiv)

Prosody is central to oral communication, conveying information like the emotional state of the speaker and cues needed for meaning disambiguation. Many self-supervised models of speech produce embeddings that encode prosodic as well as linguistic, and speaker information. This entanglement of information is problematic in scenarios where prosody is the main distinguishing factor while other factors may vary between training and deployment; in such cases, a purely prosodic representation would be more robust. Such representation could also be used for analyzing the role of prosody in a given task or as input to speech synthesis systems. In this work, we propose a variety of approaches for producing global prosodic embeddings based on auto-encoder models of pitch and energy. We develop a benchmark for assessing the performance of these representations, showing that our embeddings provide competitive or superior performance under challenging conditions, compared to various alternatives.