mlsanityData to 19 Oct 2026

Beyond Cross-Reconstruction: Probing-Based Disentanglement Evaluation for Acoustic Teleportation Codecs

arXiv 2606.31365 ↗First posted 30 Jun 2026eess.AS cs.SDcited by 0

On the map: Speech and audio language models → Vocoders and speech synthesis

Abstract (arXiv)

Some neural audio codecs disentangle speech into latent subspaces encoding content, speaker identity, and acoustics, enabling acoustic teleportation and voice conversion. Existing evaluations rely on cross-reconstruction quality, which cannot reliably detect leakage across partitions. We extend a probing based framework to assess disentanglement by regressing room-acoustic parameters (reverberation time, clarity, and direct-to-reverberant ratio) and classifying speaker identity, using the gap between intended and unintended partitions as the disentanglement measure. Applied to an acoustic teleportation codec, we find speaker identity is largely confined to its partition, while acoustics leak into the speech embeddings due to the training objective. Acoustic embeddings blindly estimate room parameters within 0.02 s of supervised baselines, indicating physically meaningful structure emerges without explicit supervision.

Key facts. No citing papers in the map yet (data through 19 Oct 2026). Placed in Vocoders and speech synthesis, one of 11 directions in Speech and audio language models. Builds on 13 of its 24 references that are in the map. First posted on arXiv 30 Jun 2026.

Builds on

13 of 24 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025Acoustic Teleportation via Disentangled Neural Audio Codec Representations15 Oct
  2. 2024FreeCodec: A disentangled neural speech codec with fewer tokens2 Dec
  3. 2024Learning Source Disentanglement in Neural Audio Codec17 Sep
  4. 2024NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Models5 Mar
  5. 2022Disentangling speech from surroundings with neural embeddings29 Mar

Other references · 8

  1. 2022High Fidelity Neural Audio Compressioncited by 917
  2. 2018Understanding disentangling in β-VAEcited by 349
  3. 2022Disentangled Representation Learningcited by 115
  4. 2023ICASSP 2023 Deep Noise Suppression Challengecited by 101
  5. 2019One-shot Voice Conversion by Separating Speaker and Content Representations with Instance Normalizationcited by 95
  6. 2022ContentVec: An Improved Self-Supervised Speech Representation by Disentangling Speakerscited by 84
  7. 2024SCOREQ: Speech Quality Assessment with Contrastive Regressioncited by 49
  8. 2025Towards a Unified Representation Evaluation Framework Beyond Downstream Taskscited by 8

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Exploring Disentangled Neural Speech Codecs from Self-Supervised Representations
  2. 2022Towards Disentangled Speech Representations
  3. 2025DeCodec: Rethinking Audio Codecs as Universal Disentangled Representation Learners
  4. 2025D'esentrelacement Fr'equentiel Doux pour les Codecs Audio Neuronaux
  5. 2026Unsupervised Cross-device Speaker Diarization And Linking Through Spatiotemporal Structure
  6. 2026EntangleCodec: A Unified Discrete Audio Tokenizer via Semantic-Acoustic Entanglement
  7. 2026AugCodec: A Low-Bitrate Disentangled Neural Speech Codec via Data Augmentation
  8. 2026A Comprehensive Study of Content Representations for Speech Synthesis