# In This Environment, As That Speaker: A Text-Driven Framework for Multi-Attribute Speech Conversion

arXiv: https://arxiv.org/abs/2506.07036 · HTML: https://mlsanity.com/paper/2506.07036/

## Key facts

- Cited by 1 papers in the map (data through 19 Oct 2026).
- First posted on arXiv 8 Jun 2025.

## Built on by (most cited first, 1 of 1)

- [Edit Who Speaks, Control How They Speak: Global Timbre Editing and Local Instruction Control for TTS](https://mlsanity.com/paper/2610.11437/) (2026)

## Abstract (arXiv)

We propose TES-VC (Text-driven Environment and Speaker controllable Voice Conversion), a text-driven voice conversion framework with independent control of speaker timbre and environmental acoustics. TES-VC processes simultaneous text inputs for target voice and environment, accurately generating speech matching described timbre/environment while preserving source content. Trained on synthetic data with decoupled vocal/environment features via latent diffusion modeling, our method eliminates interference between attributes. The Retrieval-Based Timbre Control (RBTC) module enables precise manipulation using abstract descriptions without paired data. Experiments confirm TES-VC effectively generates contextually appropriate speech in both timbre and environment with high content retention and superior controllability which demonstrates its potential for widespread applications.