mlsanityData to 7 Oct 2026

Tutti: Expressive Multi-Singer Synthesis via Structure-Level Timbre Control and Vocal Texture Modeling

arXiv 2602.08233 ↗First posted 9 Feb 2026cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

While existing Singing Voice Synthesis systems achieve high-fidelity solo performances, they are constrained by global timbre control, failing to address dynamic multi-singer arrangement and vocal texture within a single song. To address this, we propose Tutti, a unified framework designed for structured multi-singer generation. Specifically, we introduce a Structure-Aware Singer Prompt to enable flexible singer scheduling evolving with musical structure, and propose Complementary Texture Learning via Condition-Guided VAE to capture implicit acoustic textures (e.g., spatial reverberation and spectral fusion) that are complementary to explicit controls. Experiments demonstrate that Tutti excels in precise multi-singer scheduling and significantly enhances the acoustic realism of choral generation, offering a novel paradigm for complex multi-singer arrangement. Audio samples are available at https://annoauth123-ctrl.github.io/Tutii_Demo/.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 39 references that are in the map. First posted on arXiv 9 Feb 2026.

Builds on

29 of 39 references.

References · 29

  1. 2022Flow Matching for Generative Modelingcited by 5,426
  2. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  3. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  4. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
  5. 2020Jukebox: A Generative Model for Musiccited by 535
  6. 2023MusicLM: Generating Music From Textcited by 442
  7. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
  8. 2024Stable Audio Opencited by 192
  9. 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
  10. 2022Generative Spoken Dialogue Language Modelingcited by 125
  11. 2023Audiobox: Unified Audio Generation with Natural Language Promptscited by 120
  12. 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 95
17 more
  1. 2025DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusioncited by 46
  2. 2024A Full-duplex Speech Dialogue Scheme Based On Large Language Modelscited by 40
  3. 2021VISinger: Variational Inference with Adversarial Learning for End-to-End Singing Voice Synthesiscited by 38
  4. 2023Music Source Separation with Band-Split RoPE Transformercited by 36
  5. 2025Vevo: Controllable Zero-Shot Voice Imitation with Self-Supervised Disentanglementcited by 34
  6. 2023Make-A-Voice: Unified Voice Synthesis With Discrete Representationcited by 27
  7. 2025SongEval: A Benchmark Dataset for Song Aesthetics Evaluationcited by 24
  8. 2025LeVo: High-Quality Song Generation with Multi-Preference Alignmentcited by 23
  9. 2025SongBloom: Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinementcited by 21
  10. 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Controlcited by 20
  11. 2025TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matchingcited by 19
  12. 2024CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversationscited by 15
  13. 2025CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matchingcited by 11
  14. 2025JoyVoice: Long-Context Conditioning for Anthropomorphic Multi-Speaker Conversational Synthesiscited by 6
  15. 2025SongPrep: A Preprocessing Framework and End-to-end Model for Full-song Structure Parsing and Lyrics Transcriptioncited by 5
  16. 2025DialoSpeech: Dual-Speaker Dialogue Generation with LLM and Flow Matchingcited by 3
  17. 2024InstructSing: High-Fidelity Singing Voice Generation via Instructing Yourselfcited by 2

Built on by

Not cited yet.