Tutti: Expressive Multi-Singer Synthesis via Structure-Level Timbre Control and Vocal Texture Modeling
Not on the map. Why?
Abstract (arXiv)
While existing Singing Voice Synthesis systems achieve high-fidelity solo performances, they are constrained by global timbre control, failing to address dynamic multi-singer arrangement and vocal texture within a single song. To address this, we propose Tutti, a unified framework designed for structured multi-singer generation. Specifically, we introduce a Structure-Aware Singer Prompt to enable flexible singer scheduling evolving with musical structure, and propose Complementary Texture Learning via Condition-Guided VAE to capture implicit acoustic textures (e.g., spatial reverberation and spectral fusion) that are complementary to explicit controls. Experiments demonstrate that Tutti excels in precise multi-singer scheduling and significantly enhances the acoustic realism of choral generation, offering a novel paradigm for complex multi-singer arrangement. Audio samples are available at https://annoauth123-ctrl.github.io/Tutii_Demo/.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 29 of its 39 references that are in the map. First posted on arXiv 9 Feb 2026.
Builds on
29 of 39 references.
References · 29
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 592
- 2020Jukebox: A Generative Model for Musiccited by 535
- 2023MusicLM: Generating Music From Textcited by 442
- 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
- 2024Stable Audio Opencited by 192
- 2021DiffSinger: Singing Voice Synthesis via Shallow Diffusion Mechanismcited by 154
- 2022Generative Spoken Dialogue Language Modelingcited by 125
- 2023Audiobox: Unified Audio Generation with Natural Language Promptscited by 120
- 2023CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Maskingcited by 95
17 more
- 2025DiffRhythm: Blazingly Fast and Embarrassingly Simple End-to-End Full-Length Song Generation with Latent Diffusioncited by 46
- 2024A Full-duplex Speech Dialogue Scheme Based On Large Language Modelscited by 40
- 2021VISinger: Variational Inference with Adversarial Learning for End-to-End Singing Voice Synthesiscited by 38
- 2023Music Source Separation with Band-Split RoPE Transformercited by 36
- 2025Vevo: Controllable Zero-Shot Voice Imitation with Self-Supervised Disentanglementcited by 34
- 2023Make-A-Voice: Unified Voice Synthesis With Discrete Representationcited by 27
- 2025SongEval: A Benchmark Dataset for Song Aesthetics Evaluationcited by 24
- 2025LeVo: High-Quality Song Generation with Multi-Preference Alignmentcited by 23
- 2025SongBloom: Coherent Song Generation via Interleaved Autoregressive Sketching and Diffusion Refinementcited by 21
- 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Controlcited by 20
- 2025TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matchingcited by 19
- 2024CoVoMix: Advancing Zero-Shot Speech Generation for Human-like Multi-talker Conversationscited by 15
- 2025CoVoMix2: Advancing Zero-Shot Dialogue Generation with Fully Non-Autoregressive Flow Matchingcited by 11
- 2025JoyVoice: Long-Context Conditioning for Anthropomorphic Multi-Speaker Conversational Synthesiscited by 6
- 2025SongPrep: A Preprocessing Framework and End-to-end Model for Full-song Structure Parsing and Lyrics Transcriptioncited by 5
- 2025DialoSpeech: Dual-Speaker Dialogue Generation with LLM and Flow Matchingcited by 3
- 2024InstructSing: High-Fidelity Singing Voice Generation via Instructing Yourselfcited by 2
Built on by
Not cited yet.