TechSinger: Technique Controllable Multilingual Singing Voice Synthesis via Flow Matching
Not on the map. Why?
Abstract (arXiv)
Singing voice synthesis has made remarkable progress in generating natural and high-quality voices. However, existing methods rarely provide precise control over vocal techniques such as intensity, mixed voice, falsetto, bubble, and breathy tones, thus limiting the expressive potential of synthetic voices. We introduce TechSinger, an advanced system for controllable singing voice synthesis that supports five languages and seven vocal techniques. TechSinger leverages a flow-matching-based generative model to produce singing voices with enhanced expressive control over various techniques. To enhance the diversity of training data, we develop a technique detection model that automatically annotates datasets with phoneme-level technique labels. Additionally, our prompt-based technique prediction model enables users to specify desired vocal attributes through natural language, offering fine-grained control over the synthesized singing. Experimental results demonstrate that TechSinger significantly enhances the expressiveness and realism of synthetic singing voices, outperforming existing methods in terms of audio quality and technique-specific control. Audio samples can be found at https://gwx314.github.io/tech-singer/.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). First posted on arXiv 18 Feb 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 10; 2026: 9.
19 papers.
Sort:
By area:
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessmentcited by 7
- 2025TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesiscited by 5
- 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generationcited by 5
- 2025Versatile Framework for Song Generation with Prompt-based Controlcited by 4
- 2025CoMelSinger: Discrete Token-Based Zero-Shot Singing Synthesis With Structured Melody Control and Guidancecited by 3
- 2025DiTSinger: Scaling Singing Voice Synthesis with Diffusion Transformer and Implicit Alignmentcited by 3
- 2025Controllable Singing Voice Synthesis using Phoneme-Level Energy Sequencecited by 1
- 2025LTA-L2S: Lexical Tone-Aware Lip-to-Speech Synthesis for Mandarin with Cross-Lingual Transfer Learningcited by 1
- 2026Towards Streaming Synchronized Spatial Audio Generation via Autoregressive Diffusion Transformercited by 1
- 2025Leveraging Pretrained Diffusion Models for Zero-Shot Part Assemblycited by 0
- 2025Systematizing LLM Persona Design: A Four-Quadrant Technical Taxonomy for AI Companion Applicationscited by 0
- 2026Mitigating Latent Mismatch in cVAE-Based Singing Voice Synthesis via Flow Matchingcited by 0
7 more
- 2026Tutti: Expressive Multi-Singer Synthesis via Structure-Level Timbre Control and Vocal Texture Modelingcited by 0
- 2026Aligning Language Models for Lyric-to-Melody Generation with Rule-Based Musical Constraintscited by 0
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Modelscited by 0
- 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Controlcited by 0
- 2026MPEcho: A Melody and Phoneme-Aware Generative Framework for Controllable Cover Song Generationcited by 0
- 2026VocalRender: Score-Native Singing Voice Synthesis for Real-World Compositioncited by 0
- 2026VIOLET: High-Fidelity Violin Synthesis with Techniques and Dynamicscited by 0
- 2026VIOLET: High-Fidelity Violin Synthesis with Techniques and Dynamics8 Aug 2026
- 2026VocalRender: Score-Native Singing Voice Synthesis for Real-World Composition30 Jul 2026
- 2026MPEcho: A Melody and Phoneme-Aware Generative Framework for Controllable Cover Song Generation29 Jul 2026
- 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Control15 Jun 2026
- 2026Towards Streaming Synchronized Spatial Audio Generation via Autoregressive Diffusion Transformer29 May 2026
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Models6 May 2026
- 2026Aligning Language Models for Lyric-to-Melody Generation with Rule-Based Musical Constraints20 Apr 2026
- 2026Tutti: Expressive Multi-Singer Synthesis via Structure-Level Timbre Control and Vocal Texture Modeling9 Feb 2026
- 2026Mitigating Latent Mismatch in cVAE-Based Singing Voice Synthesis via Flow Matching1 Jan 2026
- 2025Systematizing LLM Persona Design: A Four-Quadrant Technical Taxonomy for AI Companion Applications4 Nov 2025
- 2025DiTSinger: Scaling Singing Voice Synthesis with Diffusion Transformer and Implicit Alignment10 Oct 2025
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessment2 Oct 2025
7 more
- 2025LTA-L2S: Lexical Tone-Aware Lip-to-Speech Synthesis for Mandarin with Cross-Lingual Transfer Learning30 Sep 2025
- 2025CoMelSinger: Discrete Token-Based Zero-Shot Singing Synthesis With Structured Melody Control and Guidance24 Sep 2025
- 2025Controllable Singing Voice Synthesis using Phoneme-Level Energy Sequence8 Sep 2025
- 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generation22 Aug 2025
- 2025TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis20 May 2025
- 2025Leveraging Pretrained Diffusion Models for Zero-Shot Part Assembly1 May 2025
- 2025Versatile Framework for Song Generation with Prompt-based Control27 Apr 2025
- 2025DiTSinger: Scaling Singing Voice Synthesis with Diffusion Transformer and Implicit Alignmentcited by 3
- 2025LTA-L2S: Lexical Tone-Aware Lip-to-Speech Synthesis for Mandarin with Cross-Lingual Transfer Learningcited by 1
- 2026Towards Streaming Synchronized Spatial Audio Generation via Autoregressive Diffusion Transformercited by 1
- 2025Leveraging Pretrained Diffusion Models for Zero-Shot Part Assemblycited by 0
- 2026Mitigating Latent Mismatch in cVAE-Based Singing Voice Synthesis via Flow Matchingcited by 0
- 2026VIOLET: High-Fidelity Violin Synthesis with Techniques and Dynamicscited by 0
- 2026VIOLET: High-Fidelity Violin Synthesis with Techniques and Dynamics8 Aug 2026
- 2026Towards Streaming Synchronized Spatial Audio Generation via Autoregressive Diffusion Transformer29 May 2026
- 2026Mitigating Latent Mismatch in cVAE-Based Singing Voice Synthesis via Flow Matching1 Jan 2026
- 2025DiTSinger: Scaling Singing Voice Synthesis with Diffusion Transformer and Implicit Alignment10 Oct 2025
- 2025LTA-L2S: Lexical Tone-Aware Lip-to-Speech Synthesis for Mandarin with Cross-Lingual Transfer Learning30 Sep 2025
- 2025Leveraging Pretrained Diffusion Models for Zero-Shot Part Assembly1 May 2025
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessmentcited by 7
- 2025TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesiscited by 5
- 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generationcited by 5
- 2025Versatile Framework for Song Generation with Prompt-based Controlcited by 4
- 2025CoMelSinger: Discrete Token-Based Zero-Shot Singing Synthesis With Structured Melody Control and Guidancecited by 3
- 2025Controllable Singing Voice Synthesis using Phoneme-Level Energy Sequencecited by 1
- 2025Systematizing LLM Persona Design: A Four-Quadrant Technical Taxonomy for AI Companion Applicationscited by 0
- 2026Tutti: Expressive Multi-Singer Synthesis via Structure-Level Timbre Control and Vocal Texture Modelingcited by 0
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Modelscited by 0
- 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Controlcited by 0
- 2026MPEcho: A Melody and Phoneme-Aware Generative Framework for Controllable Cover Song Generationcited by 0
- 2026VocalRender: Score-Native Singing Voice Synthesis for Real-World Compositioncited by 0
- 2026VocalRender: Score-Native Singing Voice Synthesis for Real-World Composition30 Jul 2026
- 2026MPEcho: A Melody and Phoneme-Aware Generative Framework for Controllable Cover Song Generation29 Jul 2026
- 2026Vibrato Expression Control for Singing Voice Conversion with Improving Independent Control15 Jun 2026
- 2026VocalParse: Towards Unified and Scalable Singing Voice Transcription with Large Audio Language Models6 May 2026
- 2026Tutti: Expressive Multi-Singer Synthesis via Structure-Level Timbre Control and Vocal Texture Modeling9 Feb 2026
- 2025Systematizing LLM Persona Design: A Four-Quadrant Technical Taxonomy for AI Companion Applications4 Nov 2025
- 2025SingMOS-Pro: An Comprehensive Benchmark for Singing Quality Assessment2 Oct 2025
- 2025CoMelSinger: Discrete Token-Based Zero-Shot Singing Synthesis With Structured Melody Control and Guidance24 Sep 2025
- 2025Controllable Singing Voice Synthesis using Phoneme-Level Energy Sequence8 Sep 2025
- 2025Vevo2: A Unified and Controllable Framework for Speech and Singing Voice Generation22 Aug 2025
- 2025TCSinger 2: Customizable Multilingual Zero-shot Singing Voice Synthesis20 May 2025
- 2025Versatile Framework for Song Generation with Prompt-based Control27 Apr 2025
Similar, not cited
Close in wording, no citation either way
- 2024TCSinger: Zero-Shot Singing Voice Synthesis with Style Transfer and Multi-Level Style Control
- 2024ConSinger: Efficient High-Fidelity Singing Voice Generation with Minimal Steps
- 2025Generative Multi-modal Feedback for Singing Voice Synthesis Evaluation
- 2025Adapting Speech Language Model to Singing Voice Synthesis ↗
- 2023HiddenSinger: High-Quality Singing Voice Synthesis via Neural Audio Codec and Latent Diffusion Models
- 2026Adapting Diffusion-Based Music Synthesis to Speech and Singing Voice Conversion
- 2025SmoothSinger: A Conditional Diffusion Model for Singing Voice Synthesis with Multi-Resolution Architecture
- 2024CONTUNER: Singing Voice Beautifying with Pitch and Expressiveness Condition