ClearerVoice-Studio: Bridging Advanced Speech Processing Research and Practical Deployment
Not on the map. Why?
Abstract (arXiv)
This paper introduces ClearerVoice-Studio, an open-source, AI-powered speech processing toolkit designed to bridge cutting-edge research and practical application. Unlike broad platforms like SpeechBrain and ESPnet, ClearerVoice-Studio focuses on interconnected speech tasks of speech enhancement, separation, super-resolution, and multimodal target speaker extraction. A key advantage is its state-of-the-art pretrained models, including FRCRN with 3 million uses and MossFormer with 2.5 million uses, optimized for real-world scenarios. It also offers model optimization tools, multi-format audio support, the SpeechScore evaluation toolkit, and user-friendly interfaces, catering to researchers, developers, and end-users. Its rapid adoption attracting 3000 GitHub stars and 239 forks highlights its academic and industrial impact. This paper details ClearerVoice-Studio's capabilities, architectures, training strategies, benchmarks, community impact, and future plan. Source code is available at https://github.com/modelscope/ClearerVoice-Studio.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). First posted on arXiv 24 Jun 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 1; 2026: 10.
11 papers.
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generationcited by 20
- 2026MoXaRt: Audio-Visual Object-Guided Sound Interaction for XRcited by 1
- 2026Beyond Monologue: Interactive Talking-Listening Avatar Generation with Conversational Audio Context-Aware Kernelscited by 1
- 2025Decoding the Ear: A Framework for Objectifying Expressiveness from Human Preference Through Efficient Alignmentcited by 0
- 2026Hierarchical Codec Diffusion for Video-to-Speech Generationcited by 0
- 2026Feature-Aligned Speech Watermarking for Robustness to Reconstruction Distortionscited by 0
- 2026Poly-InstructTTS: Learning In-the-Wild Expressive Speech Synthesis from Open-Ended Instructionscited by 0
- 2026StrixAE: An Intelligent Agent for Audio Enhancement under Complex Distortion Coupling in Real-World Scenarioscited by 0
- 2026InterSing: Explicit Interaction Dynamics for 3D Duet Singing Animation and Beyondcited by 0
- 2026NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Taskcited by 0
- 2026VietPrism: A large-scale Vietnamese speech and deepfake corpus with diverse dialects and code-switchingcited by 0
- 2026VietPrism: A large-scale Vietnamese speech and deepfake corpus with diverse dialects and code-switching24 Sep 2026
- 2026NADI 2026: The Second Multidialectal Arabic Speech Processing Shared Task22 Sep 2026
- 2026InterSing: Explicit Interaction Dynamics for 3D Duet Singing Animation and Beyond4 Sep 2026
- 2026StrixAE: An Intelligent Agent for Audio Enhancement under Complex Distortion Coupling in Real-World Scenarios3 Sep 2026
- 2026Poly-InstructTTS: Learning In-the-Wild Expressive Speech Synthesis from Open-Ended Instructions30 Jun 2026
- 2026Feature-Aligned Speech Watermarking for Robustness to Reconstruction Distortions10 Jun 2026
- 2026Hierarchical Codec Diffusion for Video-to-Speech Generation17 Apr 2026
- 2026Beyond Monologue: Interactive Talking-Listening Avatar Generation with Conversational Audio Context-Aware Kernels11 Apr 2026
- 2026MoXaRt: Audio-Visual Object-Guided Sound Interaction for XR11 Mar 2026
- 2026DreamID-Omni: Unified Framework for Controllable Human-Centric Audio-Video Generation12 Feb 2026
- 2025Decoding the Ear: A Framework for Objectifying Expressiveness from Human Preference Through Efficient Alignment23 Oct 2025