Smule Renaissance Small: Efficient General-Purpose Vocal Restoration
Not on the map. Why?
Abstract (arXiv)
Vocal recordings on consumer devices commonly suffer from multiple concurrent degradations: noise, reverberation, band-limiting, and clipping. We present Smule Renaissance Small (SRS), a compact single-stage model that performs end-to-end vocal restoration directly in the complex STFT domain. By incorporating phase-aware losses, SRS enables large analysis windows for improved frequency resolution while achieving 10.5x real-time inference on iPhone 12 CPU at 48 kHz. On the DNS 5 Challenge blind set, despite no speech training, SRS outperforms a strong GAN baseline and closely matches a computationally expensive flow-matching system. To enable evaluation under realistic multi-degradation scenarios, we introduce the Extreme Degradation Bench (EDB): 87 singing and speech recordings captured under severe acoustic conditions. On EDB, SRS surpasses all open-source baselines on singing and matches commercial systems, while remaining competitive on speech despite no speech-specific training. We release both SRS and EDB under the MIT License.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). First posted on arXiv 24 Oct 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025VoiceRestore: Flow-Matching Transformers for Speech Recording Quality Restoration
- 2025REF-VC: Robust, Expressive and Fast Zero-Shot Voice Conversion with Diffusion Transformers
- 2026Self-supervised restoration of singing voice degraded by pitch shifting using shallow diffusion ↗
- 2026P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolution
- 2025Towards Real-Time Generative Speech Restoration with Flow-Matching
- 2024High-Resolution Speech Restoration with Latent Diffusion Model
- 2024RDSinger: Reference-based Diffusion Network for Singing Voice Synthesis
- 2025FlashSR: One-step Versatile Audio Super-resolution via Diffusion Distillation