mlsanityData to 14 Oct 2026

Smule Renaissance Small: Efficient General-Purpose Vocal Restoration

arXiv 2510.21659 ↗First posted 24 Oct 2025cs.SDcited by 1

Not on the map. Why?

Abstract (arXiv)

Vocal recordings on consumer devices commonly suffer from multiple concurrent degradations: noise, reverberation, band-limiting, and clipping. We present Smule Renaissance Small (SRS), a compact single-stage model that performs end-to-end vocal restoration directly in the complex STFT domain. By incorporating phase-aware losses, SRS enables large analysis windows for improved frequency resolution while achieving 10.5x real-time inference on iPhone 12 CPU at 48 kHz. On the DNS 5 Challenge blind set, despite no speech training, SRS outperforms a strong GAN baseline and closely matches a computationally expensive flow-matching system. To enable evaluation under realistic multi-degradation scenarios, we introduce the Extreme Degradation Bench (EDB): 87 singing and speech recordings captured under severe acoustic conditions. On EDB, SRS surpasses all open-source baselines on singing and matches commercial systems, while remaining competitive on speech despite no speech-specific training. We release both SRS and EDB under the MIT License.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). First posted on arXiv 24 Oct 2025.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025VoiceRestore: Flow-Matching Transformers for Speech Recording Quality Restoration
  2. 2025REF-VC: Robust, Expressive and Fast Zero-Shot Voice Conversion with Diffusion Transformers
  3. 2026Self-supervised restoration of singing voice degraded by pitch shifting using shallow diffusion ↗
  4. 2026P2Flow: Phoneme-aware Progressive Flow Matching for Extreme Speech Super-Resolution
  5. 2025Towards Real-Time Generative Speech Restoration with Flow-Matching
  6. 2024High-Resolution Speech Restoration with Latent Diffusion Model
  7. 2024RDSinger: Reference-based Diffusion Network for Singing Voice Synthesis
  8. 2025FlashSR: One-step Versatile Audio Super-resolution via Diffusion Distillation