mlsanityData to 14 Oct 2026

SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering

arXiv 2508.03448 ↗First posted 5 Aug 2025cs.SD cs.AI cs.MMcited by 6

Not on the map. Why?

Abstract (arXiv)

Music recordings often suffer from audio quality issues such as excessive reverberation, distortion, clipping, tonal imbalances, and a narrowed stereo image, especially when created in non-professional settings without specialized equipment or expertise. These problems are typically corrected using separate specialized tools and manual adjustments. In this paper, we introduce SonicMaster, the first unified generative model for music restoration and mastering that addresses a broad spectrum of audio artifacts with text-based control. SonicMaster is conditioned on natural language instructions to apply targeted enhancements, or can operate in an automatic mode for general restoration. To train this model, we construct the SonicMaster dataset, a large dataset of paired degraded and high-quality tracks by simulating common degradation types with nineteen degradation functions belonging to five enhancements groups: equalization, dynamics, reverb, amplitude, and stereo. Our approach leverages a flow-matching generative training paradigm to learn an audio transformation that maps degraded inputs to their cleaned, mastered versions guided by text prompts. Objective audio quality metrics demonstrate that SonicMaster significantly improves sound quality across all artifact categories. Furthermore, subjective listening tests confirm that listeners prefer SonicMaster's enhanced outputs over other baselines.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 44 of its 68 references that are in the map. First posted on arXiv 5 Aug 2025.

Builds on

44 of 68 references.

References · 44

  1. 2022Scalable Diffusion Models with Transformerscited by 6,054
  2. 2022Classifier-Free Diffusion Guidancecited by 5,847
  3. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  6. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
  7. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 344
  8. 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 181
  9. 2025Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Soundcited by 137
  10. 2017Pyroomacoustics: A Python package for audio room simulations and array processing algorithmscited by 132
  11. 2023Mustango: Toward Controllable Text-to-Music Generationcited by 100
  12. 2021Hybrid Spectrogram and Waveform Source Separationcited by 91
32 more
  1. 2023AUDIT: Audio Editing by Following Instructions with Latent Diffusion Modelscited by 83
  2. 2019Phase-aware Speech Enhancement with Deep Complex U-Netcited by 73
  3. 2020Dual-Path Transformer Network: Direct Context-Aware Modeling for End-to-End Monaural Speech Separationcited by 68
  4. 2024TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimizationcited by 68
  5. 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 60
  6. 2021VoiceFixer: Toward General Speech Restoration with Neural Vocodercited by 50
  7. 2017A Wavenet for Speech Denoisingcited by 47
  8. 2024MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Modelscited by 32
  9. 2024Diffusion Models for Audio Restorationcited by 32
  10. 2020Automatic multitrack mixing with a differentiable mixing console of neural audio effectscited by 27
  11. 2024MaskSR: Masked Language Model for Full-band Speech Restorationcited by 24
  12. 2023Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approachcited by 21
  13. 2024FlowSep: Language-Queried Sound Separation with Rectified Flow Matchingcited by 21
  14. 2024FLUX that Plays Musiccited by 18
  15. 2021Efficient neural networks for real-time modeling of analog dynamic range compressioncited by 15
  16. 2025JamendoMaxCaps: A Large Scale Music-caption Dataset with Imputed Metadatacited by 15
  17. 2022BEHM-GAN: Bandwidth Extension of Historical Music using Generative Adversarial Networkscited by 13
  18. 2023Diffusion-Based Audio Inpaintingcited by 13
  19. 2024Editing Music with Melody and Text: Using ControlNet for Diffusion Transformercited by 13
  20. 2022Music Enhancement via Image Translation and Vocodingcited by 11
  21. 2022Automatic music mixing with deep learning and out-of-domain datacited by 11
  22. 2024Text2FX: Harnessing CLAP Embeddings for Text-Guided Audio Effectscited by 9
  23. 2020A survey and an extensive evaluation of popular audio declipping methodscited by 7
  24. 2023General Purpose Audio Effect Removalcited by 7
  25. 2024Listen, Chat, and Remix: Text-Guided Soundscape Remixing for Enhanced Auditory Experiencecited by 6
  26. 2025Music Source Restorationcited by 5
  27. 2022Distortion Audio Effects: Learning How to Recover the Clean Signalcited by 4
  28. 2025ImprovNet -- Generating Controllable Musical Improvisations with Iterative Corruption Refinementcited by 3
  29. 2024Searching For Music Mixing Graphs: A Pruning Approachcited by 1
  30. 2024Automatic Equalization for Individual Instrument Tracks Using Convolutional Neural Networkscited by 1
  31. 2024POLIPHONE: A Dataset for Smartphone Model Identification from Audio Recordingscited by 1
  32. 2024Exploring trends in audio mixes and masters: Insights from a dataset analysiscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024A Diffusion-Based Generative Equalizer for Music Restoration
  2. 2026End-to-End Historical Music Restoration in Latent Space
  3. 2026Music Restoration via Latent Operator Optimization and Diffusion Model Priors
  4. 2025MuseControlLite: Multifunctional Music Generation with Lightweight Conditioners
  5. 2025Token-Based Audio Inpainting via Discrete Diffusion
  6. 2025AudioMorphix: Training-free audio editing with diffusion probabilistic models
  7. 2025Audio Palette: A Diffusion Transformer with Multi-Signal Conditioning for Controllable Foley Synthesis
  8. 2026The NPU-ASLP System for Music Restoration in the CCF-AATC 2026 Challenge ↗