SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering
Not on the map. Why?
Abstract (arXiv)
Music recordings often suffer from audio quality issues such as excessive reverberation, distortion, clipping, tonal imbalances, and a narrowed stereo image, especially when created in non-professional settings without specialized equipment or expertise. These problems are typically corrected using separate specialized tools and manual adjustments. In this paper, we introduce SonicMaster, the first unified generative model for music restoration and mastering that addresses a broad spectrum of audio artifacts with text-based control. SonicMaster is conditioned on natural language instructions to apply targeted enhancements, or can operate in an automatic mode for general restoration. To train this model, we construct the SonicMaster dataset, a large dataset of paired degraded and high-quality tracks by simulating common degradation types with nineteen degradation functions belonging to five enhancements groups: equalization, dynamics, reverb, amplitude, and stereo. Our approach leverages a flow-matching generative training paradigm to learn an audio transformation that maps degraded inputs to their cleaned, mastered versions guided by text prompts. Objective audio quality metrics demonstrate that SonicMaster significantly improves sound quality across all artifact categories. Furthermore, subjective listening tests confirm that listeners prefer SonicMaster's enhanced outputs over other baselines.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 44 of its 68 references that are in the map. First posted on arXiv 5 Aug 2025.
Builds on
44 of 68 references.
References · 44
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
- 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 344
- 2024Fast Timing-Conditioned Latent Audio Diffusioncited by 181
- 2025Meta Audiobox Aesthetics: Unified Automatic Quality Assessment for Speech, Music, and Soundcited by 137
- 2017Pyroomacoustics: A Python package for audio room simulations and array processing algorithmscited by 132
- 2023Mustango: Toward Controllable Text-to-Music Generationcited by 100
- 2021Hybrid Spectrogram and Waveform Source Separationcited by 91
32 more
- 2023AUDIT: Audio Editing by Following Instructions with Latent Diffusion Modelscited by 83
- 2019Phase-aware Speech Enhancement with Deep Complex U-Netcited by 73
- 2020Dual-Path Transformer Network: Direct Context-Aware Modeling for End-to-End Monaural Speech Separationcited by 68
- 2024TangoFlux: Super Fast and Faithful Text to Audio Generation with Flow Matching and Clap-Ranked Preference Optimizationcited by 68
- 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 60
- 2021VoiceFixer: Toward General Speech Restoration with Neural Vocodercited by 50
- 2017A Wavenet for Speech Denoisingcited by 47
- 2024MusicMagus: Zero-Shot Text-to-Music Editing via Diffusion Modelscited by 32
- 2024Diffusion Models for Audio Restorationcited by 32
- 2020Automatic multitrack mixing with a differentiable mixing console of neural audio effectscited by 27
- 2024MaskSR: Masked Language Model for Full-band Speech Restorationcited by 24
- 2023Blind Audio Bandwidth Extension: A Diffusion-Based Zero-Shot Approachcited by 21
- 2024FlowSep: Language-Queried Sound Separation with Rectified Flow Matchingcited by 21
- 2024FLUX that Plays Musiccited by 18
- 2021Efficient neural networks for real-time modeling of analog dynamic range compressioncited by 15
- 2025JamendoMaxCaps: A Large Scale Music-caption Dataset with Imputed Metadatacited by 15
- 2022BEHM-GAN: Bandwidth Extension of Historical Music using Generative Adversarial Networkscited by 13
- 2023Diffusion-Based Audio Inpaintingcited by 13
- 2024Editing Music with Melody and Text: Using ControlNet for Diffusion Transformercited by 13
- 2022Music Enhancement via Image Translation and Vocodingcited by 11
- 2022Automatic music mixing with deep learning and out-of-domain datacited by 11
- 2024Text2FX: Harnessing CLAP Embeddings for Text-Guided Audio Effectscited by 9
- 2020A survey and an extensive evaluation of popular audio declipping methodscited by 7
- 2023General Purpose Audio Effect Removalcited by 7
- 2024Listen, Chat, and Remix: Text-Guided Soundscape Remixing for Enhanced Auditory Experiencecited by 6
- 2025Music Source Restorationcited by 5
- 2022Distortion Audio Effects: Learning How to Recover the Clean Signalcited by 4
- 2025ImprovNet -- Generating Controllable Musical Improvisations with Iterative Corruption Refinementcited by 3
- 2024Searching For Music Mixing Graphs: A Pruning Approachcited by 1
- 2024Automatic Equalization for Individual Instrument Tracks Using Convolutional Neural Networkscited by 1
- 2024POLIPHONE: A Dataset for Smartphone Model Identification from Audio Recordingscited by 1
- 2024Exploring trends in audio mixes and masters: Insights from a dataset analysiscited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026ALARM: Audio-Language Alignment for Reasoning Modelscited by 1
- 2026Probing Low-Level Acoustic Attribute Encoding in CLAP Audio Embeddingscited by 1
- 2026Single-step Controllable Music Bandwidth Extension With Flow Matchingcited by 0
- 2026Multi-Stage Music Source Restoration with BandSplit-RoFormer Separation and HiFi++ GANcited by 0
- 2026Music Source Restoration with Ensemble Separation and Targeted Reconstructioncited by 0
- 2026HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmarkcited by 0
- 2026Probing Low-Level Acoustic Attribute Encoding in CLAP Audio Embeddings4 Jul 2026
- 2026HAIM: Human-AI Music Datasets for AI Music Production Tracking Benchmark1 Jun 2026
- 2026Music Source Restoration with Ensemble Separation and Targeted Reconstruction13 Mar 2026
- 2026ALARM: Audio-Language Alignment for Reasoning Models10 Mar 2026
- 2026Multi-Stage Music Source Restoration with BandSplit-RoFormer Separation and HiFi++ GAN4 Mar 2026
- 2026Single-step Controllable Music Bandwidth Extension With Flow Matching20 Jan 2026
Similar, not cited
Close in wording, no citation either way
- 2024A Diffusion-Based Generative Equalizer for Music Restoration
- 2026End-to-End Historical Music Restoration in Latent Space
- 2026Music Restoration via Latent Operator Optimization and Diffusion Model Priors
- 2025MuseControlLite: Multifunctional Music Generation with Lightweight Conditioners
- 2025Token-Based Audio Inpainting via Discrete Diffusion
- 2025AudioMorphix: Training-free audio editing with diffusion probabilistic models
- 2025Audio Palette: A Diffusion Transformer with Multi-Signal Conditioning for Controllable Foley Synthesis
- 2026The NPU-ASLP System for Music Restoration in the CCF-AATC 2026 Challenge ↗