Automatic music mixing with deep learning and out-of-domain data
Not on the map. Why?
Abstract (arXiv)
Music mixing traditionally involves recording instruments in the form of clean, individual tracks and blending them into a final mixture using audio effects and expert knowledge (e.g., a mixing engineer). The automation of music production tasks has become an emerging field in recent years, where rule-based methods and machine learning approaches have been explored. Nevertheless, the lack of dry or clean instrument recordings limits the performance of such models, which is still far from professional human-made mixes. We explore whether we can use out-of-domain data such as wet or processed multitrack music recordings and repurpose it to train supervised deep learning models that can bridge the current gap in automatic mixing quality. To achieve this we propose a novel data preprocessing method that allows the models to perform automatic music mixing. We also redesigned a listening test method for evaluating music mixing systems. We validate our results through such subjective tests using highly experienced mixing engineers as participants.
Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 9 of its 53 references that are in the map. First posted on arXiv 24 Aug 2022.
Builds on
9 of 53 references.
References · 9
- 2017Squeeze-and-Excitation Networkscited by 4,789
- 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 406
- 2021Music Demixing Challenge 2021cited by 38
- 2020Upsampling artifacts in neural audio synthesiscited by 28
- 2020Automatic multitrack mixing with a differentiable mixing console of neural audio effectscited by 27
- 2019Perceptual Loss Function for Neural Modelling of Audio Systemscited by 11
- 2021Reverb Conversion of Mixed Vocal Tracks Using an End-to-end Convolutional Deep Neural Networkcited by 8
- 2022Distortion Audio Effects: Learning How to Recover the Clean Signalcited by 4
- 2021Blind Estimation of Room Acoustic Parameters and Speech Transmission Index using MTF-based CNNscited by 1
Built on by
Citing papers per year: 2022: 1; 2023: 2; 2024: 3; 2025: 3; 2026: 2.
11 papers.
- 2022Music Mixing Style Transfer: A Contrastive Learning Approach to Disentangle Audio Effectscited by 18
- 2024Music Foundation Model as Generic Booster for Music Downstream Taskscited by 6
- 2025SonicMaster: Towards Controllable All-in-One Music Restoration and Masteringcited by 6
- 2023Adoption of AI Technology in the Music Mixing Workflow: An Investigationcited by 4
- 2023The Role of Communication and Reference Songs in the Mixing Process: Insights from Professional Mix Engineerscited by 1
- 2024Automatic Equalization for Individual Instrument Tracks Using Convolutional Neural Networkscited by 1
- 2024Prevailing Research Areas for Music AI in the Era of Foundation Modelscited by 1
- 2025Improving Inference-Time Optimisation for Vocal Effects Style Transfer with a Gaussian Priorcited by 0
- 2025Twenty-Five Years of MIR Research: Achievements, Practices, Evaluations, and Future Challengescited by 0
- 2026Music Restoration via Latent Operator Optimization and Diffusion Model Priorscited by 0
- 2026Diff2Mix: Controllable Music Mixing via Diffusion Models and Differentiable Audio Effectscited by 0
- 2026Diff2Mix: Controllable Music Mixing via Diffusion Models and Differentiable Audio Effects5 Aug 2026
- 2026Music Restoration via Latent Operator Optimization and Diffusion Model Priors3 Aug 2026
- 2025Twenty-Five Years of MIR Research: Achievements, Practices, Evaluations, and Future Challenges10 Nov 2025
- 2025SonicMaster: Towards Controllable All-in-One Music Restoration and Mastering5 Aug 2025
- 2025Improving Inference-Time Optimisation for Vocal Effects Style Transfer with a Gaussian Prior16 May 2025
- 2024Music Foundation Model as Generic Booster for Music Downstream Tasks2 Nov 2024
- 2024Prevailing Research Areas for Music AI in the Era of Foundation Models14 Sep 2024
- 2024Automatic Equalization for Individual Instrument Tracks Using Convolutional Neural Networks23 Jul 2024
- 2023The Role of Communication and Reference Songs in the Mixing Process: Insights from Professional Mix Engineers6 Sep 2023
- 2023Adoption of AI Technology in the Music Mixing Workflow: An Investigation6 Apr 2023
- 2022Music Mixing Style Transfer: A Contrastive Learning Approach to Disentangle Audio Effects4 Nov 2022