mlsanityData to 14 Oct 2026

Automatic music mixing with deep learning and out-of-domain data

arXiv 2208.11428 ↗First posted 24 Aug 2022eess.AS cs.LG cs.SDcited by 11

Not on the map. Why?

Abstract (arXiv)

Music mixing traditionally involves recording instruments in the form of clean, individual tracks and blending them into a final mixture using audio effects and expert knowledge (e.g., a mixing engineer). The automation of music production tasks has become an emerging field in recent years, where rule-based methods and machine learning approaches have been explored. Nevertheless, the lack of dry or clean instrument recordings limits the performance of such models, which is still far from professional human-made mixes. We explore whether we can use out-of-domain data such as wet or processed multitrack music recordings and repurpose it to train supervised deep learning models that can bridge the current gap in automatic mixing quality. To achieve this we propose a novel data preprocessing method that allows the models to perform automatic music mixing. We also redesigned a listening test method for evaluating music mixing systems. We validate our results through such subjective tests using highly experienced mixing engineers as participants.

Key facts. Cited by 11 papers in the map (data through 14 Oct 2026). Builds on 9 of its 53 references that are in the map. First posted on arXiv 24 Aug 2022.

Builds on

9 of 53 references.

References · 9

  1. 2017Squeeze-and-Excitation Networkscited by 4,789
  2. 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 406
  3. 2021Music Demixing Challenge 2021cited by 38
  4. 2020Upsampling artifacts in neural audio synthesiscited by 28
  5. 2020Automatic multitrack mixing with a differentiable mixing console of neural audio effectscited by 27
  6. 2019Perceptual Loss Function for Neural Modelling of Audio Systemscited by 11
  7. 2021Reverb Conversion of Mixed Vocal Tracks Using an End-to-end Convolutional Deep Neural Networkcited by 8
  8. 2022Distortion Audio Effects: Learning How to Recover the Clean Signalcited by 4
  9. 2021Blind Estimation of Room Acoustic Parameters and Speech Transmission Index using MTF-based CNNscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 1; 2023: 2; 2024: 3; 2025: 3; 2026: 2.

11 papers.