Clean2FX: Label-conditioned modeling for clean-to-effect guitar audio transformations
Not on the map. Why?
Abstract (arXiv)
We present Clean2FX, a study and demo of label-conditioned clean-to-effect transformation for electric guitar audio. Given a clean guitar input and a target effect label, the task is to synthesize the corresponding effected signal while preserving the musical content. Training and evaluation pairs are constructed from EGFxSet real, single tone recordings by assembling matched clean/effected chords, melodies, and mixed timelines. This allows for controlled comparison across effects. We evaluate four neural approaches under a common spectrogram-based transformation setting: two variational autoencoders and two U-Net models that differ in whether they operate on linear or log-magnitude representations. Performance is measured using linear-magnitude spectrogram MSE and Fr'echet Audio Distance. The U-Net models outperform the variational autoencoder variants. Per-effect results show that distortion effects are most readily improved, whereas delay and reverb effects exhibit weaker FAD gains despite substantial spectral-error reductions. A conditioning-sensitivity diagnostic provides evidence that the best model responds to target labels rather than collapsing to a single transformation. Our demo website compares two models applied on real-world guitar performances outside training and validation data, providing audio and spectrogram examples of the practical clean-to-effect behavior.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 25 references that are in the map. First posted on arXiv 9 Jul 2026.
Builds on
12 of 25 references.
References · 12
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2018Group Normalizationcited by 1,524
- 2015Autoencoding beyond pixels using a learned similarity metriccited by 407
- 2019Conditioned-U-Net: Introducing a Control Mechanism in the U-Net for Multiple Source Separationscited by 27
- 2022Style Transfer of Audio Effects with Differentiable Signal Processingcited by 18
- 2020The impact of Audio input representations on neural network based music transcriptioncited by 4
- 2025Guitar-TECHS: An Electric Guitar Dataset Covering Techniques, Musical Excerpts, Chords and Scales Using a Diverse Array of Hardwarecited by 4
- 2024Leveraging Real Electric Guitar Tones and Effects to Improve Robustness in Guitar Tablature Transcription Modelingcited by 3
Built on by
Not cited yet.