Fx-Encoder++: Extracting Instrument-Wise Audio Effects Representations from Mixtures
Not on the map. Why?
Abstract (arXiv)
General-purpose audio representations have proven effective across diverse music information retrieval applications, yet their utility in intelligent music production remains limited by insufficient understanding of audio effects (Fx). Although previous approaches have emphasized audio effects analysis at the mixture level, this focus falls short for tasks demanding instrument-wise audio effects understanding, such as automatic mixing. In this work, we present Fx-Encoder++, a novel model designed to extract instrument-wise audio effects representations from music mixtures. Our approach leverages a contrastive learning framework and introduces an "extractor" mechanism that, when provided with instrument queries (audio or text), transforms mixture-level audio effects embeddings into instrument-wise audio effects embeddings. We evaluated our model across retrieval and audio effects parameter matching tasks, testing its performance across a diverse range of instruments. The results demonstrate that Fx-Encoder++ outperforms previous approaches at mixture level and show a novel ability to extract effects representation instrument-wise, addressing a critical capability gap in intelligent music production systems.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 3 Jul 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Probing Low-Level Acoustic Attribute Encoding in CLAP Audio Embeddingscited by 1
- 2026Auditing Training Data in Generative Music Models via Black-Box Membership Inferencecited by 0
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Featurescited by 0
- 2026Music Restoration via Latent Operator Optimization and Diffusion Model Priorscited by 0
- 2026Diff2Mix: Controllable Music Mixing via Diffusion Models and Differentiable Audio Effectscited by 0
- 2026End-to-End Historical Music Restoration in Latent Spacecited by 0
- 2026End-to-End Historical Music Restoration in Latent Space30 Sep 2026
- 2026Diff2Mix: Controllable Music Mixing via Diffusion Models and Differentiable Audio Effects5 Aug 2026
- 2026Music Restoration via Latent Operator Optimization and Diffusion Model Priors3 Aug 2026
- 2026Probing Low-Level Acoustic Attribute Encoding in CLAP Audio Embeddings4 Jul 2026
- 2026Beyond Artifacts: Towards Generalizable Synthetic Song Detection via Music-Intrinsic Features15 Jun 2026
- 2026Auditing Training Data in Generative Music Models via Black-Box Membership Inference28 May 2026