mlsanityData to 7 Oct 2026

Evaluating Disentangled Representations for Controllable Music Generation

arXiv 2602.10058 ↗First posted 10 Feb 2026cs.SD cs.LG eess.AScited by 1

Not on the map. Why?

Abstract (arXiv)

Recent approaches in music generation rely on disentangled representations, often labeled as structure and timbre or local and global, to enable controllable synthesis. Yet the underlying properties of these embeddings remain underexplored. In this work, we evaluate such disentangled representations in a set of music audio models for controllable generation using a probing-based framework that goes beyond standard downstream tasks. The selected models reflect diverse unsupervised disentanglement strategies, including inductive biases, data augmentations, adversarial objectives, and staged training procedures. We further isolate specific strategies to analyze their effect. Our analysis spans four key axes: informativeness, equivariance, invariance, and disentanglement, which are assessed across datasets, tasks, and controlled transformations. Our findings reveal inconsistencies between intended and actual semantics of the embeddings, suggesting that current strategies fall short of producing truly disentangled representations, and prompting a re-examination of how controllability is approached in music generation.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 21 of its 25 references that are in the map. First posted on arXiv 10 Feb 2026.

Builds on

21 of 25 references.

References · 21

  1. 2023Simple and Controllable Music Generationcited by 480
  2. 2023MusicLM: Generating Music From Textcited by 442
  3. 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 215
  4. 2024Stable Audio Opencited by 192
  5. 2018Isolating Sources of Disentanglement in Variational Autoencoderscited by 167
  6. 2018Disentangled Sequential Autoencodercited by 117
  7. 2019Cutting Music Source Separation Some Slakh: A Dataset to Study the Impact of Training Data Quality and Quantitycited by 86
  8. 2023Music ControlNet: Multiple Time-varying Controls for Music Generationcited by 82
  9. 2021Codified audio language modeling learns useful representations for music information retrievalcited by 61
  10. 2023A Foundation Model for Music Informaticscited by 45
  11. 2024Joint Audio and Symbolic Conditioning for Temporally Controlled Text-to-Music Generationcited by 27
  12. 2022Unaligned Supervision For Automatic Music Transcription in The Wildcited by 25
9 more
  1. 2019Learning Disentangled Representations of Timbre and Pitch for Musical Instrument Sounds Using Gaussian Mixture Variational Autoencoderscited by 21
  2. 2024Seed-Music: A Unified Framework for High Quality and Controlled Music Generationcited by 21
  3. 2021Self-Supervised VQ-VAE for One-Shot Music Style Transfercited by 13
  4. 2024Do Music Generation Models Encode Music Theory?cited by 12
  5. 2024Combining audio control and style transfer using latent diffusioncited by 10
  6. 2021Is Disentanglement enough? On Latent Representations for Controllable Music Generationcited by 7
  7. 2025Towards a Unified Representation Evaluation Framework Beyond Downstream Taskscited by 7
  8. 2022Towards Robust Unsupervised Disentanglement of Sequential Data -- A Case Study Using Music Audiocited by 6
  9. 2025OMAR-RQ: Open Music Audio Representation Model Trained with Multi-Feature Masked Token Predictioncited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.