mlsanityData to 14 Oct 2026

Controlling Surprisal in Music Generation via Information Content Curve Matching

arXiv 2408.06022 ↗First posted 12 Aug 2024cs.SD cs.AI cs.CLcited by 7

Not on the map. Why?

Abstract (arXiv)

In recent years, the quality and public interest in music generation systems have grown, encouraging research into various ways to control these systems. We propose a novel method for controlling surprisal in music generation using sequence models. To achieve this goal, we define a metric called Instantaneous Information Content (IIC). The IIC serves as a proxy function for the perceived musical surprisal (as estimated from a probabilistic model) and can be calculated at any point within a music piece. This enables the comparison of surprisal across different musical content even if the musical events occur in irregular time intervals. We use beam search to generate musical material whose IIC curve closely approximates a given target IIC. We experimentally show that the IIC correlates with harmonic and rhythmic complexity and note density. The correlation decreases with the length of the musical context used for estimating the IIC. Finally, we conduct a qualitative user study to test if human listeners can identify the IIC curves that have been used as targets when generating the respective musical material. We provide code for creating IIC interpolations and IIC visualizations on https://github.com/muthissar/iic.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 9 of its 28 references that are in the map. First posted on arXiv 12 Aug 2024.

Builds on

9 of 28 references.

References · 9

  1. 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
  2. 2017Neural Audio Synthesis of Musical Notes with WaveNet Autoencoderscited by 225
  3. 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 217
  4. 2018Music Transformercited by 211
  5. 2020GiantMIDI-Piano: A large-scale MIDI dataset for classical piano musiccited by 37
  6. 2020AI Song Contest: Human-AI Co-Creation in Songwritingcited by 25
  7. 2021The Piano Inpainting Applicationcited by 23
  8. 2023The Batik-plays-Mozart Corpus: Linking Performance to Score to Musicological Annotationscited by 4
  9. 2023Exploring Sampling Techniques for Generating Melodies with a Transformer Language Modelcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 1; 2025: 4; 2026: 2.

7 papers.