Controlling Surprisal in Music Generation via Information Content Curve Matching
Not on the map. Why?
Abstract (arXiv)
In recent years, the quality and public interest in music generation systems have grown, encouraging research into various ways to control these systems. We propose a novel method for controlling surprisal in music generation using sequence models. To achieve this goal, we define a metric called Instantaneous Information Content (IIC). The IIC serves as a proxy function for the perceived musical surprisal (as estimated from a probabilistic model) and can be calculated at any point within a music piece. This enables the comparison of surprisal across different musical content even if the musical events occur in irregular time intervals. We use beam search to generate musical material whose IIC curve closely approximates a given target IIC. We experimentally show that the IIC correlates with harmonic and rhythmic complexity and note density. The correlation decreases with the length of the musical context used for estimating the IIC. Finally, we conduct a qualitative user study to test if human listeners can identify the IIC curves that have been used as targets when generating the respective musical material. We provide code for creating IIC interpolations and IIC visualizations on https://github.com/muthissar/iic.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 9 of its 28 references that are in the map. First posted on arXiv 12 Aug 2024.
Builds on
9 of 28 references.
References · 9
- 2021Perceiver IO: A General Architecture for Structured Inputs & Outputscited by 629
- 2017Neural Audio Synthesis of Musical Notes with WaveNet Autoencoderscited by 225
- 2018Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Datasetcited by 217
- 2018Music Transformercited by 211
- 2020GiantMIDI-Piano: A large-scale MIDI dataset for classical piano musiccited by 37
- 2020AI Song Contest: Human-AI Co-Creation in Songwritingcited by 25
- 2021The Piano Inpainting Applicationcited by 23
- 2023The Batik-plays-Mozart Corpus: Linking Performance to Score to Musicological Annotationscited by 4
- 2023Exploring Sampling Techniques for Generating Melodies with a Transformer Language Modelcited by 3
Built on by
Citing papers per year: 2024: 1; 2025: 4; 2026: 2.
7 papers.
- 2024Surprise! Uniform Information Density Isn't the Whole Story: Predicting Surprisal Contours in Long-form Discoursecited by 17
- 2025Estimating Musical Surprisal in Audiocited by 3
- 2025Estimating Musical Surprisal from Audio in Autoregressive Diffusion Model Noise Spacescited by 1
- 2026Stemphonic: All-at-once Flexible Multi-stem Music Generationcited by 1
- 2026Predicting States of Understanding in Explanatory Interactions Using Cognitive Load-Related Linguistic Cuescited by 1
- 2025Perceptually Aligning Representations of Music via Noise-Augmented Autoencoderscited by 0
- 2025Explicit Tonal Tension Conditioning via Dual-Level Beam Search for Symbolic Music Generationcited by 0
- 2026Predicting States of Understanding in Explanatory Interactions Using Cognitive Load-Related Linguistic Cues20 Mar 2026
- 2026Stemphonic: All-at-once Flexible Multi-stem Music Generation10 Feb 2026
- 2025Explicit Tonal Tension Conditioning via Dual-Level Beam Search for Symbolic Music Generation24 Nov 2025
- 2025Perceptually Aligning Representations of Music via Noise-Augmented Autoencoders7 Nov 2025
- 2025Estimating Musical Surprisal from Audio in Autoregressive Diffusion Model Noise Spaces7 Aug 2025
- 2025Estimating Musical Surprisal in Audio13 Jan 2025
- 2024Surprise! Uniform Information Density Isn't the Whole Story: Predicting Surprisal Contours in Long-form Discourse21 Oct 2024