mlsanityData to 7 Oct 2026

MusIAC: An extensible generative framework for Music Infilling Applications with multi-level Control

arXiv 2202.05528 ↗First posted 11 Feb 2022cs.AI cs.MMcited by 17

Not on the map. Why?

Abstract (arXiv)

We present a novel music generation framework for music infilling, with a user friendly interface. Infilling refers to the task of generating musical sections given the surrounding multi-track music. The proposed transformer-based framework is extensible for new control tokens as the added music control tokens such as tonal tension per bar and track polyphony level in this work. We explore the effects of including several musically meaningful control tokens, and evaluate the results using objective metrics related to pitch and rhythm. Our results demonstrate that adding additional control tokens helps to generate music with stronger stylistic similarities to the original music. It also provides the user with more control to change properties like the music texture and tonal tension in each bar compared to previous research which only provided control for track density. We present the model in a Google Colab notebook to enable interactive generation.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 23 of its 37 references that are in the map. First posted on arXiv 11 Feb 2022.

Builds on

23 of 37 references.

References · 23

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  4. 2019MASS: Masked Sequence to Sequence Pre-training for Language Generationcited by 345
  5. 2018Music Transformercited by 207
  6. 2021Compound Word Transformer: Learning to Compose Full-Song Music over Dynamic Directed Hypergraphscited by 109
  7. 2021MusicBERT: Symbolic Music Understanding with Large-Scale Pre-Trainingcited by 89
  8. 2020PopMAG: Pop Music Accompaniment Generationcited by 68
  9. 2018This Time with Feeling: Learning Expressive Musical Performancecited by 67
  10. 2020A Comprehensive Survey on Deep Music Generation: Multi-level Representations, Algorithms, Evaluations, and Future Directionscited by 56
  11. 2020MMM : Exploring Conditional Multi-Track Music Generation with the Transformercited by 48
  12. 2020Music FaderNets: Controllable Music Generation Based On High-Level Features via Low-Level Feature Modellingcited by 45
11 more
  1. 2019Counterpoint by Convolutioncited by 42
  2. 2018Symbolic Music Genre Transfer with CycleGANcited by 28
  3. 2019Learning to Traverse Latent Spaces for Musical Score Inpaintingcited by 24
  4. 2021The Piano Inpainting Applicationcited by 23
  5. 2018MorpheuS: generating structured music with constrained patterns and tensioncited by 22
  6. 2021Hierarchical Recurrent Neural Networks for Conditional Melody Generation with Long-term Structurecited by 12
  7. 2019NONOTO: A Model-agnostic Web Interface for Interactive Music Composition by Inpaintingcited by 10
  8. 2020A variational autoencoder for music generation controlled by tonal tensioncited by 8
  9. 2021Is Disentanglement enough? On Latent Representations for Controllable Music Generationcited by 7
  10. 2019Midi Miner -- A Python library for tonal tension and track classificationcited by 6
  11. 2021A Contextual Latent Space Model: Subsequence Modulation in Melodic Sequencecited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 4; 2024: 5; 2025: 4; 2026: 1.

17 papers.

Sort:

By area:

  1. 2023Polyffusion: A Diffusion Model for Polyphonic Score Generation with Internal and External Controlscited by 35
  2. 2022A Review of Intelligent Music Generation Systemscited by 11
  3. 2024Natural Language Processing Methods for Symbolic Music Generation and Information Retrieval: a Surveycited by 10
  4. 2023Composer's Assistant: An Interactive Transformer for Multi-Track MIDI Infillingcited by 9
  5. 2022Jointist: Joint Learning for Multi-instrument Transcription and Its Applicationscited by 6
  6. 2024Composer's Assistant 2: Interactive Multi-Track MIDI Infilling with Fine-Grained User Controlcited by 5
  7. 2025Moonbeam: A MIDI Foundation Model Using Both Absolute and Relative Music Attributescited by 4
  8. 2022A Survey on Artificial Intelligence for Music Generation: Agents, Domains and Perspectivescited by 3
  9. 2023Jointist: Simultaneous Improvement of Multi-instrument Transcription and Music Source Separation via Joint Trainingcited by 3
  10. 2025Mamba-Diffusion Model with Learnable Wavelet for Controllable Symbolic Music Generationcited by 3
  11. 2023From Words to Music: A Study of Subword Tokenization Techniques in Symbolic Music Generationcited by 2
  12. 2024BandCondiNet: Parallel Transformers-based Conditional Popular Music Generation with Multi-View Featurescited by 2
5 more
  1. 2024WaveTransfer: A Flexible End-to-end Multi-instrument Timbre Transfer with Diffusioncited by 2
  2. 2025Adaptable Symbolic Music Infilling with MIDI-RWKVcited by 1
  3. 2026BeatEdit: Symbolic Music Generation as Explicit Editingcited by 1
  4. 2024Notochord: a Flexible Probabilistic Model for Real-Time MIDI Performancecited by 0
  5. 2025Explicit Tonal Tension Conditioning via Dual-Level Beam Search for Symbolic Music Generationcited by 0