# TunesFormer: Forming Irish Tunes with Control Codes by Bar Patching

arXiv: https://arxiv.org/abs/2301.02884 · HTML: https://mlsanity.com/paper/2301.02884/

## Key facts

- Cited by 20 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 7 Jan 2023.

## Built on by (most cited first, 20 of 20)

- [Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence](https://mlsanity.com/paper/2404.05892/) (2024)
- [Foundation Models for Music: A Survey](https://mlsanity.com/paper/2408.14340/) (2024)
- [MuPT: A Generative Symbolic Music Pretrained Transformer](https://mlsanity.com/paper/2404.06393/) (2024)
- [NotaGen: Advancing Musicality in Symbolic Music Generation with Large Language Model Training Paradigms](https://mlsanity.com/paper/2502.18008/) (2025)
- [Beyond Language Models: Byte Models are Digital World Simulators](https://mlsanity.com/paper/2402.19155/) (2024)
- [SEAM: Semantically Equivalent Across Modalities Benchmark for Vision-Language Models](https://mlsanity.com/paper/2508.18179/) (2025)
- [ABC-Eval: Benchmarking Large Language Models on Symbolic Music Understanding and Instruction Following](https://mlsanity.com/paper/2509.23350/) (2025)
- [Sound Check: Auditing Audio Datasets](https://mlsanity.com/paper/2410.13114/) (2024)
- [Exploring Tokenization Methods for Multitrack Sheet Music Generation](https://mlsanity.com/paper/2410.17584/) (2024)
- [Via Score to Performance: Efficient Human-Controllable Long Song Generation with Bar-Level Symbolic Notation](https://mlsanity.com/paper/2508.01394/) (2025)
- [EMelodyGen: Emotion-Conditioned Melody Generation in ABC Notation with the Musical Feature Template](https://mlsanity.com/paper/2309.13259/) (2023)
- [The Renaissance of Expert Systems: Optical Recognition of Printed Chinese Jianpu Musical Scores with Lyrics](https://mlsanity.com/paper/2512.14758/) (2025)
- [BMdataset: A Musicologically Curated LilyPond Dataset](https://mlsanity.com/paper/2604.10628/) (2026)
- [DisciplineGen-1M: A Large-Scale Dataset for Multidisciplinary Visual Generation and Editing](https://mlsanity.com/paper/2607.02290/) (2026)
- [Anchored Cyclic Generation: A Novel Paradigm for Long-Sequence Symbolic Music Generation](https://mlsanity.com/paper/2604.05343/) (2026)
- [MeloBottleneck: Self-Supervised Melody Skeleton Extraction with a Latent Subsequence Bottleneck](https://mlsanity.com/paper/2607.10233/) (2026)
- [TUTTI: Toward generalizable audio-to-score transcription via fully synthesized data](https://mlsanity.com/paper/2609.00640/) (2026)
- [Which Constraints Are Missing? Ask the Verifier: Graded Rewards for Constraint-Following Music Generation](https://mlsanity.com/paper/2609.23665/) (2026)
- [Getting Motif-ated: Controllable AI Compositions from Injected Motif Prompts](https://mlsanity.com/paper/2609.32788/) (2026)
- [From One-Shot Generation to Incremental Music Composition: Adapting a General-Purpose Instruction LLM for Persistent Symbolic Editing](https://mlsanity.com/paper/2609.34994/) (2026)

## Abstract (arXiv)

This paper introduces TunesFormer, an efficient Transformer-based dual-decoder model specifically designed for the generation of melodies that adhere to user-defined musical forms. Trained on 214,122 Irish tunes, TunesFormer utilizes techniques including bar patching and control codes. Bar patching reduces sequence length and generation time, while control codes guide TunesFormer in producing melodies that conform to desired musical forms. Our evaluation demonstrates TunesFormer's superior efficiency, being 3.22 times faster than GPT-2 and 1.79 times faster than a model with linear complexity of equal scale while offering comparable performance in controllability and other metrics. TunesFormer provides a novel tool for musicians, composers, and music enthusiasts alike to explore the vast landscape of Irish music. Our model and code are available at https://github.com/sander-wood/tunesformer.