# Structure-Aware Audio-to-Score Alignment using Progressively Dilated Convolutional Neural Networks

arXiv: https://arxiv.org/abs/2102.00382 · HTML: https://mlsanity.com/paper/2102.00382/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 10 of its 34 references that are in the map.
- First posted on arXiv 31 Jan 2021.

## Builds on (most cited first, 10 of 10)

- [Multi-Scale Context Aggregation by Dilated Convolutions](https://mlsanity.com/paper/1511.07122/) (2015)
- [Onsets and Frames: Dual-Objective Piano Transcription](https://mlsanity.com/paper/1710.11153/) (2017)
- [Going Deeper with Contextual CNN for Hyperspectral Image Classification](https://mlsanity.com/paper/1604.03519/) (2016)
- [Learning to Listen, Read, and Follow: Score Following as a Reinforcement Learning Game](https://mlsanity.com/paper/1807.06391/) (2018)
- [Learning Soft-Attention Models for Tempo-invariant Audio-Sheet Music Retrieval](https://mlsanity.com/paper/1906.10996/) (2019)
- [Learning Frame Similarity using Siamese networks for Audio-to-Score Alignment](https://mlsanity.com/paper/2011.07546/) (2020)
- [Real-Time Audio-to-Score Alignment of Music Performances Containing Errors and Arbitrary Repeats and Skips](https://mlsanity.com/paper/1512.07748/) (2015)
- [MIDI-Sheet Music Alignment Using Bootleg Score Synthesis](https://mlsanity.com/paper/2004.10345/) (2020)
- [Improved Handling of Repeats and Jumps in Audio-Sheet Image Synchronization](https://mlsanity.com/paper/2007.14580/) (2020)
- [A Hybrid Approach to Audio-to-Score Alignment](https://mlsanity.com/paper/2007.14333/) (2020)

## Built on by (most cited first, 5 of 5)

- [A Convolutional-Attentional Neural Framework for Structure-Aware Performance-Score Synchronization](https://mlsanity.com/paper/2204.08822/) (2022)
- [Multimodal Lyrics-Rhythm Matching](https://mlsanity.com/paper/2301.02732/) (2023)
- [Towards Context-Aware Neural Performance-Score Synchronisation](https://mlsanity.com/paper/2206.00454/) (2022)
- [MMSD-Net: Towards Multi-modal Stuttering Detection](https://mlsanity.com/paper/2407.11492/) (2024)
- [RUMAA: Repeat-Aware Unified Music Audio Analysis for Score-Performance Alignment, Transcription, and Mistake Detection](https://mlsanity.com/paper/2507.12175/) (2025)

## Abstract (arXiv)

The identification of structural differences between a music performance and the score is a challenging yet integral step of audio-to-score alignment, an important subtask of music information retrieval. We present a novel method to detect such differences between the score and performance for a given piece of music using progressively dilated convolutional neural networks. Our method incorporates varying dilation rates at different layers to capture both short-term and long-term context, and can be employed successfully in the presence of limited annotated data. We conduct experiments on audio recordings of real performances that differ structurally from the score, and our results demonstrate that our models outperform standard methods for structure-aware audio-to-score alignment.