# Towards Score Following in Sheet Music Images

arXiv: https://arxiv.org/abs/1612.05050 · HTML: https://mlsanity.com/paper/1612.05050/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 15 Dec 2016.

## Built on by (most cited first, 2 of 2)

- [Multi-modal Conditional Bounding Box Regression for Music Score Following](https://mlsanity.com/paper/2105.04309/) (2021)
- [Proceedings of the 2nd International Workshop on Reading Music Systems](https://mlsanity.com/paper/2212.00380/) (2022)

## Abstract (arXiv)

This paper addresses the matching of short music audio snippets to the corresponding pixel location in images of sheet music. A system is presented that simultaneously learns to read notes, listens to music and matches the currently played music to its corresponding notes in the sheet. It consists of an end-to-end multi-modal convolutional neural network that takes as input images of sheet music and spectrograms of the respective audio snippets. It learns to predict, for a given unseen audio snippet (covering approximately one bar of music), the corresponding position in the respective score line. Our results suggest that with the use of (deep) neural networks -- which have proven to be powerful image processing models -- working with sheet music becomes feasible and a promising future research direction.