# Multi-modal Conditional Bounding Box Regression for Music Score Following

arXiv: https://arxiv.org/abs/2105.04309 · HTML: https://mlsanity.com/paper/2105.04309/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 17 of its 34 references that are in the map.
- First posted on arXiv 10 May 2021.

## Builds on (most cited first, 17 of 17)

- [Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks](https://mlsanity.com/paper/1506.01497/) (2015)
- [Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift](https://mlsanity.com/paper/1502.03167/) (2015)
- [Layer Normalization](https://mlsanity.com/paper/1607.06450/) (2016)
- [SGDR: Stochastic Gradient Descent with Warm Restarts](https://mlsanity.com/paper/1608.03983/) (2016)
- [You Only Look Once: Unified, Real-Time Object Detection](https://mlsanity.com/paper/1506.02640/) (2015)
- [FiLM: Visual Reasoning with a General Conditioning Layer](https://mlsanity.com/paper/1709.07871/) (2017)
- [YOLO9000: Better, Faster, Stronger](https://mlsanity.com/paper/1612.08242/) (2016)
- [Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)](https://mlsanity.com/paper/1511.07289/) (2015)
- [Exact solutions to the nonlinear dynamics of learning in deep linear neural networks](https://mlsanity.com/paper/1312.6120/) (2013)
- [Bag of Tricks for Image Classification with Convolutional Neural Networks](https://mlsanity.com/paper/1812.01187/) (2018)
- [Segmentation from Natural Language Expressions](https://mlsanity.com/paper/1603.06180/) (2016)
- [TResNet: High Performance GPU-Dedicated Architecture](https://mlsanity.com/paper/2003.13630/) (2020)
- [Learning to Listen, Read, and Follow: Score Following as a Reinforcement Learning Game](https://mlsanity.com/paper/1807.06391/) (2018)
- [Learning Frame Similarity using Siamese networks for Audio-to-Score Alignment](https://mlsanity.com/paper/2011.07546/) (2020)
- [Learning to Read and Follow Music in Complete Score Sheet Images](https://mlsanity.com/paper/2007.10736/) (2020)
- [Audio-Conditioned U-Net for Position Estimation in Full Sheet Images](https://mlsanity.com/paper/1910.07254/) (2019)
- [Towards Score Following in Sheet Music Images](https://mlsanity.com/paper/1612.05050/) (2016)

## Built on by (most cited first, 1 of 1)

- [Fully Automatic Page Turning on Real Scores](https://mlsanity.com/paper/2111.06643/) (2021)

## Abstract (arXiv)

This paper addresses the problem of sheet-image-based on-line audio-to-score alignment also known as score following. Drawing inspiration from object detection, a conditional neural network architecture is proposed that directly predicts x,y coordinates of the matching positions in a complete score sheet image at each point in time for a given musical performance. Experiments are conducted on a synthetic polyphonic piano benchmark dataset and the new method is compared to several existing approaches from the literature for sheet-image-based score following as well as an Optical Music Recognition baseline. The proposed approach achieves new state-of-the-art results and furthermore significantly improves the alignment performance on a set of real-world piano recordings by applying Impulse Responses as a data augmentation technique.