# Drum-Aware Ensemble Architecture for Improved Joint Musical Beat and Downbeat Tracking

arXiv: https://arxiv.org/abs/2106.08685 · HTML: https://mlsanity.com/paper/2106.08685/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 8 of its 51 references that are in the map.
- First posted on arXiv 16 Jun 2021.

## Builds on (most cited first, 8 of 8)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Lookahead Optimizer: k steps forward, 1 step back](https://mlsanity.com/paper/1907.08610/) (2019)
- [madmom: a new Python Audio and Music Signal Processing Library](https://mlsanity.com/paper/1605.07008/) (2016)
- [Mixing-Specific Data Augmentation Techniques for Improved Blind Violin/Piano Source Separation](https://mlsanity.com/paper/2008.02480/) (2020)
- [Robust Downbeat Tracking Using an Ensemble of Convolutional Networks](https://mlsanity.com/paper/1605.08396/) (2016)
- [Dilated Convolution with Dilated GRU for Music Source Separation](https://mlsanity.com/paper/1906.01203/) (2019)
- [Downbeat Tracking with Tempo-Invariant Convolutional Neural Networks](https://mlsanity.com/paper/2102.02282/) (2021)
- [Deep Learning-Based Automatic Downbeat Tracking: A Brief Review](https://mlsanity.com/paper/1906.03870/) (2019)

## Built on by (most cited first, 2 of 2)

- [BERT-like Pre-training for Symbolic Piano Music Classification Tasks](https://mlsanity.com/paper/2107.05223/) (2021)
- [JukeDrummer: Conditional Beat-aware Audio-domain Drum Accompaniment Generation via Transformer VQ-VAE](https://mlsanity.com/paper/2210.06007/) (2022)

## Abstract (arXiv)

This paper presents a novel system architecture that integrates blind source separation with joint beat and downbeat tracking in musical audio signals. The source separation module segregates the percussive and non-percussive components of the input signal, over which beat and downbeat tracking are performed separately and then the results are aggregated with a learnable fusion mechanism. This way, the system can adaptively determine how much the tracking result for an input signal should depend on the input's percussive or non-percussive components. Evaluation on four testing sets that feature different levels of presence of drum sounds shows that the new architecture consistently outperforms the widely-adopted baseline architecture that does not employ source separation.