# MIRFLEX: Music Information Retrieval Feature Library for Extraction

arXiv: https://arxiv.org/abs/2411.00469 · HTML: https://mlsanity.com/paper/2411.00469/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 12 of its 21 references that are in the map.
- First posted on arXiv 1 Nov 2024.

## Builds on (most cited first, 12 of 12)

- [A Bi-directional Transformer for Musical Chord Recognition](https://mlsanity.com/paper/1907.02698/) (2019)
- [An Attention Mechanism for Musical Instrument Recognition](https://mlsanity.com/paper/1907.04294/) (2019)
- [Leveraging Hierarchical Structures for Few-Shot Musical Instrument Recognition](https://mlsanity.com/paper/2107.07029/) (2021)
- [BeatNet: CRNN and Particle Filtering for Online Joint Beat Downbeat and Meter Tracking](https://mlsanity.com/paper/2108.03576/) (2021)
- [TensorFlow Audio Models in Essentia](https://mlsanity.com/paper/2003.07393/) (2020)
- [A Fully Convolutional Deep Auditory Model for Musical Chord Recognition](https://mlsanity.com/paper/1612.05082/) (2016)
- [Emotion and Theme Recognition in Music with Frequency-Aware RF-Regularized CNNs](https://mlsanity.com/paper/1911.05833/) (2019)
- [Musical Tempo and Key Estimation using Convolutional Neural Networks with Directional Filters](https://mlsanity.com/paper/1903.10839/) (2019)
- [Semi-supervised music emotion recognition using noisy student training and harmonic pitch class profiles](https://mlsanity.com/paper/2112.00702/) (2021)
- [Music Instrument Classification Reprogrammed](https://mlsanity.com/paper/2211.08379/) (2022)
- [Predominant Musical Instrument Classification based on Spectral Features](https://mlsanity.com/paper/1912.02606/) (2019)
- [A Novel 1D State Space for Efficient Music Rhythmic Analysis](https://mlsanity.com/paper/2111.00704/) (2021)

## Built on by (most cited first, 2 of 2)

- [KARMA-MV: A Benchmark for Causal Question Answering on Music Videos](https://mlsanity.com/paper/2605.08175/) (2026)
- [SonicVerse: Multi-Task Learning for Music Feature-Informed Captioning](https://mlsanity.com/paper/2506.15154/) (2025)

## Abstract (arXiv)

This paper introduces an extendable modular system that compiles a range of music feature extraction models to aid music information retrieval research. The features include musical elements like key, downbeats, and genre, as well as audio characteristics like instrument recognition, vocals/instrumental classification, and vocals gender detection. The integrated models are state-of-the-art or latest open-source. The features can be extracted as latent or post-processed labels, enabling integration into music applications such as generative music, recommendation, and playlist generation. The modular design allows easy integration of newly developed systems, making it a good benchmarking and comparison tool. This versatile toolkit supports the research community in developing innovative solutions by providing concrete musical features.