mlsanityData to 14 Oct 2026

Robust Neural Audio Fingerprinting using Music Foundation Models

arXiv 2511.05399 ↗First posted 7 Nov 2025cs.SD cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The proliferation of distorted, compressed, and manipulated music on modern media platforms like TikTok motivates the development of more robust audio fingerprinting techniques to identify the sources of musical recordings. In this paper, we develop and evaluate new neural audio fingerprinting techniques with the aim of improving their robustness. We make two contributions to neural fingerprinting methodology: (1) we use a pretrained music foundation model as the backbone of the neural architecture and (2) we expand the use of data augmentation to train fingerprinting models under a wide variety of audio manipulations, including time streching, pitch modulation, compression, and filtering. We systematically evaluate our methods in comparison to two state-of-the-art neural fingerprinting models: NAFP and GraFPrint. Results show that fingerprints extracted with music foundation models (e.g., MuQ, MERT) consistently outperform models trained from scratch or pretrained on non-musical audio. Segment-level evaluation further reveals their capability to accurately localize fingerprint matches, an important practical feature for catalog management.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 15 of its 24 references that are in the map. First posted on arXiv 7 Nov 2025.

Builds on

15 of 24 references.

References · 15

  1. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  2. 2017Billion-scale similarity search with GPUscited by 2,497
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  4. 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,070
  5. 2022High Fidelity Neural Audio Compressioncited by 687
  6. 2015MUSAN: A Music, Speech, and Noise Corpuscited by 425
  7. 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 388
  8. 2016FMA: A Dataset For Music Analysiscited by 207
  9. 2023MERT: Acoustic Music Understanding Model with Large-Scale Self-supervised Trainingcited by 181
  10. 2025MuQ: Self-Supervised Music Representation Learning with Mel Residual Vector Quantizationcited by 68
  11. 2020Neural Audio Fingerprint for High-specific Audio Retrieval based on Contrastive Learningcited by 16
  12. 2023DISCO-10M: A Large-Scale Music Datasetcited by 13
3 more
  1. 2022A Large-scale Comprehensive Dataset and Copy-overlap Aware Evaluation Protocol for Segment-level Video Copy Detectioncited by 10
  2. 2024GraFPrint: A GNN-Based Approach for Audio Identificationcited by 7
  3. 2025Enhancing Neural Audio Fingerprint Robustness to Audio Degradation for Music Identificationcited by 4

Built on by

Not cited yet.