Turning music identification into a neural forward pass
Not on the map. Why?
Abstract (arXiv)
Search, a foundational operation in computer science, maps a query to a matching item in a collection. It is typically implemented as a System-2 like, rule-based pipeline in which a key is computed, an index is probed, and candidates are verified. By contrast, human recognition resembles a System-1 like, associative model of identity recovery, in which even partial cues can trigger a recall without explicitly enumerating, ranking, or even accessing discrete candidates. Here, we show that music sound identification, a difficult search problem, can be performed in a single neural feed-forward pass by a generative transformer. Trained on an audio dataset, the model predicts the corresponding track identifier from a short audio excerpt. This approach surpasses state-of-the-art acoustic fingerprinting, with the largest gains for short audio segments (1 second), demonstrating the method is not only viable but advantageous. Moreover, it reduces external storage to 0.33% of the baseline footprint and improves inference latency by 2.3x (p95). Furthermore, the model can reject queries for unseen tracks, supporting open-set operation while reducing misattribution risk. Using music track identification as an example, this work reframes search, bringing it closer in spirit to human associative recognition and away from algorithmic database lookup.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 25 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
17 of 25 references.
References · 17
- 2017Attention Is All You Needcited by 60,361
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,824
- 2017Billion-scale similarity search with GPUscited by 2,497
- 2016Learning without Forgettingcited by 2,496
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
- 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
- 2020Autoregressive Entity Retrievalcited by 334
- 2022Transformer Memory as a Differentiable Search Indexcited by 247
- 2016FMA: A Dataset For Music Analysiscited by 207
- 2017The Case for Learned Index Structurescited by 188
- 2022A Neural Corpus Indexer for Document Retrievalcited by 111
5 more
- 2020Neural Audio Fingerprint for High-specific Audio Retrieval based on Contrastive Learningcited by 16
- 2022Attention-Based Audio Embeddings for Query-by-Examplecited by 8
- 2024GraFPrint: A GNN-Based Approach for Audio Identificationcited by 7
- 2025Contrastive and Transfer Learning for Effective Audio Fingerprinting through a Real-World Evaluation Protocolcited by 1
- 2026Segment Length Matters: A Study of Segment Lengths on Audio Fingerprinting Performancecited by 1
Built on by
Not cited yet.