mlsanityData to 7 Oct 2026

Toward Universal Text-to-Music Retrieval

arXiv 2211.14558 ↗First posted 26 Nov 2022cs.IR cs.MM cs.SDcited by 18

Not on the map. Why?

Abstract (arXiv)

This paper introduces effective design choices for text-to-music retrieval systems. An ideal text-based retrieval system would support various input queries such as pre-defined tags, unseen tags, and sentence-level descriptions. In reality, most previous works mainly focused on a single query type (tag or sentence) which may not generalize to another input type. Hence, we review recent text-based music retrieval systems using our proposed benchmark in two main aspects: input text representation and training objectives. Our findings enable a universal text-to-music retrieval system that achieves comparable retrieval performances in both tag- and sentence-level inputs. Furthermore, the proposed multimodal representation generalizes to 9 different downstream music classification tasks. We present the code and demo online.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Nov 2022.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 7; 2024: 5; 2025: 4; 2026: 2.

18 papers.

Sort:

By area:

  1. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 343
  2. 2023The Song Describer Dataset: a Corpus of Audio Captions for Music-and-Language Evaluationcited by 68
  3. 2023MusiLingo: Bridging Music and Text with Pre-trained Language Models for Music Captioning and Query Responsecited by 45
  4. 2023MuseChat: A Conversational Music Recommendation System for Videoscited by 21
  5. 2023A Unified Framework for Multimodal, Multi-Part Human Motion Synthesiscited by 12
  6. 2024CLaMP 2: Multimodal Music Information Retrieval Across 101 Languages Using Large Language Modelscited by 12
  7. 2024Futga: Towards Fine-grained Music Understanding through Temporally-enhanced Generative Augmentationcited by 5
  8. 2024I can listen but cannot read: An evaluation of two-tower multimodal systems for instrument recognitioncited by 4
  9. 2025AGAV-Rater: Adapting Large Multimodal Model for AI-Generated Audio-Visual Quality Assessmentcited by 4
  10. 2023WikiMuTe: A web-sourced dataset of semantic descriptions for music audiocited by 3
  11. 2024Augment, Drop & Swap: Improving Diversity in LLM Captions for Efficient Music-Text Representation Learningcited by 3
  12. 2024PIAST: A Multimodal Piano Dataset with Audio, Symbolic and Textcited by 2
6 more
  1. 2025MCA: Modality Composition Awareness for Robust Composed Multimodal Retrievalcited by 2
  2. 2023MDSC: Towards Evaluating the Style Consistency Between Music and Dancecited by 1
  3. 2025MMVA: Multimodal Matching Based on Valence and Arousal across Images, Music, and Musical Captionscited by 0
  4. 2025MUST-RAG: MUSical Text Question Answering with Retrieval Augmented Generationcited by 0
  5. 2026Towards Effective Negation Modeling in Joint Audio-Text Models for Musiccited by 0
  6. 2026Beyond Musical Descriptors: Extracting Preference-Bearing Intent in Music Queriescited by 0