mlsanityData to 7 Oct 2026

Audio Retrieval with Natural Language Queries

arXiv 2105.02192 ↗First posted 5 May 2021cs.IR cs.SD eess.AScited by 49

Not on the map. Why?

Abstract (arXiv)

We consider the task of retrieving audio using free-form natural language queries. To study this problem, which has received limited attention in the existing literature, we introduce challenging new benchmarks for text-based audio retrieval using text annotations sourced from the Audiocaps and Clotho datasets. We then employ these benchmarks to establish baselines for cross-modal audio retrieval, where we demonstrate the benefits of pre-training on diverse audio tasks. We hope that our benchmarks will inspire further research into cross-modal text-based audio retrieval with free-form text queries.

Key facts. Cited by 49 papers in the map (data through 7 Oct 2026). First posted on arXiv 5 May 2021.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 15; 2023: 13; 2024: 11; 2025: 4; 2026: 4.

49 papers.

Sort:

By area:

  1. 2023ImageBind: One Embedding Space To Bind Them Allcited by 1,162
  2. 2022Socratic Models: Composing Zero-Shot Multimodal Reasoning with Languagecited by 513
  3. 2024Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilitiescited by 183
  4. 2023VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Datasetcited by 168
  5. 2023VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Datasetcited by 138
  6. 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilitiescited by 127
  7. 2022Learning Audio-Video Modalities from Image Captionscited by 80
  8. 2021Cross Modal Retrieval with Querybank Normalisationcited by 71
  9. 2022MAViL: Masked Audio-Video Learnerscited by 56
  10. 2024Gramian Multimodal Representation Learning and Alignmentcited by 52
  11. 2022Separate What You Describe: Language-Queried Audio Source Separationcited by 45
  12. 2023Separate Anything You Describecited by 43
37 more
  1. 2023CompA: Addressing the Gap in Compositional Reasoning in Audio-Language Modelscited by 43
  2. 2022Audio Retrieval with WavText5K and CLAP Trainingcited by 35
  3. 2023Exposing and Mitigating Spurious Correlations for Cross-Modal Retrievalcited by 35
  4. 2022Contrastive Audio-Language Learning for Musiccited by 32
  5. 2023ViT-Lens: Towards Omni-modal Representationscited by 29
  6. 2023Towards Video Anomaly Retrieval from Video Anomaly Detection: New Benchmarks and Modelcited by 25
  7. 2022Vision+X: A Survey on Multimodal Learning in the Light of Datacited by 22
  8. 2023Balance Act: Mitigating Hubness in Cross-Modal Retrieval with Query and Gallery Bankscited by 20
  9. 2022Integrating Language Guidance into Vision-based Deep Metric Learningcited by 19
  10. 2025Principled Multimodal Representation Learningcited by 19
  11. 2024T-CLAP: Temporal-Enhanced Contrastive Language-Audio Pretrainingcited by 18
  12. 2021Connecting the Dots between Audio and Text without Parallel Data through Visual Knowledge Transfercited by 17
  13. 2024Speech Retrieval-Augmented Generation without Automatic Speech Recognitioncited by 14
  14. 2024ReCLAP: Improving Zero Shot Audio Classification by Describing Soundscited by 12
  15. 2023Zero-shot audio captioning with audio-language model guidance and audio context keywordscited by 11
  16. 2022Audio-text Retrieval in Contextcited by 10
  17. 2024Revisiting Deep Audio-Text Retrieval Through the Lens of Transportationcited by 10
  18. 2024Audio Dialogues: Dialogues dataset for audio and music understandingcited by 7
  19. 2023MAQA: A Multimodal QA Benchmark for Negationcited by 4
  20. 2023MobileVidFactory: Automatic Diffusion-Based Social Media Video Generation for Mobile Devices from Textcited by 4
  21. 2023InvGC: Robust Cross-Modal Retrieval by Inverse Graph Convolutioncited by 4
  22. 2024Dissecting Temporal Understanding in Text-to-Audio Retrievalcited by 3
  23. 2024Enhancing Retrieval-Augmented Audio Captioning with Generation-Assisted Multimodal Querying and Progressive Learningcited by 3
  24. 2025SupCLAP: Controlling Optimization Trajectory Drift in Audio-Text Contrastive Learning with Support Vector Regularizationcited by 3
  25. 2022Automated Audio Captioning and Language-Based Audio Retrievalcited by 2
  26. 2022Improving Natural-Language-based Audio Retrieval with Transfer Learning and Audio & Text Augmentationscited by 2
  27. 2024Unified Video-Language Pre-training with Synchronized Audiocited by 2
  28. 2026Efficient and High-Fidelity Omni Modality Retrievalcited by 2
  29. 2022Introducing Auxiliary Text Query-modifier to Content-based Audio Retrievalcited by 1
  30. 2022Text-to-Audio Grounding Based Novel Metric for Evaluating Audio Caption Similaritycited by 1
  31. 2022Sonus Texere! Automated Dense Soundtrack Construction for Books using Movie Adaptationscited by 1
  32. 2024Enhancing Audio-Language Models through Self-Supervised Post-Training with Text-Audio Pairscited by 1
  33. 2025Can LLMs Deceive CLIP? Benchmarking Adversarial Compositionality of Pre-trained Multimodal Representation via Text Updatescited by 1
  34. 2022Automatic Audio Captioning using Attention weighted Event based Embeddingscited by 0
  35. 2026Shared Representation Learning for Reference-Guided Targeted Sound Detectioncited by 0
  36. 2026ATIR: Towards Audio-Text Interleaved Contextual Retrievalcited by 0
  37. 2026Hypergraph-Regularized Gramian Volumes for Multimodal Retrievalcited by 0