mlsanityData to 7 Oct 2026

CORA: A Protocol for Diagnosing Boundary Robustness in Text-to-Audio Retrieval under Query Reformulations

arXiv 2609.33433 ↗First posted 27 Sep 2026cs.SD cs.CL eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

Text-to-Audio (T2A) retrievers are typically evaluated with caption style queries, but the same user intent can be expressed in many forms. We introduce CORA (Caption-Offset Retrieval for Audio), a caption anchored diagnostic protocol that rewrites each source caption into five intent preserving forms (Command, Question, Indirect, Key phrase, and Statement) while fixing the target audio. By tracking the same target across query forms, CORA defines RankDrop, a metric revealing failures hidden by Recall@k. Using Pearson's correlation coefficient r, we find that RankDrop is weakly associated with raw text space movement (r=0.084), but strongly associated with Target Alignment Loss and Target Boundary Margin Degradation (r=0.508 and r=0.615). The same pattern appears in OEA retrievers, where RankDrop is better explained by boundary degradation (r=0.472/0.478) than by query movement (r=0.084/0.046). Overall, these results suggest that robust T2A retrieval requires preserving the target's boundary advantage over competing audio under reformulation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 18 references that are in the map. First posted on arXiv 27 Sep 2026.

Builds on

13 of 18 references.

References · 13

  1. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 707
  2. 2020Contrastive Learning with Hard Negative Samplescited by 619
  3. 2019Clotho: An Audio Captioning Datasetcited by 354
  4. 2023WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Researchcited by 266
  5. 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 100
  6. 2021Evaluating the Robustness of Retrieval Pipelines with Query Variation Generatorscited by 33
  7. 2025Judge's Verdict: A Comprehensive Analysis of LLM Judge Capability Through Human Agreementcited by 24
  8. 2024T-CLAP: Temporal-Enhanced Contrastive Language-Audio Pretrainingcited by 18
  9. 2024Advancing Multi-grained Alignment for Contrastive Language-Audio Pre-trainingcited by 14
  10. 2023Hard-Negative Sampling for Contrastive Learning: Optimal Representation Geometry and Neural- vs Dimensional-Collapsecited by 6
  11. 2024Do Audio-Language Models Understand Linguistic Variations?cited by 4
  12. 2024The language of sound search: Examining User Queries in Audio Search Enginescited by 3
1 more
  1. 2026Omni-Embed-Audio: Leveraging Multimodal LLMs for Robust Audio-Text Retrievalcited by 3

Built on by

Not cited yet.