mlsanityData to 7 Oct 2026

Text-to-Audio Grounding: Building Correspondence Between Captions and Sound Events

arXiv 2102.11474 ↗First posted 23 Feb 2021cs.SD eess.AScited by 16

Not on the map. Why?

Abstract (arXiv)

Automated Audio Captioning is a cross-modal task, generating natural language descriptions to summarize the audio clips' sound events. However, grounding the actual sound events in the given audio based on its corresponding caption has not been investigated. This paper contributes an AudioGrounding dataset, which provides the correspondence between sound events and the captions provided in Audiocaps, along with the location (timestamps) of each present sound event. Based on such, we propose the text-to-audio grounding (TAG) task, which interactively considers the relationship between audio processing and language understanding. A baseline approach is provided, resulting in an event-F1 score of 28.3% and a Polyphonic Sound Detection Score (PSDS) score of 14.7%.

Key facts. Cited by 16 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Feb 2021.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 2; 2024: 4; 2025: 1; 2026: 6.

16 papers.

Sort:

By area:

  1. 2024AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehensioncited by 215
  2. 2023Large Language Models are Few-Shot Health Learnerscited by 115
  3. 2023DiffSED: Sound Event Detection with Denoising Diffusioncited by 4
  4. 2024Dissecting Temporal Understanding in Text-to-Audio Retrievalcited by 3
  5. 2022Automated Audio Captioning and Language-Based Audio Retrievalcited by 2
  6. 2024Smooth-Foley: Creating Continuous Sound for Video-to-Audio Generation Under Semantic Guidancecited by 2
  7. 2026MusTBench: Benchmarking and Advancing Temporal Grounding in Music LLMscited by 2
  8. 2022Text-to-Audio Grounding Based Novel Metric for Evaluating Audio Caption Similaritycited by 1
  9. 2026Towards Fine-grained Temporal Perception: Post-Training Large Audio-Language Models with Audio-Side Time Promptcited by 1
  10. 2022Language-Based Audio Retrieval with Converging Tied Layers and Contrastive Losscited by 0
  11. 2024MINT: a Multi-modal Image and Narrative Text Dubbing Dataset for Foley Audio Content Planning and Generationcited by 0
  12. 2025Think Smart, Not Hard: Difficulty Adaptive Reasoning for Large Audio Language Modelscited by 0
4 more
  1. 2026Auto-AEG: Scalable Data Construction for Open-Vocabulary Audio Event Groundingcited by 0
  2. 2026GigaChat Audio: Time-aware Large Audio Language Modelcited by 0
  3. 2026What Did the MLLM Hear? Token-Level Spectro-Temporal Grounding for Audio MLLM Explainabilitycited by 0
  4. 2026Augmenting Large Audio-Language Models with Frame-Level Grounding for Fine-Grained Temporal Perceptioncited by 0