mlsanityData to 14 Oct 2026

Geo-ATBench: A Benchmark for Geospatial Audio Tagging with Geospatial Semantic Context

arXiv 2603.10623 ↗First posted 11 Mar 2026eess.AS cs.LG cs.SDcited by 0

Not on the map. Why?

Abstract (arXiv)

Environmental sound understanding in computational auditory scene analysis (CASA) is often formulated as an audio-only recognition problem. This formulation leaves a persistent drawback in multi-label audio tagging (AT): acoustic similarity can make certain events difficult to separate from waveforms alone. In such cases, disambiguating cues often lie outside the waveform. Geospatial semantic context (GSC), derived from geographic information system data, e.g., points of interest (POI), provides location-tied environmental priors that can help reduce this ambiguity. A systematic study of this direction is enabled through the proposed geospatial audio tagging (Geo-AT) task, which conditions multi-label sound event tagging on GSC alongside audio. To benchmark Geo-AT, Geo-ATBench is introduced as a polyphonic audio benchmark with geographical annotations, containing 10.71 hours of audio across 28 event categories; each clip is paired with a GSC representation from 11 semantic context categories. GeoFusion-AT is proposed as a unified geo-audio fusion framework that evaluates feature-, representation-, and decision-level fusion on representative audio backbones, with audio- and GSC-only baselines. Results show that incorporating GSC improves AT performance, especially on acoustically confounded labels, indicating geospatial semantics provide effective priors beyond audio alone. A crowdsourced listening study with 10 participants on 579 samples shows that there is no significant difference in performance between models on Geo-ATBench labels and aggregated human labels, supporting Geo-ATBench as a human-aligned benchmark. The Geo-AT task, benchmark Geo-ATBench, and reproducible geo-audio fusion framework GeoFusion-AT provide a foundation for studying AT with geospatial semantic context within the CASA community. Dataset, code, models are on homepage (https://github.com/WuYanru2002/Geo-ATBench).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 44 references that are in the map. First posted on arXiv 11 Mar 2026.

Builds on

17 of 44 references.

References · 17

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,795
  3. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  4. 2020VGGSound: A Large-scale Audio-Visual Datasetcited by 648
  5. 2021AST: Audio Spectrogram Transformercited by 643
  6. 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 574
  7. 2021VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Textcited by 429
  8. 2020FSD50K: An Open Dataset of Human-Labeled Sound Eventscited by 342
  9. 2023Multimodal Deep Learningcited by 258
  10. 2022HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detectioncited by 176
  11. 2017Visual to Sound: Generating Natural Sound for Videos in the Wildcited by 98
  12. 2019Deep Learning for Audio Signal Processingcited by 92
5 more
  1. 2016Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classificationcited by 85
  2. 2021Sound Event Detection: A Tutorialcited by 51
  3. 2016Audio Event Detection using Weakly Labeled Datacited by 12
  4. 2020SONYC-UST-V2: An Urban Sound Tagging Dataset with Spatiotemporal Contextcited by 12
  5. 2024Fusing Audio and Metadata Embeddings Improves Language-based Audio Retrievalcited by 2

Built on by

Not cited yet.