Augmenting Large Audio-Language Models with Frame-Level Grounding for Fine-Grained Temporal Perception
Not on the map. Why?
Abstract (arXiv)
Large Audio-Language Models (LALMs) have substantially advanced general audio understanding, yet they remain limited in fine-grained temporal perception, particularly in precise event localization. Existing approaches primarily post-train LALMs to predict event boundaries as timestamp tokens. However, this generative formulation lacks explicit correspondence between the timestamp predictions and fine-grained acoustic evidence, limiting the precision and reliability of temporal localization. To address this issue, we augment the LALM with a dedicated frame-level grounding model while leveraging its semantic modeling capability to represent the event query. Specifically, the frozen LALM encodes the event query with audio as context, and the grounding model combines these query representations with fine-grained audio features to localize the target event at the frame level. Extensive experiments across diverse temporal grounding benchmarks demonstrate strong and consistent improvements over existing methods. Further evaluation shows that the grounding model can provide temporal evidence to support downstream reasoning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 28 references that are in the map. First posted on arXiv 14 Sep 2026.
Builds on
26 of 28 references.
References · 26
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
- 2025Qwen3-Omni Technical Reportcited by 497
- 2022BEATs: Audio Pre-Training with Acoustic Tokenizerscited by 388
- 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Modelscited by 219
- 2023Listen, Think, and Understandcited by 209
- 2024Audio Flamingo: A Novel Audio Language Model with Few-Shot Learning and Dialogue Abilitiescited by 186
- 2024EAT: Self-Supervised Pre-Training with Efficient Audio Transformercited by 53
- 2021Sound Event Detection: A Tutorialcited by 51
- 2017Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detectioncited by 46
- 2023Dense-Localizing Audio-Visual Events in Untrimmed Videos: A Large-Scale Benchmark and Baselinecited by 46
- 2023Self-supervised Audio Teacher-Student Transformer for Both Clip-level and Frame-level Taskscited by 25
14 more
- 2021Text-to-Audio Grounding: Building Correspondence Between Captions and Sound Eventscited by 16
- 2023Fine-tune the pretrained ATST model for sound event detectioncited by 14
- 2024Advancing Multi-grained Alignment for Contrastive Language-Audio Pre-trainingcited by 14
- 2026Audio-Omni: Extending Multi-modal Understanding to Versatile Audio Generation and Editingcited by 12
- 2026MOSS-Audio Technical Reportcited by 11
- 2025TACOS: Temporally-aligned Audio CaptiOnS for Language-Audio Pretrainingcited by 9
- 2025Detect Any Sound: Open-Vocabulary Sound Event Detection with Multi-Modal Queriescited by 9
- 2025Listening Between the Frames: Bridging Temporal Gaps in Large Audio-Language Modelscited by 8
- 2025Multi-Domain Audio Question Answering Benchmark Toward Acoustic Content Reasoningcited by 5
- 2026SpotSound: Enhancing Large Audio-Language Models with Fine-Grained Temporal Groundingcited by 5
- 2024Language-based Audio Moment Retrievalcited by 4
- 2026FineLAP: Taming Heterogeneous Supervision for Fine-grained Language-Audio Pretrainingcited by 3
- 2026Encode Once, Decode Never: Reusing Audio LM Internals for Efficient Temporal Localizationcited by 2
- 2026Towards Fine-grained Temporal Perception: Post-Training Large Audio-Language Models with Audio-Side Time Promptcited by 1
Built on by
Not cited yet.