Towards Fine-grained Temporal Perception: Post-Training Large Audio-Language Models with Audio-Side Time Prompt
Not on the map. Why?
Abstract (arXiv)
Large Audio-Language Models (LALMs) enable general audio understanding and demonstrate remarkable performance across various audio tasks. However, these models still face challenges in temporal perception (e.g., inferring event onset and offset), leading to limited utility in fine-grained scenarios. To address this issue, we propose Audio-Side Time Prompt and leverage Reinforcement Learning (RL) to develop the TimePro-RL framework for fine-grained temporal perception. Specifically, we encode timestamps as embeddings and interleave them within the audio feature sequence as temporal coordinates to prompt the model. Furthermore, we introduce RL following Supervised Fine-Tuning (SFT) to directly optimize temporal alignment performance. Experiments demonstrate that TimePro-RL achieves significant performance gains across a range of audio temporal tasks, such as audio grounding, sound event detection, and dense audio captioning, validating its robust effectiveness.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 25 of its 32 references that are in the map. First posted on arXiv 15 Apr 2026.
Builds on
25 of 32 references.
References · 25
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2025Qwen2.5-Omni Technical Reportcited by 736
- 2023Qwen-Audio: Advancing Universal Audio Understanding via Unified Large-Scale Audio-Language Modelscited by 608
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 574
- 2024Qwen2-Audio Technical Reportcited by 560
- 2016Self-critical Sequence Training for Image Captioningcited by 547
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
- 2017A Deep Reinforced Model for Abstractive Summarizationcited by 365
- 2023AudioPaLM: A Large Language Model That Can Speak and Listencited by 343
- 2025VideoChat-R1: Enhancing Spatio-Temporal Perception via Reinforcement Fine-Tuningcited by 255
13 more
- 2025Kimi-Audio Technical Reportcited by 222
- 2023Pengi: An Audio Language Model for Audio Taskscited by 220
- 2023Listen, Think, and Understandcited by 209
- 2025Time-R1: Post-Training Large Vision Language Model for Temporal Video Groundingcited by 146
- 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilitiescited by 133
- 2024Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Modelscited by 91
- 2024Number it: Temporal Grounding Videos like Flipping Mangacited by 65
- 2021Sound Event Detection: A Tutorialcited by 51
- 2024AudioTime: A Temporally-aligned Audio-text Benchmark Datasetcited by 19
- 2021Text-to-Audio Grounding: Building Correspondence Between Captions and Sound Eventscited by 16
- 2025Listening Between the Frames: Bridging Temporal Gaps in Large Audio-Language Modelscited by 8
- 2025VideoTG-R1: Boosting Video Temporal Grounding via Curriculum Reinforcement Learning on Reflected Boundary Annotationscited by 7
- 2024Enhancing Temporal Understanding in Audio Question Answering for Large Audio Language Modelscited by 5
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026TEMPO: Temporally-grounded Multi-task Post-training for Large Audio-Language Models
- 2026Listen Then Reason: Perception-Grounded Test-Time Reinforcement Learning for Large Audio-Language Models
- 2025TACOS: Temporally-aligned Audio CaptiOnS for Language-Audio Pretraining
- 2026A Closer Look at Failure Modes in Temporal Understanding of Large Audio-Language Models
- 2025Reinforcement Learning Outperforms Supervised Fine-Tuning: A Case Study on Audio Question Answering
- 2026Improving Text-to-Audio Instruction Following via Fine-Grained Feedback from Audio-Aware Large Language Models
- 2026Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs
- 2026On Temporal Binding in Large Audio Language Models