GigaChat Audio: Time-aware Large Audio Language Model
Not on the map. Why?
Abstract (arXiv)
Temporal grounding in long recordings remains challenging for audio-conditioned LLMs. We present a time-aware audio LLM that answers questions with explicit timestamps over up to 120 minutes of input. Our approach interleaves periodic time markers with continuous audio tokens using large-scale synthetic supervision from a cascaded pipeline. Our model achieves strong temporal-grounding accuracy on short and long benchmarks and supports time-anchored fragment descriptions and summaries. Extensive ablations examine how time representation, marker frequency, tokenization, and duration-mixture design affect accuracy and computational cost. We release model weights and datasets to support further research on time-aware audio understanding, available at https://huggingface.co/ai-sage/GigaChat3.1-Audio-10B-A1.8B.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 35 references that are in the map. First posted on arXiv 11 Jul 2026.
Builds on
27 of 35 references.
References · 27
- 2024GPT-4o System Cardcited by 4,467
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
- 2024Qwen2-Audio Technical Reportcited by 543
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
- 2025Qwen3-Omni Technical Reportcited by 451
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
15 more
- 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
- 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 118
- 2018Localizing Moments in Video with Temporal Languagecited by 83
- 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 69
- 2024YODAS: Youtube-Oriented Dataset for Audio and Speechcited by 56
- 2025LongCat-Flash Technical Reportcited by 54
- 2025Voxtralcited by 41
- 2021Text-to-Audio Grounding: Building Correspondence Between Captions and Sound Eventscited by 16
- 2026VIBEVOICE-ASR Technical Reportcited by 14
- 2024A Comparative Study of Quality Evaluation Methods for Text Summarizationcited by 13
- 2025Listening Between the Frames: Bridging Temporal Gaps in Large Audio-Language Modelscited by 8
- 2024Language-based Audio Moment Retrievalcited by 4
- 2026MOSS Transcribe Diarize Technical Reportcited by 4
- 2025GigaAM: Efficient Self-Supervised Learner for Speech Recognitioncited by 3
- 2025CASTELLA: Long Audio Dataset with Captions and Temporal Boundariescited by 3
Built on by
Not cited yet.