mlsanityData to 7 Oct 2026

GigaChat Audio: Time-aware Large Audio Language Model

arXiv 2607.10387 ↗First posted 11 Jul 2026eess.AS cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Temporal grounding in long recordings remains challenging for audio-conditioned LLMs. We present a time-aware audio LLM that answers questions with explicit timestamps over up to 120 minutes of input. Our approach interleaves periodic time markers with continuous audio tokens using large-scale synthetic supervision from a cascaded pipeline. Our model achieves strong temporal-grounding accuracy on short and long benchmarks and supports time-anchored fragment descriptions and summaries. Extensive ablations examine how time representation, marker frequency, tokenization, and duration-mixture design affect accuracy and computational cost. We release model weights and datasets to support further research on time-aware audio understanding, available at https://huggingface.co/ai-sage/GigaChat3.1-Audio-10B-A1.8B.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 27 of its 35 references that are in the map. First posted on arXiv 11 Jul 2026.

Builds on

27 of 35 references.

References · 27

  1. 2024GPT-4o System Cardcited by 4,467
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  3. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  4. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  5. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
  6. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  7. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  8. 2020SummEval: Re-evaluating Summarization Evaluationcited by 666
  9. 2024Qwen2-Audio Technical Reportcited by 543
  10. 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 492
  11. 2025Qwen3-Omni Technical Reportcited by 451
  12. 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
15 more
  1. 2023WhisperX: Time-Accurate Speech Transcription of Long-Form Audiocited by 320
  2. 2020VoxLingua107: a Dataset for Spoken Language Recognitioncited by 118
  3. 2018Localizing Moments in Video with Temporal Languagecited by 83
  4. 2024TimeMarker: A Versatile Video-LLM for Long and Short Video Understanding with Superior Temporal Localization Abilitycited by 69
  5. 2024YODAS: Youtube-Oriented Dataset for Audio and Speechcited by 56
  6. 2025LongCat-Flash Technical Reportcited by 54
  7. 2025Voxtralcited by 41
  8. 2021Text-to-Audio Grounding: Building Correspondence Between Captions and Sound Eventscited by 16
  9. 2026VIBEVOICE-ASR Technical Reportcited by 14
  10. 2024A Comparative Study of Quality Evaluation Methods for Text Summarizationcited by 13
  11. 2025Listening Between the Frames: Bridging Temporal Gaps in Large Audio-Language Modelscited by 8
  12. 2024Language-based Audio Moment Retrievalcited by 4
  13. 2026MOSS Transcribe Diarize Technical Reportcited by 4
  14. 2025GigaAM: Efficient Self-Supervised Learner for Speech Recognitioncited by 3
  15. 2025CASTELLA: Long Audio Dataset with Captions and Temporal Boundariescited by 3

Built on by

Not cited yet.