mlsanityData to 14 Oct 2026

TinyGiantALM: A Compact Audio-Language Model for Intent-Aware Reasoning under Resource Constraints

arXiv 2606.08425 ↗First posted 7 Jun 2026cs.SD cs.CL eess.AScited by 0

On the map: LLM reasoning → Audio-language model reasoning

Abstract (arXiv)

Current advancements in Audio Reasoning rely on massive Large Audio-Language Models (LALMs), hindering deployment in resource-constrained environments. We introduce TinyGiantALM, a compact 1.5B efficiency-oriented alternative. Instead of brute-force scaling, we propose an Instruction-Aware Feature Refinement framework using a Query-guided Projector and Semantic Gating to filter acoustic signals based on user intent. On the MMAR benchmark, TinyGiantALM achieves 46.4% zero-shot accuracy, significantly outperforming 7B-13B baselines. While a reasoning gap in logical narrative remains versus 30B+ models and certain trade-offs exist in overly dense or spatial scenes, our approach notably surpasses models up to 8x larger in disentangling mixed-modality environments. These findings demonstrate that architectural precision offers a tangible pathway to secure robust perception capabilities on edge-friendly scales.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 19 of its 27 references that are in the map. First posted on arXiv 7 Jun 2026.

Builds on

19 of 27 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026The Interspeech 2026 Audio Reasoning Challenge: Evaluating Reasoning Process Quality for Audio Reasoning Models and Agents15 Feb
  2. 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix19 May
  3. 2025Qwen2.5-Omni Technical Report26 Mar
  4. 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities6 Mar
  5. 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Models4 Mar
  6. 2025Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model13 Jan
  7. 2024GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities17 Jun

Other references · 12

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  2. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  4. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
  5. 2024Qwen2-Audio Technical Reportcited by 560
  6. 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
  7. 2025Qwen3-Omni Technical Reportcited by 497
  8. 2022HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detectioncited by 176
  9. 2025Baichuan-Omni-1.5 Technical Reportcited by 111
  10. 2023Joint Audio and Speech Understandingcited by 100
  11. 2023Mustango: Toward Controllable Text-to-Music Generationcited by 100
  12. 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 92

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Mellow: a small audio language model for reasoning
  2. 2026When Scaling Fails: Mitigating Audio Perception Decay of LALMs via Multi-Step Perception-Aware Reasoning
  3. 2026Audio-Cogito: Towards Deep Audio Reasoning in Large Audio Language Models
  4. 2026Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs
  5. 2026ALARM: Audio-Language Alignment for Reasoning Models
  6. 2026AudioRouter: Data Efficient Audio Understanding via RL based Dual Reasoning
  7. 2025Audio-Maestro: Enhancing Large Audio-Language Models with Tool-Augmented Reasoning
  8. 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark