TinyGiantALM: A Compact Audio-Language Model for Intent-Aware Reasoning under Resource Constraints
On the map: LLM reasoning → Audio-language model reasoning
Abstract (arXiv)
Current advancements in Audio Reasoning rely on massive Large Audio-Language Models (LALMs), hindering deployment in resource-constrained environments. We introduce TinyGiantALM, a compact 1.5B efficiency-oriented alternative. Instead of brute-force scaling, we propose an Instruction-Aware Feature Refinement framework using a Query-guided Projector and Semantic Gating to filter acoustic signals based on user intent. On the MMAR benchmark, TinyGiantALM achieves 46.4% zero-shot accuracy, significantly outperforming 7B-13B baselines. While a reasoning gap in logical narrative remains versus 30B+ models and certain trade-offs exist in overly dense or spatial scenes, our approach notably surpasses models up to 8x larger in disentangling mixed-modality environments. These findings demonstrate that architectural precision offers a tangible pathway to secure robust perception capabilities on edge-friendly scales.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 19 of its 27 references that are in the map. First posted on arXiv 7 Jun 2026.
Builds on
19 of 27 references.
Closest ancestors · 7
Same direction, newest first
- 2026The Interspeech 2026 Audio Reasoning Challenge: Evaluating Reasoning Process Quality for Audio Reasoning Models and Agents15 Feb
- 2025MMAR: A Challenging Benchmark for Deep Reasoning in Speech, Audio, Music, and Their Mix19 May
- 2025Qwen2.5-Omni Technical Report26 Mar
- 2025Audio Flamingo 2: An Audio-Language Model with Long-Audio Understanding and Expert Reasoning Abilities6 Mar
- 2025Audio-Reasoner: Improving Reasoning Capability in Large Audio Language Models4 Mar
- 2025Audio-CoT: Exploring Chain-of-Thought Reasoning in Large Audio Language Model13 Jan
- 2024GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities17 Jun
Other references · 12
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
- 2024Qwen2-Audio Technical Reportcited by 560
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
- 2025Qwen3-Omni Technical Reportcited by 497
- 2022HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detectioncited by 176
- 2025Baichuan-Omni-1.5 Technical Reportcited by 111
- 2023Joint Audio and Speech Understandingcited by 100
- 2023Mustango: Toward Controllable Text-to-Music Generationcited by 100
- 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 92
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Mellow: a small audio language model for reasoning
- 2026When Scaling Fails: Mitigating Audio Perception Decay of LALMs via Multi-Step Perception-Aware Reasoning
- 2026Audio-Cogito: Towards Deep Audio Reasoning in Large Audio Language Models
- 2026Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs
- 2026ALARM: Audio-Language Alignment for Reasoning Models
- 2026AudioRouter: Data Efficient Audio Understanding via RL based Dual Reasoning
- 2025Audio-Maestro: Enhancing Large Audio-Language Models with Tool-Augmented Reasoning
- 2024MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark