SPUR: A Plug-and-Play Framework for Integrating Spatial Audio Understanding and Reasoning into Large Audio-Language Models
On the map: LLM reasoning → Audio-language model reasoning
Abstract (arXiv)
Spatial perception is central to auditory intelligence, enabling accurate understanding of real-world acoustic scenes and advancing human-level perception of the world around us. While recent large audio-language models (LALMs) show strong reasoning over complex audios, most operate on monaural inputs and lack the ability to capture spatial cues such as direction, elevation, and distance. We introduce SPUR, a lightweight, plug-in approach that equips LALMs with spatial perception through minimal architectural changes. SPUR consists of: (i) a First-Order Ambisonics (FOA) encoder that maps (W, X, Y, Z) channels to rotation-aware, listener-centric spatial features, integrated into target LALMs via a multimodal adapter; and (ii) SPUR-Set, a spatial QA dataset combining open-source FOA recordings with controlled simulations, emphasizing relative direction, elevation, distance, and overlap for supervised spatial reasoning. Fine-tuning our model on the SPUR-Set consistently improves spatial QA and multi-speaker attribution while preserving general audio understanding. SPUR provides a simple recipe that transforms monaural LALMs into spatially aware models. Extensive ablations validate the effectiveness of our approach.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Audio-language model reasoning, one of 17 directions in LLM reasoning. Builds on 22 of its 34 references that are in the map. First posted on arXiv 10 Nov 2025.
Builds on
22 of 34 references.
Closest ancestors · 5
Same direction, newest first
- 2025OWL: Geometry-Aware Spatial Reasoning for Audio Large Language Models30 Sep
- 2025DSpAST: Disentangled Representations for Spatial Audio Reasoning with Large Language Models17 Sep
- 2025Audio Flamingo 3: Advancing Audio Intelligence with Fully Open Large Audio Language Models10 Jul
- 2025Qwen2.5-Omni Technical Report26 Mar
- 2024BAT: Learning to Reason about Spatial Sounds with Large Language Models2 Feb
Other references · 17
- 2023GPT-4 Technical Reportcited by 18,132
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2024Qwen2-Audio Technical Reportcited by 543
- 2025Phi-4-Mini Technical Report: Compact yet Powerful Multimodal Language Models via Mixture-of-LoRAscited by 491
- 2025Qwen3-Omni Technical Reportcited by 451
- 2025Kimi-Audio Technical Reportcited by 210
- 2025Step-Audio 2 Technical Reportcited by 101
- 2023STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Eventscited by 39
- 2024Learning Spatially-Aware Language and Audio Embeddingscited by 15
- 2024Can Large Language Models Understand Spatial Audio?cited by 14
5 more
- 2023FN-SSL: Full-Band and Narrow-Band Fusion for Sound Source Localizationcited by 10
- 2025SALM: Spatial Audio Language Model with Structured Embeddings for Understanding and Editingcited by 6
- 2025Spatial Audio Processing with Large Language Model on Wearable Devicescited by 4
- 2025Towards Spatial Audio Understanding via Question Answeringcited by 3
- 2024Blind Estimation of Sub-band Acoustic Parameters from Ambisonics Recordings using Spectro-Spatial Covariance Featurescited by 1
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Spatial-Omni: Spatial Audio Understanding Integration in Multimodal LLMs via FOA Encodingcited by 4
- 2026Spatial Audio Question Answering and Reasoning on Dynamic Source Movementscited by 2
- 2026Spatio-Temporal Audio Language Modeling for Dynamic Sound Sourcescited by 2
- 2026Listen, See and Track: Spatio-Temporal Audio-Visual Sound Event Reasoning for Omni-Modal Language Modelscited by 1
- 2026OmniEcho: Audio-Visual Spatial Understanding for Omni-Modal Embodied Agentscited by 1
- 2026SAIL: Spatial Audio Intelligence with Large Language Models via Disentangled Acoustic-Spatial Encoding and Dual-Stream Q-Formercited by 0
- 2026SAIL: Spatial Audio Intelligence with Large Language Models via Disentangled Acoustic-Spatial Encoding and Dual-Stream Q-Former28 Sep 2026
- 2026OmniEcho: Audio-Visual Spatial Understanding for Omni-Modal Embodied Agents20 Sep 2026
- 2026Listen, See and Track: Spatio-Temporal Audio-Visual Sound Event Reasoning for Omni-Modal Language Models10 Aug 2026
- 2026Spatio-Temporal Audio Language Modeling for Dynamic Sound Sources12 Jun 2026
- 2026Spatial-Omni: Spatial Audio Understanding Integration in Multimodal LLMs via FOA Encoding9 Jun 2026
- 2026Spatial Audio Question Answering and Reasoning on Dynamic Source Movements18 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026The World is Not Mono: Enabling Spatial Understanding in Large Audio-Language Models
- 2025Spatial Audio Motion Understanding and Reasoning
- 2026SAVU-BENCH: A Real-World Benchmark for Spatial Audio-Visual Understanding
- 2026SEA-LM: Egocentric Spatial Audio Understanding for Wearable Microphone Arrays
- 2025STAR-Bench: Probing Deep Spatio-Temporal Reasoning as Audio 4D Intelligence
- 2025AudioMotionBench: Evaluating Auditory Motion Perception in Audio LLMs
- 2025In-the-wild Audio Spatialization with Flexible Text-guided Localization
- 2026PhaseCoder: Microphone Geometry-Agnostic Spatial Audio Understanding for Multimodal LLMs