Advancing Audio-Visual Navigation Through Multi-Agent Collaboration in 3D Environments
Not on the map. Why?
Abstract (arXiv)
Intelligent agents often require collaborative strategies to achieve complex tasks beyond individual capabilities in real-world scenarios. While existing audio-visual navigation (AVN) research mainly focuses on single-agent systems, their limitations emerge in dynamic 3D environments where rapid multi-agent coordination is critical, especially for time-sensitive applications like emergency response. This paper introduces MASTAVN (Multi-Agent Scalable Transformer Audio-Visual Navigation), a scalable framework enabling two agents to collaboratively localize and navigate toward an audio target in shared 3D environments. By integrating cross-agent communication protocols and joint audio-visual fusion mechanisms, MASTAVN enhances spatial reasoning and temporal synchronization. Through rigorous evaluation in photorealistic 3D simulators (Replica and Matterport3D), MASTAVN achieves significant reductions in task completion time and notable improvements in navigation success rates compared to single-agent and non-collaborative baselines. This highlights the essential role of spatiotemporal coordination in multi-agent systems. Our findings validate MASTAVN's effectiveness in time-sensitive emergency scenarios and establish a paradigm for advancing scalable multi-agent embodied intelligence in complex 3D environments.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Builds on 27 of its 32 references that are in the map. First posted on arXiv 21 Sep 2025.
Builds on
27 of 32 references.
References · 27
- 2017Attention Is All You Needcited by 60,361
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
- 2015Multiagent Cooperation and Competition with Deep Reinforcement Learningcited by 184
- 2019Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Taskscited by 179
- 2023ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environmentscited by 169
- 2022Multi-Agent Reinforcement Learning is a Sequence Modeling Problemcited by 155
- 2023Towards Learning a Generalist Model for Embodied Navigationcited by 138
- 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 110
- 2019Look, Listen, and Act: Towards Audio-Visual Embodied Navigationcited by 96
- 2021Structured Scene Memory for Vision-Language Navigationcited by 95
- 2022SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learningcited by 95
15 more
- 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 65
- 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigationcited by 60
- 2022Sound Adversarial Audio-Visual Navigationcited by 48
- 2019Two Body Problem: Collaborative Visual Task Completioncited by 45
- 2022Learning in Audio-visual Context: A Review, Analysis, and New Perspectivecited by 44
- 2022Reinforced Structured State-Evolution for Vision-Language Navigationcited by 37
- 2021Move2Hear: Active Audio-Visual Source Separationcited by 35
- 2021Vision-Language Navigation: A Survey and Taxonomycited by 34
- 2023Audio Visual Language Maps for Robot Navigationcited by 30
- 2022AVLEN: Audio-Visual-Language Embodied Navigation in 3D Environmentscited by 26
- 2023Measuring Acoustics with Collaborative Multiple Agentscited by 22
- 2023Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigationcited by 19
- 2023WebVLN: Vision-and-Language Navigation on Websitescited by 19
- 2022Pay Self-Attention to Audio-Visual Navigationcited by 18
- 2025DOPE: Dual Object Perception-Enhancement Network for Vision-and-Language Navigationcited by 14
Built on by
Citing papers per year: 2026: 14.
14 papers.
Sort:
By area:
- 2026Parse, Search, and Confirmation: Training-Free Aerial Vision-and-Dialog Navigation with Chain-of-Thought Reasoning and Structured Spatial Memorycited by 1
- 2026Audio Spatially-Guided Fusion for Audio-Visual Navigationcited by 0
- 2026Spatial-Aware Conditioned Fusion for Audio-Visual Navigationcited by 0
- 2026Reliability-Aware Geometric Fusion for Robust Audio-Visual Navigationcited by 0
- 2026Generalizable Audio-Visual Navigation via Binaural Difference Attention and Action Transition Predictioncited by 0
- 2026EAD-Net: Emotion-Aware Talking Head Generation with Spatial Refinement and Temporal Coherencecited by 0
- 2026ML-SAN: Multi-Level Speaker-Adaptive Network for Emotion Recognition in Conversationscited by 0
- 2026Cross-Modal Navigation with Multi-Agent Reinforcement Learningcited by 0
- 2026HRO: Hierarchical Room-to-Object Framework for Zero-Shot Object Goal Navigation with Large Language Modelscited by 0
- 2026CTAN: Cycle-Temporal Attention Network for Embodied Audio-Visual Navigationcited by 0
- 2026Transformer-Based Token Fusion and Dynamic Graph Planning for Audio-Visual Navigationcited by 0
- 2026Talking Head Synthesis with Facial Landmark Guidance via 3D Gaussian Splattingcited by 0
- 2026Two-Stage Multi-modal Learning for Dynamic Audio-Visual Navigation: From Physical Alignment to Scene Aggregation8 Oct 2026
- 2026WS-NeRF: A Mamba-Driven World-State-Aware Adaptive Deblurring Neural Radiance Field18 Sep 2026
- 2026CTAN: Cycle-Temporal Attention Network for Embodied Audio-Visual Navigation25 Jul 2026
- 2026Talking Head Synthesis with Facial Landmark Guidance via 3D Gaussian Splatting16 Jul 2026
- 2026Transformer-Based Token Fusion and Dynamic Graph Planning for Audio-Visual Navigation16 Jul 2026
- 2026Parse, Search, and Confirmation: Training-Free Aerial Vision-and-Dialog Navigation with Chain-of-Thought Reasoning and Structured Spatial Memory13 Jul 2026
- 2026HRO: Hierarchical Room-to-Object Framework for Zero-Shot Object Goal Navigation with Large Language Models12 Jul 2026
- 2026Cross-Modal Navigation with Multi-Agent Reinforcement Learning7 May 2026
- 2026ML-SAN: Multi-Level Speaker-Adaptive Network for Emotion Recognition in Conversations28 Apr 2026
- 2026EAD-Net: Emotion-Aware Talking Head Generation with Spatial Refinement and Temporal Coherence25 Apr 2026
- 2026Generalizable Audio-Visual Navigation via Binaural Difference Attention and Action Transition Prediction6 Apr 2026
- 2026Reliability-Aware Geometric Fusion for Robust Audio-Visual Navigation2 Apr 2026
2 more
- 2026Audio Spatially-Guided Fusion for Audio-Visual Navigationcited by 0
- 2026Spatial-Aware Conditioned Fusion for Audio-Visual Navigationcited by 0
- 2026Reliability-Aware Geometric Fusion for Robust Audio-Visual Navigationcited by 0
- 2026Generalizable Audio-Visual Navigation via Binaural Difference Attention and Action Transition Predictioncited by 0
- 2026EAD-Net: Emotion-Aware Talking Head Generation with Spatial Refinement and Temporal Coherencecited by 0
- 2026ML-SAN: Multi-Level Speaker-Adaptive Network for Emotion Recognition in Conversationscited by 0
- 2026Cross-Modal Navigation with Multi-Agent Reinforcement Learningcited by 0
- 2026HRO: Hierarchical Room-to-Object Framework for Zero-Shot Object Goal Navigation with Large Language Modelscited by 0
- 2026CTAN: Cycle-Temporal Attention Network for Embodied Audio-Visual Navigationcited by 0
- 2026Transformer-Based Token Fusion and Dynamic Graph Planning for Audio-Visual Navigationcited by 0
- 2026Talking Head Synthesis with Facial Landmark Guidance via 3D Gaussian Splattingcited by 0
- 2026Two-Stage Multi-modal Learning for Dynamic Audio-Visual Navigation: From Physical Alignment to Scene Aggregationcited by 0
- 2026Two-Stage Multi-modal Learning for Dynamic Audio-Visual Navigation: From Physical Alignment to Scene Aggregation8 Oct 2026
- 2026CTAN: Cycle-Temporal Attention Network for Embodied Audio-Visual Navigation25 Jul 2026
- 2026Talking Head Synthesis with Facial Landmark Guidance via 3D Gaussian Splatting16 Jul 2026
- 2026Transformer-Based Token Fusion and Dynamic Graph Planning for Audio-Visual Navigation16 Jul 2026
- 2026HRO: Hierarchical Room-to-Object Framework for Zero-Shot Object Goal Navigation with Large Language Models12 Jul 2026
- 2026Cross-Modal Navigation with Multi-Agent Reinforcement Learning7 May 2026
- 2026ML-SAN: Multi-Level Speaker-Adaptive Network for Emotion Recognition in Conversations28 Apr 2026
- 2026EAD-Net: Emotion-Aware Talking Head Generation with Spatial Refinement and Temporal Coherence25 Apr 2026
- 2026Generalizable Audio-Visual Navigation via Binaural Difference Attention and Action Transition Prediction6 Apr 2026
- 2026Reliability-Aware Geometric Fusion for Robust Audio-Visual Navigation2 Apr 2026
- 2026Spatial-Aware Conditioned Fusion for Audio-Visual Navigation2 Apr 2026
- 2026Audio Spatially-Guided Fusion for Audio-Visual Navigation2 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026Systematic Multi-Agent Vision-and-Language Navigation: Formulation, Benchmark, and Method
- 2022Finding Fallen Objects Via Asynchronous Audio-Visual Integration
- 2025Audio-Guided Dynamic Modality Fusion with Stereo-Aware Attention for Audio-Visual Navigation
- 2025Audio-Visual World Models: Learning Physically Grounded Multisensory Dynamics
- 2024Human-Aware Vision-and-Language Navigation: Bridging Simulation to Reality with Dynamic Human Interactions
- 2026Interactive Navigation Beyond Reachability: Benchmark and Agentic Framework
- 2026HM3D-M3: A Benchmark for Multi-Agent, Multi-Modal, Multi-Object Goal Navigation
- 2026Global Commander and Local Operative: A Dual-Agent Framework for Scene Navigation