mlsanityData to 14 Oct 2026

Dynamic Multi-Target Fusion for Efficient Audio-Visual Navigation

arXiv 2509.21377 ↗First posted 23 Sep 2025cs.CV cs.AIcited by 13

Not on the map. Why?

Abstract (arXiv)

Audiovisual embodied navigation enables robots to locate audio sources by dynamically integrating visual observations from onboard sensors with the auditory signals emitted by the target. The core challenge lies in effectively leveraging multimodal cues to guide navigation. While prior works have explored basic fusion of visual and audio data, they often overlook deeper perceptual context. To address this, we propose the Dynamic Multi-Target Fusion for Efficient Audio-Visual Navigation (DMTF-AVN). Our approach uses a multi-target architecture coupled with a refined Transformer mechanism to filter and selectively fuse cross-modal information. Extensive experiments on the Replica and Matterport3D datasets demonstrate that DMTF-AVN achieves state-of-the-art performance, outperforming existing methods in success rate (SR), path efficiency (SPL), and scene adaptation (SNA). Furthermore, the model exhibits strong scalability and generalizability, paving the way for advanced multimodal fusion strategies in robotic navigation. The code and videos are available at https://github.com/zzzmmm-svg/DMTF.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 22 of its 33 references that are in the map. First posted on arXiv 23 Sep 2025.

Builds on

22 of 33 references.

References · 22

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2020End-to-End Object Detection with Transformerscited by 7,414
  5. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  6. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  7. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  8. 2016SoundNet: Learning Sound Representations from Unlabeled Videocited by 247
  9. 2023Towards Learning a Generalist Model for Embodied Navigationcited by 138
  10. 2023Discuss Before Moving: Visual Language Navigation via Multi-expert Discussionscited by 110
  11. 2019Look, Listen, and Act: Towards Audio-Visual Embodied Navigationcited by 96
  12. 2020Learning Representations from Audio-Visual Spatial Alignmentcited by 95
10 more
  1. 2022SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learningcited by 95
  2. 2016Ambient Sound Provides Supervision for Visual Learningcited by 78
  3. 2019Dual-modality seq2seq network for audio-visual event localizationcited by 72
  4. 2024Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigationcited by 65
  5. 2025MapNav: A Novel Memory Representation via Annotated Semantic Maps for Vision-and-Language Navigationcited by 60
  6. 2022Sound Adversarial Audio-Visual Navigationcited by 48
  7. 2023Measuring Acoustics with Collaborative Multiple Agentscited by 22
  8. 2023Omnidirectional Information Gathering for Knowledge Transfer-based Audio-Visual Navigationcited by 19
  9. 2023WebVLN: Vision-and-Language Navigation on Websitescited by 19
  10. 2022Pay Self-Attention to Audio-Visual Navigationcited by 18

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 13.

13 papers.

Sort:

By area: