mlsanityData to 7 Oct 2026

AcousticDiffusion: Semantically Conditioned Audio-Guided Diffusion Policy for Search-and-Rescue Assistance

arXiv 2609.21792 ↗First posted 18 Sep 2026cs.ROcited by 0

On the map: Diffusion models → Diffusion and flow policies for robotics also fits: Audio, speech and music

Abstract (arXiv)

Navigating toward human callers is an important capability for rescue robots operating where visual contact is degraded or occluded. We present AcousticDiffusion, a semantically conditioned, audio-guided diffusion policy for human-directed navigation. A frozen pretrained audio recognizer processes 10.24 s windows, with speech gating and distress-aware prioritization converting recognition outputs into source-level navigation roles. Microphone-array direction-of-arrival measurements are recursively integrated into a robot-centric Bayesian bird's-eye-view belief field. Ego-motion compensation aligns successive observations, progressively constraining source position while preserving bearing-induced range uncertainty. The semantic belief, recent acoustic observations, audio features, and robot state condition a diffusion model that generates waypoint trajectories. On a synthetic-navigation validation set using recorded audio, AcousticDiffusion achieves a mean end-point bearing error of 11.20 degrees, with 91.78% of trajectories aligned within 30 degrees of the caller. Distractor rejection ranges from 89.20% to 98.99%, and the policy favors a HELP-designated caller over a competing speaker in 91.07% of windows. Deployed online on a ZSL-1 quadruped without additional retraining, it achieves a mean bearing error of 64.9 degrees, compared with 98.2 degrees for A* and 90.4 degrees for RRT, with a mean planner compute time of 6.07 ms. Despite imperfect acoustic localization, the reported mean final source distance is reduced from 3.96 m for the classical planners using ODAS-derived (Open embedded Audition System) guidance to 2.48 m, a 37.4% improvement. These results demonstrate the framework's ability to translate uncertain acoustic observations into closer approaches to human callers.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Diffusion and flow policies for robotics, one of 14 directions in Diffusion models. Builds on 11 of its 20 references that are in the map. First posted on arXiv 18 Sep 2026.

Builds on

11 of 20 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023NoMaD: Goal Masked Diffusion Policies for Navigation and Exploration11 Oct
  2. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar
  3. 2023Imitating Human Behaviour with Diffusion Models25 Jan

Other references · 8

  1. 2019Look, Listen, and Act: Towards Audio-Visual Embodied Navigationcited by 95
  2. 2022SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learningcited by 93
  3. 2020Semantic Audio-Visual Navigationcited by 79
  4. 2022Sound Adversarial Audio-Visual Navigationcited by 46
  5. 2021Catch Me If You Hear Me: Audio-Visual Navigation in Complex Unmapped Environments with Moving Soundscited by 40
  6. 2021Move2Hear: Active Audio-Visual Source Separationcited by 35
  7. 2024Sim2Real Transfer for Audio-Visual Navigation with Frequency-Adaptive Acoustic Field Predictioncited by 7
  8. 2021ODAS: Open embeddeD Audition Systemcited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026BCNav: Bearing-Conditioned Depth Policies for Sound Source Navigation ↗
  2. 2025SONAR: Semantic-Object Navigation with Aggregated Reasoning through a Cross-Modal Inference Paradigm
  3. 2026Towards the Vision-Sound-Language-Action Paradigm: The HEAR Framework for Sound-Centric Manipulation
  4. 2025Audio-Visual World Models: Learning Physically Grounded Multisensory Dynamics
  5. 2026UniSteer: Unified Noise Steering for Efficient Human-Guided VLA Adaptation
  6. 2026Navig-AI-tion: Navigation by Contextual AI and Spatial Audio ↗
  7. 2026PASSAGE: Scaling Scene-Aligned Motion Learning for Perceptive Humanoid Traversal in Cluttered Environments ↗
  8. 2025VENTURA: Adapting Image Diffusion Models for Unified Task Conditioned Navigation