A Synergistic Framework of Nonlinear Acoustic Computing and Reinforcement Learning for Real-World Human-Robot Interaction
On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation
Abstract (arXiv)
This paper introduces a novel framework integrating nonlinear acoustic computing and reinforcement learning to enhance advanced human-robot interaction under complex noise and reverberation. Leveraging physically informed wave equations (e.g., Westervelt, KZK), the approach captures higher-order phenomena such as harmonic generation and shock formation. By embedding these models in a reinforcement learning-driven control loop, the system adaptively optimizes key parameters (e.g., absorption, beamforming) to mitigate multipath interference and non-stationary noise. Experimental evaluations, covering far-field localization, weak signal detection, and multilingual speech recognition, demonstrate that this hybrid strategy surpasses traditional linear methods and purely data-driven baselines, achieving superior noise suppression, minimal latency, and robust accuracy in demanding real-world scenarios. The proposed system demonstrates broad application prospects in AI hardware, robot, machine audition, artificial audition, and brain-machine interfaces.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 14 of its 29 references that are in the map. First posted on arXiv 4 May 2025.
Builds on
14 of 29 references.
References · 14
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 669
- 2023Scaling Speech Technology to 1,000+ Languagescited by 411
- 2025Kimi-Audio Technical Reportcited by 222
- 2017Supervised Speech Separation Based on Deep Learning: An Overviewcited by 216
- 2015Deep clustering: Discriminative embeddings for segmentation and separationcited by 212
- 2022Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognitioncited by 144
- 2024FunAudioLLM: Voice Understanding and Generation Foundation Models for Natural Interaction Between Humans and LLMscited by 122
- 2025FireRedASR: Open-Source Industrial-Grade Mandarin Speech Recognition Models from Encoder-Decoder to LLM Integrationcited by 46
- 2017A Hybrid DSP/Deep Learning Approach to Real-Time Full-Band Speech Enhancementcited by 34
- 2020Far-Field Automatic Speech Recognitioncited by 32
- 2021A Survey on Deep Reinforcement Learning for Audio-Based Applicationscited by 17
Built on by
Citing papers per year: 2025: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2024Learning to Communicate Functional States with Nonverbal Expressions for Improved Human-Robot Collaboration
- 2024Audio-Driven Reinforcement Learning for Head-Orientation in Naturalistic Environments
- 2026Embodied Human-Robot Interaction via Acoustics: A MARL Approach with AcoustoBots for Spatial Data Physicalization ↗
- 2025Learning Quiet Walking for a Small Home Robot
- 2019Speech Driven Backchannel Generation using Deep Q-Network for Enhancing Engagement in Human-Robot Interaction ↗
- 2026BCNav: Bearing-Conditioned Depth Policies for Sound Source Navigation ↗
- 2026Semantic Audio-driven Understanding for Dynamic Humanoid Whole Body Control
- 2025Learning Robot Manipulation from Audio World Models