# Challenges and Opportunities in Multi-device Speech Processing

arXiv: https://arxiv.org/abs/2206.15432 · HTML: https://mlsanity.com/paper/2206.15432/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 17 of its 41 references that are in the map.
- First posted on arXiv 27 Jun 2022.

## Builds on (most cited first, 17 of 17)

- [SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition](https://mlsanity.com/paper/1904.08779/) (2019)
- [SDR - half-baked or well done?](https://mlsanity.com/paper/1811.02508/) (2018)
- [Interspeech 2021 Deep Noise Suppression Challenge](https://mlsanity.com/paper/2101.01902/) (2021)
- [Building and Evaluation of a Real Room Impulse Response Dataset](https://mlsanity.com/paper/1811.06795/) (2018)
- [Deep Multimodal Learning for Audio-Visual Speech Recognition](https://mlsanity.com/paper/1501.05396/) (2015)
- [Channel-Attention Dense U-Net for Multichannel Speech Enhancement](https://mlsanity.com/paper/2001.11542/) (2020)
- [Deep Long Short-Term Memory Adaptive Beamforming Networks For Multichannel Robust Speech Recognition](https://mlsanity.com/paper/1711.08016/) (2017)
- [dEchorate: a Calibrated Room Impulse Response Database for Echo-aware Signal Processing](https://mlsanity.com/paper/2104.13168/) (2021)
- [Dataset of Spatial Room Impulse Responses in a Variable Acoustics Room for Six Degrees-of-Freedom Rendering and Analysis](https://mlsanity.com/paper/2111.11882/) (2021)
- [DNN-based mask estimation for distributed speech enhancement in spatially unconstrained microphone arrays](https://mlsanity.com/paper/2011.01714/) (2020)
- [One model to enhance them all: array geometry agnostic multi-channel personalized speech enhancement](https://mlsanity.com/paper/2110.10330/) (2021)
- [Dual-Encoder Architecture with Encoder Selection for Joint Close-Talk and Far-Talk Speech Recognition](https://mlsanity.com/paper/2109.08744/) (2021)
- [3D Localization of a Sound Source Using Mobile Microphone Arrays Referenced by SLAM](https://mlsanity.com/paper/2007.11079/) (2020)
- [Microphone Array Generalization for Multichannel Narrowband Deep Speech Enhancement](https://mlsanity.com/paper/2107.12601/) (2021)
- [End-to-end Alexa Device Arbitration](https://mlsanity.com/paper/2112.04914/) (2021)
- [Distributed Microphone Speech Enhancement based on Deep Learning](https://mlsanity.com/paper/1911.08153/) (2019)
- [Communication-Cost Aware Microphone Selection For Neural Speech Enhancement with Ad-hoc Microphone Arrays](https://mlsanity.com/paper/2011.07348/) (2020)

## Abstract (arXiv)

We review current solutions and technical challenges for automatic speech recognition, keyword spotting, device arbitration, speech enhancement, and source localization in multidevice home environments to provide context for the INTERSPEECH 2022 special session, "Challenges and opportunities for signal processing and machine learning for multiple smart devices". We also identify the datasets needed to support these research areas. Based on the review and our research experience in the multi-device domain, we conclude with an outlook on the future evolution