Asteroid: the PyTorch-based audio source separation toolkit for researchers
Not on the map. Why?
Abstract (arXiv)
This paper describes Asteroid, the PyTorch-based audio source separation toolkit for researchers. Inspired by the most successful neural source separation systems, it provides all neural building blocks required to build such a system. To improve reproducibility, Kaldi-style recipes on common audio source separation datasets are also provided. This paper describes the software architecture of Asteroid and its most important features. By showing experimental results obtained with Asteroid's recipes, we show that our implementations are at least on par with most results reported in reference papers. The toolkit is publicly available at https://github.com/mpariente/asteroid .
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). First posted on arXiv 8 May 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 7; 2023: 7; 2024: 9; 2025: 6; 2026: 3.
45 papers.
Sort:
By area:
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2022An efficient encoder-decoder architecture with top-down attention for speech separationcited by 38
- 2022MESH2IR: Neural Acoustic Impulse Response Generator for Complex 3D Scenescited by 23
- 2021ESPnet2-TTS: Extending the Edge of TTS Researchcited by 22
- 2024Look Once to Hear: Target Speech Hearing with Noisy Examplescited by 11
- 2022An Audio-Visual Speech Separation Model Inspired by Cortico-Thalamo-Cortical Circuitscited by 9
- 2021Test-Time Adaptation Toward Personalized Speech Enhancement: Zero-Shot Learning with Knowledge Distillationcited by 8
- 2022ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understandingcited by 8
- 2021USTC-NELSLIP System Description for DIHARD-III Challengecited by 7
- 2022Multimodal Emotion Recognition with Modality-Pairwise Unsupervised Contrastive Losscited by 7
- 2021End-to-End Complex-Valued Multidilated Convolutional Neural Network for Joint Acoustic Echo Cancellation and Noise Suppressioncited by 6
- 2023Zero-Shot Duet Singing Voices Separation with Diffusion Modelscited by 6
33 more
- 2021Efficient Personalized Speech Enhancement through Self-Supervised Learningcited by 5
- 2021Directed Speech Separation for Automatic Speech Recognition of Long Form Conversational Speechcited by 5
- 2024SynthSOD: Developing an Heterogeneous Dataset for Orchestra Music Source Separationcited by 4
- 2021BLOOM-Net: Blockwise Optimization for Masking Networks Toward Scalable and Efficient Speech Enhancementcited by 3
- 2022Disentangling the Impacts of Language and Channel Variability on Speech Separation Networkscited by 3
- 2023On Neural Architectures for Deep Learning-based Source Separation of Co-Channel OFDM Signalscited by 3
- 2021Tune-In: Training Under Negative Environments with Interference for Attention Networks Simulating Cocktail Party Effectcited by 2
- 2023A Multimodal Data-driven Framework for Anxiety Screeningcited by 2
- 2023End-to-End Integration of Speech Separation and Voice Activity Detection for Low-Latency Diarization of Telephone Conversationscited by 2
- 2024Online speaker diarization of meetings guided by speech separationcited by 2
- 2025Score-informed Music Source Separation: Improving Synthetic-to-real Generalization in Classical Musiccited by 2
- 2025Whispering Under the Eaves: Protecting User Privacy Against Commercial and LLM-powered Automatic Speech Recognition Systemscited by 2
- 2021Deep Learning Tools for Audacity: Helping Researchers Expand the Artist's Toolkitcited by 1
- 2021Learning Filterbanks for End-to-End Acoustic Beamformingcited by 1
- 2022Analysis of impact of emotions on target speech extraction and speech separationcited by 1
- 2024Papez: Resource-Efficient Speech Separation with Auditory Working Memorycited by 1
- 2025SonicSieve: Bringing Directional Speech Extraction to Smartphones Using Acoustic Microstructurescited by 1
- 2025Frequency-Weighted Training Losses for Phoneme-Level DNN-based Speech Enhancementcited by 1
- 2025The Spheres Dataset: Multitrack Orchestral Recordings for Music Source Separation and Information Retrievalcited by 1
- 2021Manifold-Aware Deep Clustering: Maximizing Angles between Embedding Vectors Based on Regular Simplexcited by 0
- 2021Progressive Learning for Stabilizing Label Selection in Speech Separation with Mapping-based Methodcited by 0
- 2023Scaling strategies for on-device low-complexity source separation with Conv-Tasnetcited by 0
- 2023Automatic Data Augmentation for Domain Adapted Fine-Tuning of Self-Supervised Speech Representationscited by 0
- 2023Improving Label Assignments Learning by Dynamic Sample Dropout Combined with Layer-wise Optimization in Speech Separationcited by 0
- 2024CATSE: A Context-Aware Framework for Causal Target Sound Extractioncited by 0
- 2024Effects of Dataset Sampling Rate for Noise Cancellation through Deep Learningcited by 0
- 2024ESPnet-EZ: Python-only ESPnet for Easy Fine-tuning and Integrationcited by 0
- 2024Joint Beamforming and Speaker-Attributed ASR for Real Distant-Microphone Meeting Transcriptioncited by 0
- 2024GhostRNN: Reducing State Redundancy in RNN with Cheap Operationscited by 0
- 2025IS3 : Generic Impulsive--Stationary Sound Separation in Acoustic Scenes using Deep Filteringcited by 0
- 2026Time-Frequency Weighted Losses for Phoneme Reconstruction in DNN-Based Speech Enhancementcited by 0
- 2026Music-Source-Separation-Training (MSST): A Unified Framework for Training and Evaluating Music Demixing Modelscited by 0
- 2026GLARE: Generating Listening Heads with Appropriate Reactionscited by 0
- 2026GLARE: Generating Listening Heads with Appropriate Reactions30 Sep 2026
- 2026Music-Source-Separation-Training (MSST): A Unified Framework for Training and Evaluating Music Demixing Models25 Jul 2026
- 2026Time-Frequency Weighted Losses for Phoneme Reconstruction in DNN-Based Speech Enhancement19 Jun 2026
- 2025The Spheres Dataset: Multitrack Orchestral Recordings for Music Source Separation and Information Retrieval26 Nov 2025
- 2025IS3 : Generic Impulsive--Stationary Sound Separation in Acoustic Scenes using Deep Filtering1 Sep 2025
- 2025Frequency-Weighted Training Losses for Phoneme-Level DNN-based Speech Enhancement23 Jun 2025
- 2025SonicSieve: Bringing Directional Speech Extraction to Smartphones Using Acoustic Microstructures15 Apr 2025
- 2025Whispering Under the Eaves: Protecting User Privacy Against Commercial and LLM-powered Automatic Speech Recognition Systems1 Apr 2025
- 2025Score-informed Music Source Separation: Improving Synthetic-to-real Generalization in Classical Music10 Mar 2025
- 2024GhostRNN: Reducing State Redundancy in RNN with Cheap Operations20 Nov 2024
- 2024Joint Beamforming and Speaker-Attributed ASR for Real Distant-Microphone Meeting Transcription29 Oct 2024
- 2024SynthSOD: Developing an Heterogeneous Dataset for Orchestra Music Source Separation17 Sep 2024
33 more
- 2024ESPnet-EZ: Python-only ESPnet for Easy Fine-tuning and Integration14 Sep 2024
- 2024Papez: Resource-Efficient Speech Separation with Auditory Working Memory1 Jul 2024
- 2024Effects of Dataset Sampling Rate for Noise Cancellation through Deep Learning30 May 2024
- 2024Look Once to Hear: Target Speech Hearing with Noisy Examples10 May 2024
- 2024CATSE: A Context-Aware Framework for Causal Target Sound Extraction21 Mar 2024
- 2024Online speaker diarization of meetings guided by speech separation30 Jan 2024
- 2023Improving Label Assignments Learning by Dynamic Sample Dropout Combined with Layer-wise Optimization in Speech Separation20 Nov 2023
- 2023Zero-Shot Duet Singing Voices Separation with Diffusion Models13 Nov 2023
- 2023Automatic Data Augmentation for Domain Adapted Fine-Tuning of Self-Supervised Speech Representations1 Jun 2023
- 2023End-to-End Integration of Speech Separation and Voice Activity Detection for Low-Latency Diarization of Telephone Conversations21 Mar 2023
- 2023A Multimodal Data-driven Framework for Anxiety Screening16 Mar 2023
- 2023On Neural Architectures for Deep Learning-based Source Separation of Co-Channel OFDM Signals11 Mar 2023
- 2023Scaling strategies for on-device low-complexity source separation with Conv-Tasnet6 Mar 2023
- 2022An Audio-Visual Speech Separation Model Inspired by Cortico-Thalamo-Cortical Circuits21 Dec 2022
- 2022An efficient encoder-decoder architecture with top-down attention for speech separation30 Sep 2022
- 2022Analysis of impact of emotions on target speech extraction and speech separation15 Aug 2022
- 2022Multimodal Emotion Recognition with Modality-Pairwise Unsupervised Contrastive Loss23 Jul 2022
- 2022ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understanding19 Jul 2022
- 2022MESH2IR: Neural Acoustic Impulse Response Generator for Complex 3D Scenes18 May 2022
- 2022Disentangling the Impacts of Language and Channel Variability on Speech Separation Networks30 Mar 2022
- 2021Directed Speech Separation for Automatic Speech Recognition of Long Form Conversational Speech10 Dec 2021
- 2021BLOOM-Net: Blockwise Optimization for Masking Networks Toward Scalable and Efficient Speech Enhancement17 Nov 2021
- 2021Learning Filterbanks for End-to-End Acoustic Beamforming8 Nov 2021
- 2021Deep Learning Tools for Audacity: Helping Researchers Expand the Artist's Toolkit25 Oct 2021
- 2021Progressive Learning for Stabilizing Label Selection in Speech Separation with Mapping-based Method20 Oct 2021
- 2021ESPnet2-TTS: Extending the Edge of TTS Research15 Oct 2021
- 2021End-to-End Complex-Valued Multidilated Convolutional Neural Network for Joint Acoustic Echo Cancellation and Noise Suppression2 Oct 2021
- 2021SpeechBrain: A General-Purpose Speech Toolkit8 Jun 2021
- 2021Manifold-Aware Deep Clustering: Maximizing Angles between Embedding Vectors Based on Regular Simplex4 Jun 2021
- 2021Test-Time Adaptation Toward Personalized Speech Enhancement: Zero-Shot Learning with Knowledge Distillation8 May 2021
- 2021Efficient Personalized Speech Enhancement through Self-Supervised Learning5 Apr 2021
- 2021USTC-NELSLIP System Description for DIHARD-III Challenge19 Mar 2021
- 2021Tune-In: Training Under Negative Environments with Interference for Attention Networks Simulating Cocktail Party Effect2 Mar 2021
- 2021SpeechBrain: A General-Purpose Speech Toolkitcited by 404
- 2022An efficient encoder-decoder architecture with top-down attention for speech separationcited by 38
- 2022MESH2IR: Neural Acoustic Impulse Response Generator for Complex 3D Scenescited by 23
- 2021ESPnet2-TTS: Extending the Edge of TTS Researchcited by 22
- 2024Look Once to Hear: Target Speech Hearing with Noisy Examplescited by 11
- 2022An Audio-Visual Speech Separation Model Inspired by Cortico-Thalamo-Cortical Circuitscited by 9
- 2021Test-Time Adaptation Toward Personalized Speech Enhancement: Zero-Shot Learning with Knowledge Distillationcited by 8
- 2022ESPnet-SE++: Speech Enhancement for Robust Speech Recognition, Translation, and Understandingcited by 8
- 2021USTC-NELSLIP System Description for DIHARD-III Challengecited by 7
- 2022Multimodal Emotion Recognition with Modality-Pairwise Unsupervised Contrastive Losscited by 7
- 2021End-to-End Complex-Valued Multidilated Convolutional Neural Network for Joint Acoustic Echo Cancellation and Noise Suppressioncited by 6
- 2021Efficient Personalized Speech Enhancement through Self-Supervised Learningcited by 5
12 most cited of 44 All 44 (JSON)
- 2026GLARE: Generating Listening Heads with Appropriate Reactions30 Sep 2026
- 2026Music-Source-Separation-Training (MSST): A Unified Framework for Training and Evaluating Music Demixing Models25 Jul 2026
- 2026Time-Frequency Weighted Losses for Phoneme Reconstruction in DNN-Based Speech Enhancement19 Jun 2026
- 2025The Spheres Dataset: Multitrack Orchestral Recordings for Music Source Separation and Information Retrieval26 Nov 2025
- 2025IS3 : Generic Impulsive--Stationary Sound Separation in Acoustic Scenes using Deep Filtering1 Sep 2025
- 2025Frequency-Weighted Training Losses for Phoneme-Level DNN-based Speech Enhancement23 Jun 2025
- 2025SonicSieve: Bringing Directional Speech Extraction to Smartphones Using Acoustic Microstructures15 Apr 2025
- 2025Whispering Under the Eaves: Protecting User Privacy Against Commercial and LLM-powered Automatic Speech Recognition Systems1 Apr 2025
- 2025Score-informed Music Source Separation: Improving Synthetic-to-real Generalization in Classical Music10 Mar 2025
- 2024GhostRNN: Reducing State Redundancy in RNN with Cheap Operations20 Nov 2024
- 2024Joint Beamforming and Speaker-Attributed ASR for Real Distant-Microphone Meeting Transcription29 Oct 2024
- 2024SynthSOD: Developing an Heterogeneous Dataset for Orchestra Music Source Separation17 Sep 2024
12 newest of 44 All 44 (JSON)