Sudo rm -rf: Efficient Networks for Universal Audio Source Separation
Not on the map. Why?
Abstract (arXiv)
In this paper, we present an efficient neural network for end-to-end general purpose audio source separation. Specifically, the backbone structure of this convolutional network is the SUccessive DOwnsampling and Resampling of Multi-Resolution Features (SuDoRMRF) as well as their aggregation which is performed through simple one-dimensional convolutions. In this way, we are able to obtain high quality audio source separation with limited number of floating point operations, memory requirements, number of parameters and latency. Our experiments on both speech and environmental sound separation datasets show that SuDoRMRF performs comparably and even surpasses various state-of-the-art approaches with significantly higher computational resource requirements.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 14 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 9; 2023: 9; 2024: 15; 2025: 3; 2026: 4.
50 papers.
Sort:
By area:
- 2024Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separationcited by 45
- 2022An efficient encoder-decoder architecture with top-down attention for speech separationcited by 38
- 2025SepPrune: Structured Pruning for Efficient Deep Speech Separationcited by 31
- 2021Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Datacited by 27
- 2023MossFormer: Pushing the Performance Limit of Monaural Speech Separation using Gated Single-Head Transformer with Convolution-Augmented Joint Self-Attentionscited by 27
- 2022RemixIT: Continual self-training of speech enhancement models via bootstrapped remixingcited by 20
- 2024Annealed Multiple Choice Learning: Overcoming limitations of Winner-takes-all with annealingcited by 12
- 2022Resource-Efficient Separation Transformercited by 11
- 2024TIGER: Time-frequency Interleaved Gain Extraction and Reconstruction for Efficient Speech Separationcited by 10
- 2022An Audio-Visual Speech Separation Model Inspired by Cortico-Thalamo-Cortical Circuitscited by 9
- 2023Subnetwork-to-go: Elastic Neural Network with Dynamic Training and Customizable Inferencecited by 9
- 2021Separate but Together: Unsupervised Federated Learning for Speech Enhancement from Non-IID Datacited by 8
38 more
- 2021Weight, Block or Unit? Exploring Sparsity Tradeoffs for Speech Enhancement on Tiny Neural Acceleratorscited by 8
- 2021Hybrid Neural Networks for On-device Directional Hearingcited by 8
- 2021REAL-M: Towards Speech Separation on Real Mixturescited by 7
- 2022MixCycle: Unsupervised Speech Separation via Cyclic Mixture Permutation Invariant Trainingcited by 7
- 2021Continual self-training with bootstrapped remixing for speech enhancementcited by 6
- 2022Exploiting Temporal Structures of Cyclostationary Signals for Data-Driven Single-Channel Source Separationcited by 6
- 2023A Neural State-Space Model Approach to Efficient Speech Separationcited by 6
- 2023Spatial LibriSpeech: An Augmented Dataset for Spatial Audio Learningcited by 6
- 2024Neural Blind Source Separation and Diarization for Distant Speech Recognitioncited by 6
- 2024RF Challenge: The Data-Driven Radio Frequency Signal Separation Challengecited by 5
- 2024SepMamba: State-space models for speaker separation using Mambacited by 5
- 2021Stepwise-Refining Speech Separation Network via Fine-Grained Encoding in High-order Latent Domaincited by 4
- 2022Exploring Self-Attention Mechanisms for Speech Separationcited by 4
- 2024SonicSim: A customizable simulation platform for speech processing in moving sound source scenarioscited by 4
- 2025A Study of the Scale Invariant Signal to Distortion Ratio in Speech Separation with Noisy Referencescited by 4
- 2021BLOOM-Net: Blockwise Optimization for Masking Networks Toward Scalable and Efficient Speech Enhancementcited by 3
- 2022Deep neural network techniques for monaural speech enhancement: state of the art analysiscited by 3
- 2023On Neural Architectures for Deep Learning-based Source Separation of Co-Channel OFDM Signalscited by 3
- 2021Time-Domain Speech Extraction with Spatial Information and Multi Speaker Conditioning Mechanismcited by 2
- 2022Fine-grained Noise Control for Multispeaker Speech Synthesiscited by 2
- 2023An Efficient Speech Separation Network Based on Recurrent Fusion Dilated Convolution and Channel Attentioncited by 2
- 2023Neural Fast Full-Rank Spatial Covariance Analysis for Blind Source Separationcited by 2
- 2024Online speaker diarization of meetings guided by speech separationcited by 2
- 2024Sound Source Separation Using Latent Variational Block-Wise Disentanglementcited by 2
- 2024U-Mamba-Net: A highly efficient Mamba-based U-net style network for noisy and reverberant speech separationcited by 2
- 2025Knowing When to Quit: Probabilistic Early Exits for Speech Separationcited by 2
- 2026The Radio-Frequency Transformer for Signal Separationcited by 2
- 2021A Time-domain Real-valued Generalized Wiener Filter for Multi-channel Neural Separation Systemscited by 1
- 2024TDFNet: An Efficient Audio-Visual Speech Separation Model with Top-down Fusioncited by 1
- 2024SPMamba: State-space model is all you need in speech separationcited by 1
- 2026Omni-directional attention mechanism based on Mamba for speech separationcited by 1
- 2026Difference-Driven Gating: Adaptive Feature Fusion for U-Net Decodercited by 1
- 2023Scaling strategies for on-device low-complexity source separation with Conv-Tasnetcited by 0
- 2023Improving Label Assignments Learning by Dynamic Sample Dropout Combined with Layer-wise Optimization in Speech Separationcited by 0
- 2024Objective and subjective evaluation of speech enhancement methods in the UDASE task of the 7th CHiME challengecited by 0
- 2024Effects of Dataset Sampling Rate for Noise Cancellation through Deep Learningcited by 0
- 2024Extract and Diffuse: Latent Integration for Improved Diffusion-based Speech and Vocal Enhancementcited by 0
- 2026TF-MoE: Time-Frequency Mixture-of-Experts for Efficient Speech Separationcited by 0
- 2026Difference-Driven Gating: Adaptive Feature Fusion for U-Net Decoder13 Jul 2026
- 2026TF-MoE: Time-Frequency Mixture-of-Experts for Efficient Speech Separation28 Jun 2026
- 2026The Radio-Frequency Transformer for Signal Separation10 Mar 2026
- 2026Omni-directional attention mechanism based on Mamba for speech separation23 Jan 2026
- 2025A Study of the Scale Invariant Signal to Distortion Ratio in Speech Separation with Noisy References20 Aug 2025
- 2025Knowing When to Quit: Probabilistic Early Exits for Speech Separation13 Jul 2025
- 2025SepPrune: Structured Pruning for Efficient Deep Speech Separation17 May 2025
- 2024U-Mamba-Net: A highly efficient Mamba-based U-net style network for noisy and reverberant speech separation24 Dec 2024
- 2024SepMamba: State-space models for speaker separation using Mamba28 Oct 2024
- 2024SonicSim: A customizable simulation platform for speech processing in moving sound source scenarios2 Oct 2024
- 2024TIGER: Time-frequency Interleaved Gain Extraction and Reconstruction for Efficient Speech Separation2 Oct 2024
- 2024Extract and Diffuse: Latent Integration for Improved Diffusion-based Speech and Vocal Enhancement15 Sep 2024
38 more
- 2024RF Challenge: The Data-Driven Radio Frequency Signal Separation Challenge13 Sep 2024
- 2024Annealed Multiple Choice Learning: Overcoming limitations of Winner-takes-all with annealing22 Jul 2024
- 2024Neural Blind Source Separation and Diarization for Distant Speech Recognition12 Jun 2024
- 2024Effects of Dataset Sampling Rate for Noise Cancellation through Deep Learning30 May 2024
- 2024SPMamba: State-space model is all you need in speech separation2 Apr 2024
- 2024Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separation27 Mar 2024
- 2024Sound Source Separation Using Latent Variational Block-Wise Disentanglement8 Feb 2024
- 2024Objective and subjective evaluation of speech enhancement methods in the UDASE task of the 7th CHiME challenge2 Feb 2024
- 2024Online speaker diarization of meetings guided by speech separation30 Jan 2024
- 2024TDFNet: An Efficient Audio-Visual Speech Separation Model with Top-down Fusion25 Jan 2024
- 2023Subnetwork-to-go: Elastic Neural Network with Dynamic Training and Customizable Inference6 Dec 2023
- 2023Improving Label Assignments Learning by Dynamic Sample Dropout Combined with Layer-wise Optimization in Speech Separation20 Nov 2023
- 2023Spatial LibriSpeech: An Augmented Dataset for Spatial Audio Learning18 Aug 2023
- 2023Neural Fast Full-Rank Spatial Covariance Analysis for Blind Source Separation17 Jun 2023
- 2023An Efficient Speech Separation Network Based on Recurrent Fusion Dilated Convolution and Channel Attention9 Jun 2023
- 2023A Neural State-Space Model Approach to Efficient Speech Separation26 May 2023
- 2023On Neural Architectures for Deep Learning-based Source Separation of Co-Channel OFDM Signals11 Mar 2023
- 2023Scaling strategies for on-device low-complexity source separation with Conv-Tasnet6 Mar 2023
- 2023MossFormer: Pushing the Performance Limit of Monaural Speech Separation using Gated Single-Head Transformer with Convolution-Augmented Joint Self-Attentions23 Feb 2023
- 2022An Audio-Visual Speech Separation Model Inspired by Cortico-Thalamo-Cortical Circuits21 Dec 2022
- 2022Deep neural network techniques for monaural speech enhancement: state of the art analysis1 Dec 2022
- 2022An efficient encoder-decoder architecture with top-down attention for speech separation30 Sep 2022
- 2022Exploiting Temporal Structures of Cyclostationary Signals for Data-Driven Single-Channel Source Separation22 Aug 2022
- 2022Resource-Efficient Separation Transformer19 Jun 2022
- 2022Fine-grained Noise Control for Multispeaker Speech Synthesis11 Apr 2022
- 2022RemixIT: Continual self-training of speech enhancement models via bootstrapped remixing17 Feb 2022
- 2022MixCycle: Unsupervised Speech Separation via Cyclic Mixture Permutation Invariant Training8 Feb 2022
- 2022Exploring Self-Attention Mechanisms for Speech Separation6 Feb 2022
- 2021Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data15 Dec 2021
- 2021Hybrid Neural Networks for On-device Directional Hearing11 Dec 2021
- 2021A Time-domain Real-valued Generalized Wiener Filter for Multi-channel Neural Separation Systems7 Dec 2021
- 2021BLOOM-Net: Blockwise Optimization for Masking Networks Toward Scalable and Efficient Speech Enhancement17 Nov 2021
- 2021Weight, Block or Unit? Exploring Sparsity Tradeoffs for Speech Enhancement on Tiny Neural Accelerators3 Nov 2021
- 2021REAL-M: Towards Speech Separation on Real Mixtures20 Oct 2021
- 2021Continual self-training with bootstrapped remixing for speech enhancement19 Oct 2021
- 2021Stepwise-Refining Speech Separation Network via Fine-Grained Encoding in High-order Latent Domain10 Oct 2021
- 2021Separate but Together: Unsupervised Federated Learning for Speech Enhancement from Non-IID Data11 May 2021
- 2021Time-Domain Speech Extraction with Spatial Information and Multi Speaker Conditioning Mechanism7 Feb 2021
- 2024Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separationcited by 45
- 2024SepMamba: State-space models for speaker separation using Mambacited by 5
- 2024U-Mamba-Net: A highly efficient Mamba-based U-net style network for noisy and reverberant speech separationcited by 2
- 2024SPMamba: State-space model is all you need in speech separationcited by 1
- 2026Omni-directional attention mechanism based on Mamba for speech separationcited by 1
- 2026Omni-directional attention mechanism based on Mamba for speech separation23 Jan 2026
- 2024U-Mamba-Net: A highly efficient Mamba-based U-net style network for noisy and reverberant speech separation24 Dec 2024
- 2024SepMamba: State-space models for speaker separation using Mamba28 Oct 2024
- 2024SPMamba: State-space model is all you need in speech separation2 Apr 2024
- 2024Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separation27 Mar 2024
- 2022An efficient encoder-decoder architecture with top-down attention for speech separationcited by 38
- 2025SepPrune: Structured Pruning for Efficient Deep Speech Separationcited by 31
- 2021Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Datacited by 27
- 2023MossFormer: Pushing the Performance Limit of Monaural Speech Separation using Gated Single-Head Transformer with Convolution-Augmented Joint Self-Attentionscited by 27
- 2022RemixIT: Continual self-training of speech enhancement models via bootstrapped remixingcited by 20
- 2024Annealed Multiple Choice Learning: Overcoming limitations of Winner-takes-all with annealingcited by 12
- 2022Resource-Efficient Separation Transformercited by 11
- 2024TIGER: Time-frequency Interleaved Gain Extraction and Reconstruction for Efficient Speech Separationcited by 10
- 2022An Audio-Visual Speech Separation Model Inspired by Cortico-Thalamo-Cortical Circuitscited by 9
- 2023Subnetwork-to-go: Elastic Neural Network with Dynamic Training and Customizable Inferencecited by 9
- 2021Separate but Together: Unsupervised Federated Learning for Speech Enhancement from Non-IID Datacited by 8
- 2021Weight, Block or Unit? Exploring Sparsity Tradeoffs for Speech Enhancement on Tiny Neural Acceleratorscited by 8
12 most cited of 42 All 42 (JSON)
- 2026Difference-Driven Gating: Adaptive Feature Fusion for U-Net Decoder13 Jul 2026
- 2026The Radio-Frequency Transformer for Signal Separation10 Mar 2026
- 2025A Study of the Scale Invariant Signal to Distortion Ratio in Speech Separation with Noisy References20 Aug 2025
- 2025SepPrune: Structured Pruning for Efficient Deep Speech Separation17 May 2025
- 2024SonicSim: A customizable simulation platform for speech processing in moving sound source scenarios2 Oct 2024
- 2024TIGER: Time-frequency Interleaved Gain Extraction and Reconstruction for Efficient Speech Separation2 Oct 2024
- 2024RF Challenge: The Data-Driven Radio Frequency Signal Separation Challenge13 Sep 2024
- 2024Annealed Multiple Choice Learning: Overcoming limitations of Winner-takes-all with annealing22 Jul 2024
- 2024Neural Blind Source Separation and Diarization for Distant Speech Recognition12 Jun 2024
- 2024Effects of Dataset Sampling Rate for Noise Cancellation through Deep Learning30 May 2024
- 2024Sound Source Separation Using Latent Variational Block-Wise Disentanglement8 Feb 2024
- 2024Objective and subjective evaluation of speech enhancement methods in the UDASE task of the 7th CHiME challenge2 Feb 2024
12 newest of 42 All 42 (JSON)