Source Separation with Deep Generative Priors
Not on the map. Why?
Abstract (arXiv)
Despite substantial progress in signal source separation, results for richly structured data continue to contain perceptible artifacts. In contrast, recent deep generative models can produce authentic samples in a variety of domains that are indistinguishable from samples of the data distribution. This paper introduces a Bayesian approach to source separation that uses generative models as priors over the components of a mixture of sources, and noise-annealed Langevin dynamics to sample from the posterior distribution of sources given a mixture. This decouples the source separation problem from generative modeling, enabling us to directly use cutting-edge generative models as priors. The method achieves state-of-the-art performance for MNIST digit separation. We introduce new methodology for evaluating separation quality on richer datasets, providing quantitative evaluation of separation results on CIFAR-10. We also provide qualitative results on LSUN.
Key facts. Cited by 35 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Feb 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 6; 2023: 8; 2024: 6; 2025: 6; 2026: 3.
35 papers.
Sort:
By area:
- 2021Gotta Go Fast When Generating Data with Score-Based Modelscited by 218
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separationcited by 63
- 2022Denoising Likelihood Score Matching for Conditional Score-based Data Generationcited by 45
- 2022Diffusion-based Generative Speech Source Separationcited by 41
- 2021Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamicscited by 19
- 2021Blind Image Decompositioncited by 18
- 2022Astronomia ex machina: a history, primer, and outlook on neural networks in astronomycited by 17
- 2021Detector-Free Weakly Supervised Grounding by Separationcited by 16
- 2023Separate And Diffuse: Using a Pretrained Diffusion Model for Improving Source Separationcited by 14
- 2024COCOLA: Coherence-Oriented Contrastive Learning of Musical Audio Representationscited by 14
- 2024Generalized Multi-Source Inference for Text Conditioned Music Diffusion Modelscited by 13
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Modelscited by 13
23 more
- 2023Latent Autoregressive Source Separationcited by 12
- 2022One-shot Generative Prior in Hankel-k-space for Parallel Imaging Reconstructioncited by 11
- 2021Wavelet Transform-assisted Adaptive Generative Modeling for Colorizationcited by 8
- 2025Source Separation by Flow Matchingcited by 8
- 2023Score-based Source Separation with Applications to Digital Communication Signalscited by 7
- 2025ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Priorcited by 7
- 2025MGE-LDM: Joint Latent Diffusion for Simultaneous Music Generation and Source Extractioncited by 4
- 2025ZeroSep: Separate Anything in Audio with Zero Trainingcited by 4
- 2023Diffusion-based Signal Refiner for Speech Enhancement and Separationcited by 3
- 2025Unsupervised Single-Channel Audio Separation with Diffusion Source Priorscited by 3
- 2021Unsupervised Source Separation via Bayesian Inference in the Latent Domaincited by 2
- 2022Learning and controlling the source-filter representation of speech with a variational autoencodercited by 2
- 2026The Radio-Frequency Transformer for Signal Separationcited by 2
- 2026StrADiff: A Structured Source-Wise Adaptive Diffusion Framework for Linear and Nonlinear Blind Source Separationcited by 2
- 2023Blind Source Separation of Single-Channel Mixtures via Multi-Encoder Autoencoderscited by 1
- 2022Semi-Blind Source Separation with Learned Constraintscited by 0
- 2023Adversarial Generative NMF for Single Channel Source Separationcited by 0
- 2023Mixup-Privacy: A simple yet effective approach for privacy-preserving segmentationcited by 0
- 2024Weighted-Sum of Gaussian Process Latent Variable Modelscited by 0
- 2024Maximum Discrepancy Generative Regularization and Non-Negative Matrix Factorization for Single Channel Source Separationcited by 0
- 2024Source Separation of Multi-source Raw Music using a Residual Quantized Variational Autoencodercited by 0
- 2025Disentanglement of Sources in a Multi-Stream Variational Autoencodercited by 0
- 2026SURF: Separation via Unsupervised Remixing Flowcited by 0
- 2026SURF: Separation via Unsupervised Remixing Flow3 Jun 2026
- 2026StrADiff: A Structured Source-Wise Adaptive Diffusion Framework for Linear and Nonlinear Blind Source Separation4 Apr 2026
- 2026The Radio-Frequency Transformer for Signal Separation10 Mar 2026
- 2025Unsupervised Single-Channel Audio Separation with Diffusion Source Priors8 Dec 2025
- 2025Disentanglement of Sources in a Multi-Stream Variational Autoencoder17 Oct 2025
- 2025ZeroSep: Separate Anything in Audio with Zero Training29 May 2025
- 2025MGE-LDM: Joint Latent Diffusion for Simultaneous Music Generation and Source Extraction29 May 2025
- 2025Source Separation by Flow Matching22 May 2025
- 2025ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Prior8 May 2025
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Models18 Sep 2024
- 2024Source Separation of Multi-source Raw Music using a Residual Quantized Variational Autoencoder12 Aug 2024
- 2024COCOLA: Coherence-Oriented Contrastive Learning of Musical Audio Representations25 Apr 2024
23 more
- 2024Maximum Discrepancy Generative Regularization and Non-Negative Matrix Factorization for Single Channel Source Separation26 Mar 2024
- 2024Generalized Multi-Source Inference for Text Conditioned Music Diffusion Models18 Mar 2024
- 2024Weighted-Sum of Gaussian Process Latent Variable Models14 Feb 2024
- 2023Blind Source Separation of Single-Channel Mixtures via Multi-Encoder Autoencoders31 Aug 2023
- 2023Score-based Source Separation with Applications to Digital Communication Signals26 Jun 2023
- 2023Mixup-Privacy: A simple yet effective approach for privacy-preserving segmentation23 May 2023
- 2023Diffusion-based Signal Refiner for Speech Enhancement and Separation10 May 2023
- 2023Adversarial Generative NMF for Single Channel Source Separation24 Apr 2023
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separation4 Feb 2023
- 2023Separate And Diffuse: Using a Pretrained Diffusion Model for Improving Source Separation25 Jan 2023
- 2023Latent Autoregressive Source Separation9 Jan 2023
- 2022Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy7 Nov 2022
- 2022Diffusion-based Generative Speech Source Separation31 Oct 2022
- 2022Semi-Blind Source Separation with Learned Constraints27 Sep 2022
- 2022One-shot Generative Prior in Hankel-k-space for Parallel Imaging Reconstruction15 Aug 2022
- 2022Learning and controlling the source-filter representation of speech with a variational autoencoder14 Apr 2022
- 2022Denoising Likelihood Score Matching for Conditional Score-based Data Generation27 Mar 2022
- 2021Unsupervised Source Separation via Bayesian Inference in the Latent Domain11 Oct 2021
- 2021Blind Image Decomposition25 Aug 2021
- 2021Wavelet Transform-assisted Adaptive Generative Modeling for Colorization9 Jul 2021
- 2021Gotta Go Fast When Generating Data with Score-Based Models28 May 2021
- 2021Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamics17 May 2021
- 2021Detector-Free Weakly Supervised Grounding by Separation20 Apr 2021
- 2021Gotta Go Fast When Generating Data with Score-Based Modelscited by 218
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separationcited by 63
- 2022Diffusion-based Generative Speech Source Separationcited by 41
- 2023Separate And Diffuse: Using a Pretrained Diffusion Model for Improving Source Separationcited by 14
- 2024Generalized Multi-Source Inference for Text Conditioned Music Diffusion Modelscited by 13
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Modelscited by 13
- 2025Source Separation by Flow Matchingcited by 8
- 2023Score-based Source Separation with Applications to Digital Communication Signalscited by 7
- 2025ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Priorcited by 7
- 2025MGE-LDM: Joint Latent Diffusion for Simultaneous Music Generation and Source Extractioncited by 4
- 2025ZeroSep: Separate Anything in Audio with Zero Trainingcited by 4
- 2023Diffusion-based Signal Refiner for Speech Enhancement and Separationcited by 3
12 most cited of 14 All 14 (JSON)
- 2026SURF: Separation via Unsupervised Remixing Flow3 Jun 2026
- 2025Unsupervised Single-Channel Audio Separation with Diffusion Source Priors8 Dec 2025
- 2025ZeroSep: Separate Anything in Audio with Zero Training29 May 2025
- 2025MGE-LDM: Joint Latent Diffusion for Simultaneous Music Generation and Source Extraction29 May 2025
- 2025Source Separation by Flow Matching22 May 2025
- 2025ArrayDPS: Unsupervised Blind Speech Separation with a Diffusion Prior8 May 2025
- 2024Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Models18 Sep 2024
- 2024Generalized Multi-Source Inference for Text Conditioned Music Diffusion Models18 Mar 2024
- 2023Score-based Source Separation with Applications to Digital Communication Signals26 Jun 2023
- 2023Diffusion-based Signal Refiner for Speech Enhancement and Separation10 May 2023
- 2023Multi-Source Diffusion Models for Simultaneous Music Generation and Separation4 Feb 2023
- 2023Separate And Diffuse: Using a Pretrained Diffusion Model for Improving Source Separation25 Jan 2023
12 newest of 14 All 14 (JSON)
- 2022Denoising Likelihood Score Matching for Conditional Score-based Data Generationcited by 45
- 2021Parallel and Flexible Sampling from Autoregressive Models via Langevin Dynamicscited by 19
- 2021Blind Image Decompositioncited by 18
- 2022Astronomia ex machina: a history, primer, and outlook on neural networks in astronomycited by 17
- 2021Detector-Free Weakly Supervised Grounding by Separationcited by 16
- 2024COCOLA: Coherence-Oriented Contrastive Learning of Musical Audio Representationscited by 14
- 2023Latent Autoregressive Source Separationcited by 12
- 2022One-shot Generative Prior in Hankel-k-space for Parallel Imaging Reconstructioncited by 11
- 2021Wavelet Transform-assisted Adaptive Generative Modeling for Colorizationcited by 8
- 2021Unsupervised Source Separation via Bayesian Inference in the Latent Domaincited by 2
- 2022Learning and controlling the source-filter representation of speech with a variational autoencodercited by 2
- 2026The Radio-Frequency Transformer for Signal Separationcited by 2
12 most cited of 21 All 21 (JSON)
- 2026StrADiff: A Structured Source-Wise Adaptive Diffusion Framework for Linear and Nonlinear Blind Source Separation4 Apr 2026
- 2026The Radio-Frequency Transformer for Signal Separation10 Mar 2026
- 2025Disentanglement of Sources in a Multi-Stream Variational Autoencoder17 Oct 2025
- 2024Source Separation of Multi-source Raw Music using a Residual Quantized Variational Autoencoder12 Aug 2024
- 2024COCOLA: Coherence-Oriented Contrastive Learning of Musical Audio Representations25 Apr 2024
- 2024Maximum Discrepancy Generative Regularization and Non-Negative Matrix Factorization for Single Channel Source Separation26 Mar 2024
- 2024Weighted-Sum of Gaussian Process Latent Variable Models14 Feb 2024
- 2023Blind Source Separation of Single-Channel Mixtures via Multi-Encoder Autoencoders31 Aug 2023
- 2023Mixup-Privacy: A simple yet effective approach for privacy-preserving segmentation23 May 2023
- 2023Adversarial Generative NMF for Single Channel Source Separation24 Apr 2023
- 2023Latent Autoregressive Source Separation9 Jan 2023
- 2022Astronomia ex machina: a history, primer, and outlook on neural networks in astronomy7 Nov 2022
12 newest of 21 All 21 (JSON)