mlsanityData to 7 Oct 2026

Complex Image-Generative Diffusion Transformer for Audio Denoising

arXiv 2406.09161 ↗First posted 13 Jun 2024cs.SD eess.AScited by 1

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

The audio denoising technique has captured widespread attention in the deep neural network field. Recently, the audio denoising problem has been converted into an image generation task, and deep learning-based approaches have been applied to tackle this problem. However, its performance is still limited, leaving room for further improvement. In order to enhance audio denoising performance, this paper introduces a complex image-generative diffusion transformer that captures more information from the complex Fourier domain. We explore a novel diffusion transformer by integrating the transformer with a diffusion model. Our proposed model demonstrates the scalability of the transformer and expands the receptive field of sparse attention using attention diffusion. Our work is among the first to utilize diffusion transformers to deal with the image generation task for audio denoising. Extensive experiments on two benchmark datasets demonstrate that our proposed model outperforms state-of-the-art methods.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 23 of its 28 references that are in the map. First posted on arXiv 13 Jun 2024.

Builds on

23 of 28 references.

Closest ancestors · 1

Same direction, newest first

  1. 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Models17 Nov

Other references · 22

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,551
  5. 2022Imagen Video: High Definition Video Generation with Diffusion Modelscited by 1,765
  6. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
  7. 2021Segmenter: Transformer for Semantic Segmentationcited by 855
  8. 2020U2-Net: Going Deeper with Nested U-Structure for Salient Object Detectioncited by 410
  9. 2021MetricGAN+: An Improved Version of MetricGAN for Speech Enhancementcited by 114
  10. 2021Mixed Transformer U-Net For Medical Image Segmentationcited by 95
  11. 2019Phase-aware Speech Enhancement with Deep Complex U-Netcited by 73
  12. 2022CMGAN: Conformer-based Metric GAN for Speech Enhancementcited by 45
10 more
  1. 2022MANNER: Multi-view Attention Network for Noise Erasurecited by 28
  2. 2016A Fully Convolutional Neural Network for Speech Enhancementcited by 23
  3. 2020Improving GANs for Speech Enhancementcited by 22
  4. 2021Speech Denoising Without Clean Training Data: A Noise2Noise Approachcited by 17
  5. 2022A Two-Stage U-Net for High-Fidelity Denoising of Historical Recordingscited by 17
  6. 2022BirdSoundsDenoising: Deep Visual Audio Denoising for Bird Soundscited by 7
  7. 2020DCCRGAN: Deep Complex Convolution Recurrent Generator Adversarial Network for Speech Enhancementcited by 4
  8. 2023Complex Image Generation SwinTransformer Network for Audio Denoisingcited by 3
  9. 2023DCHT: Deep Complex Hybrid Transformer for Speech Enhancementcited by 3
  10. 2023DPATD: Dual-Phase Audio Transformer for Denoisingcited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2024Diffusion Models for Audio Restoration
  2. 2024A Versatile Diffusion Transformer with Mixture of Noise Levels for Audiovisual Generation
  3. 2023Investigating the Design Space of Diffusion Models for Speech Enhancement
  4. 2022Analysing Diffusion-based Generative Approaches versus Discriminative Approaches for Speech Restoration
  5. 2024AV-DiT: Efficient Audio-Visual Diffusion Transformer for Joint Audio and Video Generation
  6. 2024Visual Echoes: A Simple Unified Transformer for Audio-Visual Generation
  7. 2026AMDM-SE: Attention-based Multichannel Diffusion Model for Speech Enhancement
  8. 2023A Survey on Audio Diffusion Models: Text To Speech Synthesis and Enhancement in Generative AI