mlsanityData to 7 Oct 2026

AudioEditor: A Training-Free Diffusion-Based Audio Editing Framework

arXiv 2409.12466 ↗First posted 19 Sep 2024cs.SD eess.AScited by 13

On the map: Diffusion models → Audio, speech and music

Abstract (arXiv)

Diffusion-based text-to-audio (TTA) generation has made substantial progress, leveraging latent diffusion model (LDM) to produce high-quality, diverse and instruction-relevant audios. However, beyond generation, the task of audio editing remains equally important but has received comparatively little attention. Audio editing tasks face two primary challenges: executing precise edits and preserving the unedited sections. While workflows based on LDMs have effectively addressed these challenges in the field of image processing, similar approaches have been scarcely applied to audio editing. In this paper, we introduce AudioEditor, a training-free audio editing framework built on the pretrained diffusion-based TTA model. AudioEditor incorporates Null-text Inversion and EOT-suppression methods, enabling the model to preserve original audio features while executing accurate edits. Comprehensive objective and subjective experiments validate the effectiveness of AudioEditor in delivering high-quality audio edits. Code and demo can be found at https://github.com/NKU-HLT/AudioEditor.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 27 of its 33 references that are in the map. First posted on arXiv 19 Sep 2024.

Builds on

27 of 33 references.

Closest ancestors · 10

Same direction, newest first

  1. 2024Prompt-guided Precise Audio Editing with Diffusion Models11 May
  2. 2024Tango 2: Aligning Diffusion-based Text-to-Audio Generations through Direct Preference Optimization15 Apr
  3. 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversion15 Feb
  4. 2024Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generation2 Jan
  5. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining10 Aug
  6. 2023Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation29 May
  7. 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model24 Apr
  8. 2023AUDIT: Audio Editing by Following Instructions with Latent Diffusion Models3 Apr
  9. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models30 Jan
  10. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Models29 Jan

Other references · 17

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2020Denoising Diffusion Implicit Modelscited by 9,655
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  5. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  6. 2022Classifier-Free Diffusion Guidancecited by 5,717
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  8. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  9. 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
  10. 2016CNN Architectures for Large-Scale Audio Classificationcited by 701
  11. 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
  12. 2023WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Researchcited by 266
5 more
  1. 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulationscited by 243
  2. 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
  3. 2023Dreamix: Video Diffusion Models are General Video Editorscited by 189
  4. 2024Get What You Want, Not What You Don't: Image Content Suppression for Text-to-Image Diffusion Modelscited by 62
  5. 2021What is the ground truth? Reliability of multi-annotator data for audio taggingcited by 29

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 7; 2026: 6.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2026DirectAudioEdit: Inversion-Free Text-Guided Audio Editing via Diffusion Prediction Contrast
  2. 2025AudioMorphix: Training-free audio editing with diffusion probabilistic models
  3. 2024SonicDiffusion: Audio-Driven Image Generation and Editing with Pretrained Diffusion Models
  4. 2026Unified Audio Generation and Editing via Joint Condition Modeling and Progressive Training ↗
  5. 2024PTQ4ADM: Post-Training Quantization for Efficient Text Conditional Audio Diffusion Models
  6. 2026SwiftAudio: Data-Efficient Caption-Only Distillation for One-Step Text-to-Audio Diffusion-based Generation
  7. 2025Virtual Consistency for Audio Editing
  8. 2024EzAudio: Enhancing Text-to-Audio Generation with Efficient Diffusion Transformer