AudioEditor: A Training-Free Diffusion-Based Audio Editing Framework
On the map: Diffusion models → Audio, speech and music
Abstract (arXiv)
Diffusion-based text-to-audio (TTA) generation has made substantial progress, leveraging latent diffusion model (LDM) to produce high-quality, diverse and instruction-relevant audios. However, beyond generation, the task of audio editing remains equally important but has received comparatively little attention. Audio editing tasks face two primary challenges: executing precise edits and preserving the unedited sections. While workflows based on LDMs have effectively addressed these challenges in the field of image processing, similar approaches have been scarcely applied to audio editing. In this paper, we introduce AudioEditor, a training-free audio editing framework built on the pretrained diffusion-based TTA model. AudioEditor incorporates Null-text Inversion and EOT-suppression methods, enabling the model to preserve original audio features while executing accurate edits. Comprehensive objective and subjective experiments validate the effectiveness of AudioEditor in delivering high-quality audio edits. Code and demo can be found at https://github.com/NKU-HLT/AudioEditor.
Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Audio, speech and music, one of 14 directions in Diffusion models. Builds on 27 of its 33 references that are in the map. First posted on arXiv 19 Sep 2024.
Builds on
27 of 33 references.
Closest ancestors · 10
Same direction, newest first
- 2024Prompt-guided Precise Audio Editing with Diffusion Models11 May
- 2024Tango 2: Aligning Diffusion-based Text-to-Audio Generations through Direct Preference Optimization15 Apr
- 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversion15 Feb
- 2024Auffusion: Leveraging the Power of Diffusion and Large Language Models for Text-to-Audio Generation2 Jan
- 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretraining10 Aug
- 2023Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation29 May
- 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Model24 Apr
- 2023AUDIT: Audio Editing by Following Instructions with Latent Diffusion Models3 Apr
- 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models30 Jan
- 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Models29 Jan
Other references · 17
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,168
- 2016CNN Architectures for Large-Scale Audio Classificationcited by 701
- 2019PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognitioncited by 563
- 2023WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Researchcited by 266
5 more
- 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulationscited by 243
- 2024StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generationcited by 240
- 2023Dreamix: Video Diffusion Models are General Video Editorscited by 189
- 2024Get What You Want, Not What You Don't: Image Content Suppression for Text-to-Image Diffusion Modelscited by 62
- 2021What is the ground truth? Reliability of multi-annotator data for audio taggingcited by 29
Built on by
Citing papers per year: 2025: 7; 2026: 6.
13 papers.
Sort:
By area:
- 2025Judge Anything: MLLM as a Judge Across Any Modalitycited by 33
- 2025Zero-Shot Audio-Visual Editing via Cross-Modal Delta Denoisingcited by 13
- 2025Guiding Audio Editing with Audio Language Modelcited by 11
- 2025Coherent Audio-Visual Editing via Conditional Audio Generation Following Video Editscited by 5
- 2026MMAE: A Massive Multitask Audio Editing Benchmarkcited by 5
- 2025RFM-Editing: Rectified Flow Matching for Text-guided Audio Editingcited by 3
- 2025SAO-Instruct: Free-form Audio Editing using Natural Language Instructionscited by 3
- 2025Step-by-Step Video-to-Audio Synthesis via Negative Audio Guidancecited by 2
- 2026TADA! Tuning Audio Diffusion Models through Activation Steeringcited by 2
- 2026Spectral-Aware Text-to-Time Series Generation with Billion-Scale Multimodal Meteorological Datacited by 1
- 2026FreeSonic: Training-Free Temporal-Aware Decoupled Attention for Precise Audio Editingcited by 1
- 2026RFM-Editing 2: Text-Guided Audio Editing with Rectified Flow Matching and Coarse-to-Fine Diffusion Transformerscited by 0
1 more
- 2026A Production-Oriented Framework for Evaluation of SFX Generation10 Jul 2026
- 2026RFM-Editing 2: Text-Guided Audio Editing with Rectified Flow Matching and Coarse-to-Fine Diffusion Transformers18 Jun 2026
- 2026FreeSonic: Training-Free Temporal-Aware Decoupled Attention for Precise Audio Editing13 Jun 2026
- 2026MMAE: A Massive Multitask Audio Editing Benchmark5 Jun 2026
- 2026Spectral-Aware Text-to-Time Series Generation with Billion-Scale Multimodal Meteorological Data28 Mar 2026
- 2026TADA! Tuning Audio Diffusion Models through Activation Steering12 Feb 2026
- 2025Coherent Audio-Visual Editing via Conditional Audio Generation Following Video Edits8 Dec 2025
- 2025SAO-Instruct: Free-form Audio Editing using Natural Language Instructions26 Oct 2025
- 2025Guiding Audio Editing with Audio Language Model25 Sep 2025
- 2025RFM-Editing: Rectified Flow Matching for Text-guided Audio Editing17 Sep 2025
- 2025Step-by-Step Video-to-Audio Synthesis via Negative Audio Guidance26 Jun 2025
- 2025Zero-Shot Audio-Visual Editing via Cross-Modal Delta Denoising26 Mar 2025
1 more
- 2025Judge Anything: MLLM as a Judge Across Any Modality21 Mar 2025
- 2025Guiding Audio Editing with Audio Language Modelcited by 11
- 2025RFM-Editing: Rectified Flow Matching for Text-guided Audio Editingcited by 3
- 2026TADA! Tuning Audio Diffusion Models through Activation Steeringcited by 2
- 2026RFM-Editing 2: Text-Guided Audio Editing with Rectified Flow Matching and Coarse-to-Fine Diffusion Transformerscited by 0
- 2026RFM-Editing 2: Text-Guided Audio Editing with Rectified Flow Matching and Coarse-to-Fine Diffusion Transformers18 Jun 2026
- 2026TADA! Tuning Audio Diffusion Models through Activation Steering12 Feb 2026
- 2025Guiding Audio Editing with Audio Language Model25 Sep 2025
- 2025RFM-Editing: Rectified Flow Matching for Text-guided Audio Editing17 Sep 2025
- 2025Judge Anything: MLLM as a Judge Across Any Modalitycited by 33
- 2025Zero-Shot Audio-Visual Editing via Cross-Modal Delta Denoisingcited by 13
- 2025Coherent Audio-Visual Editing via Conditional Audio Generation Following Video Editscited by 5
- 2026MMAE: A Massive Multitask Audio Editing Benchmarkcited by 5
- 2025SAO-Instruct: Free-form Audio Editing using Natural Language Instructionscited by 3
- 2025Step-by-Step Video-to-Audio Synthesis via Negative Audio Guidancecited by 2
- 2026Spectral-Aware Text-to-Time Series Generation with Billion-Scale Multimodal Meteorological Datacited by 1
- 2026FreeSonic: Training-Free Temporal-Aware Decoupled Attention for Precise Audio Editingcited by 1
- 2026A Production-Oriented Framework for Evaluation of SFX Generationcited by 0
- 2026A Production-Oriented Framework for Evaluation of SFX Generation10 Jul 2026
- 2026FreeSonic: Training-Free Temporal-Aware Decoupled Attention for Precise Audio Editing13 Jun 2026
- 2026MMAE: A Massive Multitask Audio Editing Benchmark5 Jun 2026
- 2026Spectral-Aware Text-to-Time Series Generation with Billion-Scale Multimodal Meteorological Data28 Mar 2026
- 2025Coherent Audio-Visual Editing via Conditional Audio Generation Following Video Edits8 Dec 2025
- 2025SAO-Instruct: Free-form Audio Editing using Natural Language Instructions26 Oct 2025
- 2025Step-by-Step Video-to-Audio Synthesis via Negative Audio Guidance26 Jun 2025
- 2025Zero-Shot Audio-Visual Editing via Cross-Modal Delta Denoising26 Mar 2025
- 2025Judge Anything: MLLM as a Judge Across Any Modality21 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2026DirectAudioEdit: Inversion-Free Text-Guided Audio Editing via Diffusion Prediction Contrast
- 2025AudioMorphix: Training-free audio editing with diffusion probabilistic models
- 2024SonicDiffusion: Audio-Driven Image Generation and Editing with Pretrained Diffusion Models
- 2026Unified Audio Generation and Editing via Joint Condition Modeling and Progressive Training ↗
- 2024PTQ4ADM: Post-Training Quantization for Efficient Text Conditional Audio Diffusion Models
- 2026SwiftAudio: Data-Efficient Caption-Only Distillation for One-Step Text-to-Audio Diffusion-based Generation
- 2025Virtual Consistency for Audio Editing
- 2024EzAudio: Enhancing Text-to-Audio Generation with Efficient Diffusion Transformer