mlsanityData to 14 Oct 2026

Audio Editing with Non-Rigid Text Prompts

arXiv 2310.12858 ↗First posted 19 Oct 2023cs.SD cs.LG eess.AScited by 8

Not on the map. Why?

Abstract (arXiv)

In this paper, we explore audio-editing with non-rigid text edits. We show that the proposed editing pipeline is able to create audio edits that remain faithful to the input audio. We explore text prompts that perform addition, style transfer, and in-painting. We quantitatively and qualitatively show that the edits are able to obtain results which outperform Audio-LDM, a recently released text-prompted audio generation model. Qualitative inspection of the results points out that the edits given by our approach remain more faithful to the input audio in terms of keeping the original onsets and offsets of the audio events.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 26 of its 30 references that are in the map. First posted on arXiv 19 Oct 2023.

Builds on

26 of 30 references.

References · 26

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  6. 2023Visual Instruction Tuningcited by 7,869
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  8. 2023QLoRA: Efficient Finetuning of Quantized LLMscited by 3,418
  9. 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
  10. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  11. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
  12. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
14 more
  1. 2020HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesiscited by 1,154
  2. 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,114
  3. 2023The Flan Collection: Designing Data and Methods for Effective Instruction Tuningcited by 739
  4. 2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 647
  5. 2023AudioLDM: Text-to-Audio Generation with Latent Diffusion Modelscited by 599
  6. 2023Simple and Controllable Music Generationcited by 488
  7. 2023AudioLDM 2: Learning Holistic Audio Generation with Self-supervised Pretrainingcited by 344
  8. 2023Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Modelscited by 324
  9. 2022AudioGen: Textually Guided Audio Generationcited by 295
  10. 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
  11. 2023LoftQ: LoRA-Fine-Tuning-Aware Quantization for Large Language Modelscited by 196
  12. 2023Text-to-Audio Generation using Instruction-Tuned LLM and Latent Diffusion Modelcited by 145
  13. 2022On the Effectiveness of Parameter-Efficient Fine-Tuningcited by 141
  14. 2023AUDIT: Audio Editing by Following Instructions with Latent Diffusion Modelscited by 83

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 2; 2025: 4; 2026: 2.

8 papers.

  1. 2024Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversioncited by 60
  2. 2024Taming Data and Transformers for Audio Generationcited by 28
  3. 2025FreeSliders: Training-Free, Modality-Agnostic Concept Sliders for Fine-Grained Diffusion Control in Images, Audio, and Videocited by 4
  4. 2025RFM-Editing: Rectified Flow Matching for Text-guided Audio Editingcited by 3
  5. 2025Melodia: Training-Free Music Editing Guided by Attention Probing in Diffusion Modelscited by 3
  6. 2025Virtual Consistency for Audio Editingcited by 0
  7. 2026AnchorSteer: Self-Discovered Concept Injection for Structure-Preserving Music Editingcited by 0
  8. 2026RFM-Editing 2: Text-Guided Audio Editing with Rectified Flow Matching and Coarse-to-Fine Diffusion Transformerscited by 0