MMEDIT: A Unified Framework for Multi-Type Audio Editing via Audio Language Model
Not on the map. Why?
Abstract (arXiv)
Text-guided audio editing aims to modify specific acoustic events while strictly preserving non-target content. Despite recent progress, existing approaches remain fundamentally limited. Training-free methods often suffer from signal degradation caused by diffusion inversion, while training-based methods, although achieving higher generation quality, are severely constrained by the scarcity of high-quality paired data and task formulations that cover only a narrow subset of editing operations. In addition, standard architectures typically decouple text and audio processing, limiting the ability to align instructions with specific acoustic contexts. To address these challenges, we propose MMEdit, an audio-language-model-driven framework for unified audio editing. We systematically extend task definitions to cover a comprehensive range of editing operations, including addition, replacement, removal, reordering, and attribute modification. Furthermore, we design a scalable data synthesis pipeline to construct large-scale paired datasets with fine-grained event-level annotations. To capture complex editing semantics, we integrate a Qwen2-Audio encoder with an MMDiT-based generator, enabling precise cross-modal alignment and localized editing. Experimental results demonstrate that our method achieves superior editing localization accuracy, robust instruction following, and high fidelity in non-edited regions.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Dec 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026Audio-Omni: Extending Multi-modal Understanding to Versatile Audio Generation and Editingcited by 10
- 2026MMAE: A Massive Multitask Audio Editing Benchmarkcited by 5
- 2026UNISON: A Unified Sound Generation and Editing Framework via Deep LLM Fusioncited by 1
- 2026FreeSonic: Training-Free Temporal-Aware Decoupled Attention for Precise Audio Editingcited by 1
- 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editingcited by 1
- 2026RFM-Editing 2: Text-Guided Audio Editing with Rectified Flow Matching and Coarse-to-Fine Diffusion Transformerscited by 0
- 2026TORUS: A Test of Rendering-Understanding Self-Coherence for Unified Audio Modelscited by 0
- 2026dots.tts.edit: Precisely Controlled Speech Editing with a Continuous Autoregressive Modelcited by 0
- 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing8 Sep 2026
- 2026dots.tts.edit: Precisely Controlled Speech Editing with a Continuous Autoregressive Model2 Aug 2026
- 2026TORUS: A Test of Rendering-Understanding Self-Coherence for Unified Audio Models30 Jul 2026
- 2026RFM-Editing 2: Text-Guided Audio Editing with Rectified Flow Matching and Coarse-to-Fine Diffusion Transformers18 Jun 2026
- 2026FreeSonic: Training-Free Temporal-Aware Decoupled Attention for Precise Audio Editing13 Jun 2026
- 2026MMAE: A Massive Multitask Audio Editing Benchmark5 Jun 2026
- 2026UNISON: A Unified Sound Generation and Editing Framework via Deep LLM Fusion29 May 2026
- 2026Audio-Omni: Extending Multi-modal Understanding to Versatile Audio Generation and Editing12 Apr 2026