AST: Adaptive, Seamless, and Training-Free Precise Speech Editing
Not on the map. Why?
Abstract (arXiv)
Text-based speech editing aims to modify specific segments while preserving speaker identity and acoustic context. Current approaches generally involve either expensive task-specific training or adapting pre-trained Text-to-Speech (TTS) models. However, both paradigms face challenges: task-specific methods often degrade fidelity in unedited regions, whereas TTS adaptations struggle with a trade-off between editing naturalness and temporal fidelity. To address these issues, we propose AST, an Adaptive, Seamless, and Training-free speech editing framework. Built upon pre-trained TTS, AST leverages Latent Recomposition to stitch preserved source segments with synthesized targets, guaranteeing fidelity in unedited regions. To break the quality-controllability trade-off, we introduce Adaptive Weak Fact Guidance (AWFG), which modulates a mel-space signal to ensure seamless boundary transitions without disrupting the generative manifold. Furthermore, to address evaluation gaps in temporal fidelity, we propose a new benchmark suite: the LibriSpeech-Edit dataset and a novel metric, Word-level Dynamic Time Warping (WDTW). Extensive experiments demonstrate that AST consistently outperforms existing task-specific and fine-tuned speech editing methods across content accuracy, perceptual quality, speaker preservation, and temporal fidelity. Remarkably, AST achieves state-of-the-art zero-shot speech editing performance without any task-specific training or paired editing data, validating the effectiveness of latent recomposition and AWFG in bridging the quality-controllability trade-off.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 28 of its 32 references that are in the map. First posted on arXiv 17 Apr 2026.
Builds on
28 of 32 references.
References · 28
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2025Qwen3 Technical Reportcited by 8,820
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2017Natural TTS Synthesis by Conditioning WaveNet on Mel Spectrogram Predictionscited by 804
- 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
- 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 717
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 616
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
16 more
- 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 334
- 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 288
- 2023An Edit Friendly DDPM Noise Space: Inversion and Manipulationscited by 244
- 2020DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressorscited by 241
- 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 150
- 2024VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizerscited by 122
- 2024VoiceCraft: Zero-Shot Speech Editing and Text-to-Speech in the Wildcited by 120
- 2026Qwen3-ASR Technical Reportcited by 118
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
- 2025IndexTTS2: A Breakthrough in Emotionally Expressive and Duration-Controlled Auto-Regressive Zero-Shot Text-to-Speechcited by 90
- 2021EditSpeech: A Text Based Speech Editing System Using Partial Inference and Bidirectional Fusioncited by 32
- 2025IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech Systemcited by 28
- 2023FluentSpeech: Stutter-Oriented Automatic Speech Editing with Context-Aware Diffusion Modelscited by 23
- 2022CampNet: Context-Aware Mask Prediction for End-to-End Text-Based Speech Editingcited by 16
- 2024SSR-Speech: Towards Stable, Safe and Robust Zero-shot Text-based Speech Editing and Synthesiscited by 13
- 2025Step-Audio-EditX Technical Reportcited by 7
Built on by
Not cited yet.