Edit Content, Preserve Acoustics: Imperceptible Text-Based Speech Editing via Self-Consistency Rewards
Not on the map. Why?
Abstract (arXiv)
Imperceptible text-based speech editing modifies spoken content through transcript manipulation while preserving acoustic continuity. Prior acoustic-space approaches suffer from content-style entanglement, causing unstable generation and boundary artifacts. We introduce a framework guided by the principle of "Edit Content, Preserve Acoustics". Editing is conducted in a stable semantic space, while acoustic realization is handled by a Flow Matching decoder. To ensure perceptual consistency, we propose Self-Consistency Rewards Group Relative Policy Optimization, which leverages a pre-trained Text-to-Speech model as an implicit critic, together with intelligibility and duration constraints. Experiments demonstrate consistent improvements over state-of-the-art autoregressive and non-autoregressive baselines in intelligibility, robustness, and perceptual quality.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). First posted on arXiv 31 Jan 2026.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Fish Audio Drama 3 Technical Reportcited by 0
- 2026Fish Audio Drama 3 Technical Report13 Oct 2026
Similar, not cited
Close in wording, no citation either way
- 2021EdiTTS: Score-based Editing for Controllable Text-to-Speech
- 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing
- 2025Speak, Edit, Repeat: High-Fidelity Voice Editing and Zero-Shot TTS with Cross-Attentive Mamba
- 2025Optimizing Speech Language Models for Acoustic Consistency
- 2026Multi Codec Discrete Diffusion Model for Text Guided Speech Inpainting and Editing
- 2026SEmoEdit: Probing and Harnessing the Editability of Pre-trained Speech Flows
- 2025SAO-Instruct: Free-form Audio Editing using Natural Language Instructions
- 2024On the Semantic Latent Space of Diffusion-Based Text-to-Speech Models