mlsanityData to 14 Oct 2026

Step-Audio-EditX Technical Report

arXiv 2511.03601 ↗First posted 5 Nov 2025cs.CL cs.AI cs.HCcited by 7

Not on the map. Why?

Abstract (arXiv)

We present Step-Audio-EditX, the first open-source LLM-based audio model excelling at expressive and iterative audio editing encompassing emotion, speaking style, and paralinguistics alongside robust zero-shot text-to-speech (TTS) capabilities. Our core innovation lies in leveraging only large-margin synthetic data, which circumvents the need for embedding-based priors or auxiliary modules. This large-margin learning approach enables both iterative control and high expressivity across voices, and represents a fundamental pivot from the conventional focus on representation-level disentanglement. Evaluation results demonstrate that Step-Audio-EditX surpasses both MiniMax-2.6-hd and Doubao-Seed-TTS-2.0 in emotion editing and other fine-grained control tasks.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 30 of its 32 references that are in the map. First posted on arXiv 5 Nov 2025.

Builds on

30 of 32 references.

References · 30

  1. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
  2. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 467
  3. 2023Voicebox: Text-Guided Multilingual Universal Speech Generation at Scalecited by 379
  4. 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 361
  5. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokenscited by 334
  6. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 300
  7. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 288
  8. 2022BigVGAN: A Universal Neural Vocoder with Large-Scale Trainingcited by 251
  9. 2024NaturalSpeech 3: Zero-Shot Speech Synthesis with Factorized Codec and Diffusion Modelscited by 226
  10. 2024MaskGCT: Zero-Shot Text-to-Speech with Masked Generative Codec Transformercited by 161
  11. 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 150
  12. 2023Matcha-TTS: A fast TTS architecture with conditional flow matchingcited by 145
18 more
  1. 2024VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizerscited by 122
  2. 2025Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokenscited by 113
  3. 2025Step-Audio: Unified Understanding and Generation in Intelligent Speech Interactioncited by 83
  4. 2024FireRedTTS: A Foundation Text-To-Speech Framework for Industry-Level Generative Speech Applicationscited by 68
  5. 2024Autoregressive Speech Synthesis without Vector Quantizationcited by 65
  6. 2025DiTAR: Diffusion Transformer Autoregressive Modeling for Speech Generationcited by 57
  7. 2023VoiceFlow: Efficient Text-to-Speech with Rectified Flow Matchingcited by 49
  8. 2024WenetSpeech4TTS: A 12,800-hour Mandarin TTS Corpus for Large Speech Generation Model Benchmarkcited by 40
  9. 2023DDDM-VC: Decoupled Denoising Diffusion Models with Disentangled Representation and Prior Mixup for Verified Robust Voice Conversioncited by 38
  10. 2025FireRedTTS-2: Towards Long Conversational Speech Generation for Podcast and Chatbotcited by 35
  11. 2024GLOBE: A High-quality English Corpus with Global Accents for Zero-shot Speaker Adaptive Text-to-Speechcited by 30
  12. 2025IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech Systemcited by 28
  13. 2025F5R-TTS: Improving Flow-Matching based Text-to-Speech with Group Relative Policy Optimizationcited by 24
  14. 2021Cross-speaker emotion disentangling and transfer for end-to-end speech synthesiscited by 21
  15. 2025NVSpeech: An Integrated and Scalable Pipeline for Human-Like Speech Modeling with Paralinguistic Vocalizationscited by 15
  16. 2022Zero-Shot Accent Conversion using Pseudo Siamese Disentanglement Networkcited by 7
  17. 2024VoiceShop: A Unified Speech-to-Speech Framework for Identity-Preserving Zero-Shot Voice Editingcited by 7
  18. 2024Speaking in Wavelet Domain: A Simple and Efficient Approach to Speed up Speech Diffusion Modelcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

  1. 2026NV-Bench: Benchmark of Nonverbal Vocalization Synthesis for Expressive Text-to-Speech Generationcited by 6
  2. 2026MMAE: A Massive Multitask Audio Editing Benchmarkcited by 5
  3. 2026Audio-Visual Intelligence in Large Foundation Modelscited by 2
  4. 2026VoiceDesigner: Text-to-Voice Generation and Editing via Unified Diffusion Modeling and Data Augmentationcited by 1
  5. 2026AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editingcited by 1
  6. 2026AST: Adaptive, Seamless, and Training-Free Precise Speech Editingcited by 0
  7. 2026SEmoEdit: Probing and Harnessing the Editability of Pre-trained Speech Flowscited by 0