mlsanityData to 14 Oct 2026

Borderless Long Speech Synthesis

arXiv 2603.19798 ↗First posted 20 Mar 2026cs.SD cs.CL eess.AScited by 2

Not on the map. Why?

Abstract (arXiv)

Most existing text-to-speech (TTS) systems either synthesize speech sentence by sentence and stitch the results together, or drive synthesis from plain-text dialogues alone. Both approaches leave models with little understanding of global context or paralinguistic cues, making it hard to capture real-world phenomena such as multi-speaker interactions (interruptions, overlapping speech), evolving emotional arcs, and varied acoustic environments. We introduce the Borderless Long Speech Synthesis framework for agent-centric, borderless long audio synthesis. Rather than targeting a single narrow task, the system is designed as a unified capability set spanning VoiceDesigner, multi-speaker synthesis, Instruct TTS, and long-form text synthesis. On the data side, we propose a "Labeling over filtering/cleaning" strategy and design a top-down, multi-level annotation schema we call Global-Sentence-Token. On the model side, we adopt a backbone with a continuous tokenizer and add Chain-of-Thought (CoT) reasoning together with Dimension Dropout, both of which markedly improve instruction following under complex conditions. We further show that the system is Native Agentic by design: the hierarchical annotation doubles as a Structured Semantic Interface between the LLM Agent and the synthesis engine, creating a layered control protocol stack that spans from scene semantics down to phonetic detail. Text thereby becomes an information-complete, wide-band control channel, enabling a front-end LLM to convert inputs of any modality into structured generation commands, extending the paradigm from Text2Speech to borderless long speech synthesis.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 9 of its 16 references that are in the map. First posted on arXiv 20 Mar 2026.

Builds on

9 of 16 references.

References · 9

  1. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  2. 2016WaveNet: A Generative Model for Raw Audiocited by 1,722
  3. 2023Neural Codec Language Models are Zero-Shot Text to Speech Synthesizerscited by 752
  4. 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
  5. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
  6. 2017Tacotron: Towards End-to-End Speech Synthesiscited by 490
  7. 2024CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Modelscited by 288
  8. 2020DNSMOS: A Non-Intrusive Perceptual Objective Speech Quality metric to evaluate Noise Suppressorscited by 241
  9. 2024TouchTTS: An Embarrassingly Simple TTS Framework that Everyone Can Touchcited by 10

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2023A Vector Quantized Approach for Text to Speech Synthesis on Real-World Spontaneous Speech
  2. 2026Unified Synthesis of Compositional Speech and Sound from Free-Form Text Prompts
  3. 2026VoiceChat-TTS: A Low-Latency Continuous Speech Synthesis Model for Interactive Agents
  4. 2026TADA: A Generative Framework for Speech Modeling via Text-Acoustic Dual Alignment
  5. 2023High-Fidelity Speech Synthesis with Minimal Supervision: All Using Diffusion Models
  6. 2026Qwen-Audio-3.0-TTS: Freely Controllable and Highly Robust Speech Synthesis with Multi-Stage Training Paradigm
  7. 2021Low-Latency Incremental Text-to-Speech Synthesis with Distilled Context Prediction Network
  8. 2024CosyVoice: A Scalable Multilingual Zero-shot Text-to-speech Synthesizer based on Supervised Semantic Tokens