mlsanityData to 14 Oct 2026

CN-NewsTTS Bench: a target-level automatic benchmark for raw-input Chinese news TTS pronunciation

arXiv 2606.24714 ↗First posted 23 Jun 2026cs.CL cs.SD eess.AScited by 0

Not on the map. Why?

Abstract (arXiv)

Chinese news text contains dense written forms such as scores, hyphenated model names, ranges, unit symbols, percentages, English abbreviations, and mixed Chinese-Latin-digit names. These forms are frequent in real listening workflows, and a text-to-speech (TTS) system can preserve the written string while changing the spoken meaning. We introduce CN-NewsTTS Bench v0.1, an open target-level benchmark for evaluating whether Chinese news TTS products pronounce such targets correctly from raw text, without user-side rules, LLM rewriting, SSML hints, or manual edits. The release contains a 200-record development set, an 800-record public test set, 992 public auto-evaluable targets, fixed transcripts from a three-ASR ensemble, an automatic target scorer, and initial results for seven product TTS systems. We additionally report ASR-route diagnostics, ASR-subset ablations, category-level results, confidence intervals, and provider configuration metadata. The best system reaches 0.879 strict accuracy, while several systems remain below 0.60.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 5 of its 12 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

5 of 12 references.

References · 5

  1. 2019MOSNet: Deep Learning based Objective Assessment for Voice Conversioncited by 127
  2. 2023FunASR: A Fundamental End-to-End Speech Recognition Toolkitcited by 95
  3. 2016RNN Approaches to Text Normalization: A Challengecited by 30
  4. 2020g2pM: A Neural Grapheme-to-Phoneme Conversion Package for Mandarin Chinese Based on a New Open Benchmark Datasetcited by 15
  5. 2022An End-to-end Chinese Text Normalization Model based on Rule-guided Flat-Lattice Transformercited by 2

Built on by

Not cited yet.