mlsanityData to 14 Oct 2026

Speech Segmentation Optimization using Segmented Bilingual Speech Corpus for End-to-end Speech Translation

arXiv 2203.15479 ↗First posted 29 Mar 2022cs.CL cs.SD eess.AScited by 7

Not on the map. Why?

Abstract (arXiv)

Speech segmentation, which splits long speech into short segments, is essential for speech translation (ST). Popular VAD tools like WebRTC VAD have generally relied on pause-based segmentation. Unfortunately, pauses in speech do not necessarily match sentence boundaries, and sentences can be connected by a very short pause that is difficult to detect by VAD. In this study, we propose a speech segmentation method using a binary classification model trained using a segmented bilingual speech corpus. We also propose a hybrid method that combines VAD and the above speech segmentation method. Experimental results revealed that the proposed method is more suitable for cascade and end-to-end ST systems than conventional segmentation methods. The hybrid approach further improved the translation performance.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 9 of its 27 references that are in the map. First posted on arXiv 29 Mar 2022.

Builds on

9 of 27 references.

References · 9

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  3. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
  4. 2018ESPnet: End-to-End Speech Processing Toolkitcited by 558
  5. 2020ESPnet-ST: All-in-One Speech Translation Toolkitcited by 82
  6. 2020End-to-End Automatic Speech Recognition Integrated With CTC-Based Voice Activity Detectioncited by 20
  7. 2021Beyond Voice Activity Detection: Hybrid Audio Segmentation for Direct Speech Translationcited by 17
  8. 2021End-to-End Speech Translation with Pre-trained Models and Adapters: UPC at IWSLT 2021cited by 16
  9. 2021Segmenting Subtitles for Correcting ASR Segmentation Errorscited by 3

Built on by

Cited by year

Citing papers per year: 2023: 2; 2024: 2; 2025: 3.

7 papers.

  1. 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?cited by 17
  2. 2023Long-Form End-to-End Speech Translation via Latent Alignment Segmentationcited by 6
  3. 2023Long-form Simultaneous Speech Translation: Thesis Proposalcited by 3
  4. 2025How to Evaluate Speech Translation with Source-Aware Neural MT Metricscited by 3
  5. 2024Lightweight Audio Segmentation for Long-form Speech Translationcited by 1
  6. 2025Overcoming Latency Bottlenecks in On-Device Speech Translation: A Cascaded Approach with Alignment-Based Streaming MTcited by 0
  7. 2025DPO-Tuned Large Language Models for Segmentation in Simultaneous Speech Translationcited by 0