Is 42 the Answer to Everything in Subtitling-oriented Speech Translation?
Not on the map. Why?
Abstract (arXiv)
Subtitling is becoming increasingly important for disseminating information, given the enormous amounts of audiovisual content becoming available daily. Although Neural Machine Translation (NMT) can speed up the process of translating audiovisual content, large manual effort is still required for transcribing the source language, and for spotting and segmenting the text into proper subtitles. Creating proper subtitles in terms of timing and segmentation highly depends on information present in the audio (utterance duration, natural pauses). In this work, we explore two methods for applying Speech Translation (ST) to subtitling: a) a direct end-to-end and b) a classical cascade approach. We discuss the benefit of having access to the source language speech for improving the conformity of the generated subtitles to the spatial and temporal subtitling constraints and show that length is not the answer to everything in the case of subtitling-oriented ST.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Jun 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 5; 2023: 3; 2024: 5; 2025: 2; 2026: 1.
21 papers.
Sort:
- 2021Isometric MT: Neural Machine Translation for Automatic Dubbingcited by 18
- 2021Beyond Voice Activity Detection: Hybrid Audio Segmentation for Direct Speech Translationcited by 17
- 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?cited by 17
- 2021Isochrony-Aware Neural Machine Translation for Automatic Dubbingcited by 14
- 2022SubER: A Metric for Automatic Evaluation of Subtitle Qualitycited by 9
- 2021Simultaneous Speech Translation for Live Subtitling: from Delay to Displaycited by 8
- 2021Between Flexibility and Consistency: Joint Generation of Captions and Subtitlescited by 7
- 2022Direct Speech Translation for Automatic Subtitlingcited by 7
- 2023Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT2023cited by 6
- 2022Joint Generation of Captions and Subtitles with Dual Decodingcited by 5
- 2022Dodging the Data Bottleneck: Automatic Subtitling with Automatically Segmented ST Corporacited by 5
- 2024Lyrics Transcription for Humans: A Readability-Aware Benchmarkcited by 5
9 more
- 2022Evaluating Subtitle Segmentation for End-to-end Generation Systemscited by 4
- 2024Automating Easy Read Text Segmentationcited by 3
- 2023Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmarkcited by 2
- 2025Prompting LLMs: Length Control for Isometric Machine Translationcited by 2
- 2024SBAAM! Eliminating Transcript Dependency in Automatic Subtitlingcited by 1
- 2024IsoChronoMeter: A simple and effective isochronic translation evaluation metriccited by 1
- 2025Length Aware Speech Translation for Video Dubbingcited by 1
- 2023Evaluating the Efficacy of Length-Controllable Machine Translationcited by 0
- 2026HOMURA: Taming the Sand-Glass for Time-Constrained LLM Translation via Reinforcement Learningcited by 0
- 2026HOMURA: Taming the Sand-Glass for Time-Constrained LLM Translation via Reinforcement Learning15 Jan 2026
- 2025Prompting LLMs: Length Control for Isometric Machine Translation5 Jun 2025
- 2025Length Aware Speech Translation for Video Dubbing31 May 2025
- 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?24 Dec 2024
- 2024IsoChronoMeter: A simple and effective isochronic translation evaluation metric14 Oct 2024
- 2024Lyrics Transcription for Humans: A Readability-Aware Benchmark30 Jul 2024
- 2024Automating Easy Read Text Segmentation17 Jun 2024
- 2024SBAAM! Eliminating Transcript Dependency in Automatic Subtitling17 May 2024
- 2023Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark23 Nov 2023
- 2023Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT202327 Sep 2023
- 2023Evaluating the Efficacy of Length-Controllable Machine Translation3 May 2023
- 2022Direct Speech Translation for Automatic Subtitling27 Sep 2022
9 more
- 2022Dodging the Data Bottleneck: Automatic Subtitling with Automatically Segmented ST Corpora21 Sep 2022
- 2022Evaluating Subtitle Segmentation for End-to-end Generation Systems19 May 2022
- 2022Joint Generation of Captions and Subtitles with Dual Decoding13 May 2022
- 2022SubER: A Metric for Automatic Evaluation of Subtitle Quality11 May 2022
- 2021Isometric MT: Neural Machine Translation for Automatic Dubbing16 Dec 2021
- 2021Isochrony-Aware Neural Machine Translation for Automatic Dubbing16 Dec 2021
- 2021Simultaneous Speech Translation for Live Subtitling: from Delay to Display19 Jul 2021
- 2021Between Flexibility and Consistency: Joint Generation of Captions and Subtitles13 Jul 2021
- 2021Beyond Voice Activity Detection: Hybrid Audio Segmentation for Direct Speech Translation23 Apr 2021
- 2021Isometric MT: Neural Machine Translation for Automatic Dubbingcited by 18
- 2021Beyond Voice Activity Detection: Hybrid Audio Segmentation for Direct Speech Translationcited by 17
- 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?cited by 17
- 2021Isochrony-Aware Neural Machine Translation for Automatic Dubbingcited by 14
- 2022SubER: A Metric for Automatic Evaluation of Subtitle Qualitycited by 9
- 2021Simultaneous Speech Translation for Live Subtitling: from Delay to Displaycited by 8
- 2021Between Flexibility and Consistency: Joint Generation of Captions and Subtitlescited by 7
- 2022Direct Speech Translation for Automatic Subtitlingcited by 7
- 2023Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT2023cited by 6
- 2022Joint Generation of Captions and Subtitles with Dual Decodingcited by 5
- 2022Dodging the Data Bottleneck: Automatic Subtitling with Automatically Segmented ST Corporacited by 5
- 2024Lyrics Transcription for Humans: A Readability-Aware Benchmarkcited by 5
12 most cited of 21 All 21 (JSON)
- 2026HOMURA: Taming the Sand-Glass for Time-Constrained LLM Translation via Reinforcement Learning15 Jan 2026
- 2025Prompting LLMs: Length Control for Isometric Machine Translation5 Jun 2025
- 2025Length Aware Speech Translation for Video Dubbing31 May 2025
- 2024How "Real" is Your Real-Time Simultaneous Speech-to-Text Translation System?24 Dec 2024
- 2024IsoChronoMeter: A simple and effective isochronic translation evaluation metric14 Oct 2024
- 2024Lyrics Transcription for Humans: A Readability-Aware Benchmark30 Jul 2024
- 2024Automating Easy Read Text Segmentation17 Jun 2024
- 2024SBAAM! Eliminating Transcript Dependency in Automatic Subtitling17 May 2024
- 2023Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark23 Nov 2023
- 2023Direct Models for Simultaneous Translation and Automatic Subtitling: FBK@IWSLT202327 Sep 2023
- 2023Evaluating the Efficacy of Length-Controllable Machine Translation3 May 2023
- 2022Direct Speech Translation for Automatic Subtitling27 Sep 2022
12 newest of 21 All 21 (JSON)