mlsanityData to 7 Oct 2026

Towards Speech Dialogue Translation Mediating Speakers of Different Languages

arXiv 2305.09210 ↗First posted 16 May 2023cs.CLcited by 4

Not on the map. Why?

Abstract (arXiv)

We present a new task, speech dialogue translation mediating speakers of different languages. We construct the SpeechBSD dataset for the task and conduct baseline experiments. Furthermore, we consider context to be an important aspect that needs to be addressed in this task and propose two ways of utilizing context, namely monolingual context and bilingual context. We conduct cascaded speech translation experiments using Whisper and mBART, and show that bilingual context performs better in our settings.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 12 of its 22 references that are in the map. First posted on arXiv 16 May 2023.

Builds on

12 of 22 references.

References · 12

  1. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 3,972
  2. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  3. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  4. 2019fairseq: A Fast, Extensible Toolkit for Sequence Modelingcited by 1,486
  5. 2020Multilingual Denoising Pre-training for Neural Machine Translationcited by 1,028
  6. 2016Listen and Translate: A Proof of Concept for End-to-End Speech-to-Text Translationcited by 113
  7. 2022MAESTRO: Matched Speech Text Representations through Modality Matchingcited by 79
  8. 2021Cascade versus Direct Speech Translation: Do the Differences Still Make a Difference?cited by 54
  9. 2020Designing the Business Conversation Corpuscited by 14
  10. 2021Towards Making the Most of Dialogue Characteristics for Neural Chat Translationcited by 12
  11. 2022Does Joint Training Really Help Cascaded Speech Translation?cited by 5
  12. 2021VAD-free Streaming Hybrid CTC/Attention ASR for Unsegmented Recordingcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 0; 2026: 3.

4 papers.

  1. 2024MELD-ST: An Emotion-aware Speech Translation Datasetcited by 4
  2. 2026Dial HEALTHDIAL for Advice: A Multilingual and Multi-Parallel Spoken Dialogue Dataset for Knowledge-Grounded Information Seekingcited by 0
  3. 2026Evaluating Japanese Dialect Robustness Across Speech and Text-based Large Language Modelscited by 0
  4. 2026Does Translation-Enhanced Speech Encoder Pre-training Affect Speech LLMs?cited by 0