mlsanityData to 7 Oct 2026

Speech-to-speech Translation between Untranscribed Unknown Languages

arXiv 1910.00795 ↗First posted 2 Oct 2019cs.CL cs.LG cs.SDcited by 27

Not on the map. Why?

Abstract (arXiv)

In this paper, we explore a method for training speech-to-speech translation tasks without any transcription or linguistic supervision. Our proposed method consists of two steps: First, we train and generate discrete representation with unsupervised term discovery with a discrete quantized autoencoder. Second, we train a sequence-to-sequence model that directly maps the source language speech to the target language's discrete representation. Our proposed method can directly generate target speech without any auxiliary or pre-training steps with a source or target transcription. To the best of our knowledge, this is the first work that performed pure speech-to-speech translation between untranscribed unknown languages.

Key facts. Cited by 27 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Oct 2019.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 6; 2022: 8; 2023: 7; 2024: 3; 2025: 3.

27 papers.

Sort:

By area:

  1. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 455
  2. 2023AudioPaLM: A Large Language Model That Can Speak and Listencited by 333
  3. 2021Direct speech-to-speech translation with discrete unitscited by 148
  4. 2021Textless Speech-to-Speech Translation on Real Datacited by 121
  5. 2022CVSS Corpus and Massively Multilingual Speech-to-Speech Translationcited by 71
  6. 2021Translatotron 2: High-quality direct speech-to-speech translation with voice preservationcited by 69
  7. 2022UnitY: Two-pass Direct Speech-to-speech Translation with Discrete Unitscited by 60
  8. 2022Enhanced Direct Speech-to-Speech Translation Using Self-supervised Pre-training and Data Augmentationcited by 43
  9. 2025Recent Advances in Discrete Speech Tokens: A Reviewcited by 42
  10. 2022Self-supervised language learning from raw audio: Lessons from the Zero Resource Speech Challengecited by 34
  11. 2022Speech-to-Speech Translation For A Real-world Unwritten Languagecited by 25
  12. 2022Leveraging unsupervised and weakly-supervised data to improve direct speech-to-speech translationcited by 20
15 more
  1. 2022Textless Direct Speech-to-Speech Translation with Discrete Speech Representationcited by 19
  2. 2023PolyVoice: Language Models for Speech to Speech Translationcited by 19
  3. 2023AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representationcited by 14
  4. 2023Translatotron 3: Speech to Speech Translation with Monolingual Datacited by 12
  5. 2022Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translationcited by 9
  6. 2023DASpeech: Directed Acyclic Transformer for Fast and High-quality Speech-to-Speech Translationcited by 9
  7. 2023AV-TranSpeech: Audio-Visual Robust Speech-to-Speech Translationcited by 6
  8. 2025When End-to-End is Overkill: Rethinking Cascaded Speech-to-Text Translationcited by 4
  9. 2021From Start to Finish: Latency Reduction Strategies for Incremental Speech Synthesis in Simultaneous Speech-to-Speech Translationcited by 3
  10. 2021Unsupervised Word Segmentation from Discrete Speech Units in Low-Resource Settingscited by 2
  11. 2024LLM-Ref: Enhancing Reference Handling in Technical Writing with Large Language Modelscited by 2
  12. 2023DiffS2UT: A Semantic Preserving Diffusion Model for Textless Direct Speech-to-Speech Translationcited by 1
  13. 2024SimulTron: On-Device Simultaneous Speech to Speech Translationcited by 1
  14. 2025Leveraging Unit Language Guidance to Advance Speech Modeling in Textless Speech-to-Speech Translationcited by 1
  15. 2024DiffNorm: Self-Supervised Normalization for Non-autoregressive Speech-to-speech Translationcited by 0