mlsanityData to 7 Oct 2026

Titanic Calling: Low Bandwidth Video Conference from the Titanic Wreck

arXiv 2410.11434 ↗First posted 15 Oct 2024cs.CLcited by 1

Not on the map. Why?

Abstract (arXiv)

In this paper, we report on communication experiments conducted in the summer of 2022 during a deep dive to the wreck of the Titanic. Radio transmission is not possible in deep sea water, and communication links rely on sonar signals. Due to the low bandwidth of sonar signals and the need to communicate readable data, text messaging is used in deep-sea missions. In this paper, we report results and experiences from a messaging system that converts speech to text in a submarine, sends text messages to the surface, and reconstructs those messages as synthetic lip-synchronous videos of the speakers. The resulting system was tested during an actual dive to Titanic in the summer of 2022. We achieved an acceptable latency for a system of such complexity as well as good quality. The system demonstration video can be found at the following link: https://youtu.be/C4lyM86-5Ig

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 23 of its 26 references that are in the map. First posted on arXiv 15 Oct 2024.

Builds on

23 of 26 references.

References · 23

  1. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  2. 2022Generative Adversarial Networkscited by 5,603
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  4. 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
  5. 2017Billion-scale similarity search with GPUscited by 2,477
  6. 2014Conditional Generative Adversarial Netscited by 2,152
  7. 2020A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wildcited by 669
  8. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
  9. 2018Deep Audio-Visual Speech Recognitioncited by 318
  10. 2021YourTTS: Towards Zero-Shot Multi-Speaker TTS and Zero-Shot Voice Conversion for everyonecited by 277
  11. 2020MiniLMv2: Multi-Head Self-Attention Relation Distillation for Compressing Pretrained Transformerscited by 240
  12. 2019pyannote.audio: neural building blocks for speaker diarizationcited by 175
11 more
  1. 2023DiffTalk: Crafting Diffusion Models for Generalized Audio-Driven Portraits Animationcited by 136
  2. 2022VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wildcited by 106
  3. 2023Seeing What You Said: Talking Face Generation Guided by a Lip Reading Expertcited by 98
  4. 2023Identity-Preserving Talking Face Generation with Landmark and Appearance Priorscited by 97
  5. 2021End-to-end speaker segmentation for overlap-aware resegmentationcited by 76
  6. 2021Instant One-Shot Word-Learning for Context-Specific Neural Sequence-to-Sequence Speech Recognitioncited by 30
  7. 2022CUNI-KIT System for Simultaneous Speech Translation Task at IWSLT 2022cited by 30
  8. 2022Face-Dubbing++: Lip-Synchronous, Voice Preserving Translation of Videoscited by 18
  9. 2024Audio-Visual Speech Representation Expert for Enhanced Talking Face Video Generation and Evaluationcited by 17
  10. 2023Audio-driven Talking Face Generation with Stabilized Synchronization Losscited by 13
  11. 2023End-to-End Evaluation for Low-Latency Simultaneous Speech Translationcited by 10

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.

  1. 2025Assessing Identity Leakage in Talking Face Generation: Metrics and Evaluation Frameworkcited by 0