mlsanityData to 7 Oct 2026

LRS3-TED: a large-scale dataset for visual speech recognition

arXiv 1809.00496 ↗First posted 3 Sep 2018cs.CVcited by 301

Not on the map. Why?

Abstract (arXiv)

This paper introduces a new multi-modal dataset for visual and audio-visual speech recognition. It includes face tracks from over 400 hours of TED and TEDx videos, along with the corresponding subtitles and word alignment boundaries. The new dataset is substantially larger in scale compared to other public datasets that are available for general research.

Key facts. Cited by 301 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Sep 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 21; 2022: 39; 2023: 79; 2024: 50; 2025: 69; 2026: 43.

301 papers.

Sort:

By area:

  1. 2022Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Predictioncited by 277
  2. 2021End-to-end Audio-visual Speech Recognition with Conformerscited by 147
  3. 2023GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesiscited by 131
  4. 2024DF40: Toward Next-Generation Deepfake Detectioncited by 126
  5. 2023Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labelscited by 113
  6. 2023Emotional Speech-Driven Animation with Content-Emotion Disentanglementcited by 98
  7. 2023Identity-Preserving Talking Face Generation with Landmark and Appearance Priorscited by 97
  8. 2022Visual Speech Recognition for Multiple Languages in the Wildcited by 94
  9. 2024Synchformer: Efficient Synchronization from Sparse Cuescited by 94
  10. 2023Self-Supervised Video Forensics by Audio-Visual Anomaly Detectioncited by 84
  11. 2024SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesiscited by 81
  12. 2024Natural Language Understanding and Inference with MLLM in Visual Question Answering: A Surveycited by 74
38 more
  1. 2022Robust Self-Supervised Audio-Visual Speech Recognitioncited by 72
  2. 2021Responsive Listening Head Generation: A Benchmark Dataset and Baselinecited by 67
  3. 2023SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Facescited by 67
  4. 2024Deepfake Generation and Detection: A Benchmark and Surveycited by 66
  5. 2023What Do Self-Supervised Speech Models Know About Words?cited by 62
  6. 2021Sub-word Level Lip Reading With Visual Attentioncited by 60
  7. 2024AVFF: Audio-Visual Feature Fusion for Video Deepfake Detectioncited by 59
  8. 2021Imitating Arbitrary Talking Style for Realistic Audio-DrivenTalking Face Synthesiscited by 56
  9. 2022Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videoscited by 50
  10. 2022Learning in Audio-visual Context: A Review, Analysis, and New Perspectivecited by 44
  11. 2021Deep Spoken Keyword Spotting: An Overviewcited by 43
  12. 2022Jointly Learning Visual and Auditory Speech Representations from Raw Datacited by 43
  13. 2023Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scoringcited by 42
  14. 2023GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generationcited by 42
  15. 2021LiRA: Learning Visual Speech Representations from Audio through Self-supervisioncited by 41
  16. 2024Large Language Models are Strong Audio-Visual Speech Recognition Learnerscited by 40
  17. 2021Audio-Visual Synchronisation in the wildcited by 39
  18. 2023MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translationcited by 39
  19. 2022u-HuBERT: Unified Mixed-Modal Speech Pretraining And Zero-Shot Transfer to Unlabeled Modalitycited by 36
  20. 2022SVTS: Scalable Video-to-Speech Synthesiscited by 35
  21. 2022VATLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learningcited by 34
  22. 2021The Right to Talk: An Audio-Visual Transformer Approachcited by 33
  23. 2024Lips Are Lying: Spotting the Temporal Inconsistency between Audio and Visual in Lip-Syncing DeepFakescited by 32
  24. 2024Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processingcited by 29
  25. 2022Transformer-Based Video Front-Ends for Audio-Visual Speech Recognition for Single and Multi-Person Videocited by 28
  26. 2023Intelligible Lip-to-Speech Synthesis with Speech Unitscited by 28
  27. 2021Looking into Your Speech: Learning Cross-modal Affinity for Audio-visual Speech Separationcited by 27
  28. 2023Multimodality Representation Learning: A Survey on Evolution, Pretraining and Its Applicationscited by 27
  29. 2025SpeakerVid-5M: A Large-Scale High-Quality Dataset for Audio-Visual Dyadic Interactive Human Generationcited by 27
  30. 2023FT2TF: First-Person Statement Text-To-Talking Face Generationcited by 26
  31. 2022Sparse in Space and Time: Audio-visual Synchronisation with Trainable Selectorscited by 25
  32. 2023AV-data2vec: Self-supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representationscited by 24
  33. 2025Multi-modal Time Series Analysis: A Tutorial and Surveycited by 24
  34. 2022Visual Context-driven Audio Feature Enhancement for Robust End-to-End Audio-Visual Speech Recognitioncited by 23
  35. 2022Training Strategies for Improved Lip-readingcited by 23
  36. 2024FlowAVSE: Efficient Audio-Visual Speech Enhancement with Conditional Flow Matchingcited by 23
  37. 2023Audio-Visual Efficient Conformer for Robust Speech Recognitioncited by 22
  38. 2023DiffV2S: Diffusion-based Video-to-Speech Synthesis with Vision-guided Speaker Embeddingcited by 22

50 most cited of 301 All 301 (JSON)