LRWR: Large-Scale Benchmark for Lip Reading in Russian language
Not on the map. Why?
Abstract (arXiv)
Lipreading, also known as visual speech recognition, aims to identify the speech content from videos by analyzing the visual deformations of lips and nearby areas. One of the significant obstacles for research in this field is the lack of proper datasets for a wide variety of languages: so far, these methods have been focused only on English or Chinese. In this paper, we introduce a naturally distributed large-scale benchmark for lipreading in Russian language, named LRWR, which contains 235 classes and 135 speakers. We provide a detailed description of the dataset collection pipeline and dataset statistics. We also present a comprehensive comparison of the current popular lipreading methods on LRWR and conduct a detailed analysis of their performance. The results demonstrate the differences between the benchmarked languages and provide several promising directions for lipreading models finetuning. Thanks to our findings, we also achieved new state-of-the-art results on the LRW benchmark.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 17 of its 24 references that are in the map. First posted on arXiv 14 Sep 2021.
Builds on
17 of 24 references.
References · 17
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,451
- 2017mixup: Beyond Empirical Risk Minimizationcited by 5,155
- 2017Improved Regularization of Convolutional Neural Networks with Cutoutcited by 1,623
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
- 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
- 2020ResNeSt: Split-Attention Networkscited by 445
- 2019Video Classification with Channel-Separated Convolutional Networkscited by 290
- 2020Lipreading using Temporal Convolutional Networkscited by 98
- 2017Combining Residual Networks with LSTMs for Lipreadingcited by 66
- 2018LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wildcited by 51
- 2018The PyTorch-Kaldi Speech Recognition Toolkitcited by 38
5 more
- 2020Deformation Flow Based Two-Stream Network for Lip Readingcited by 22
- 2020Learn an Effective Lip Reading Model without Painscited by 19
- 2019A Simple Dynamic Learning Rate Tuning Algorithm For Automated Training of DNNscited by 7
- 2018Towards Lipreading Sentences with Active Appearance Modelscited by 3
- 2020SpotFast Networks with Memory Augmented Lateral Transformers for Lipreadingcited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 2; 2025: 2.
5 papers.
- 2023A Multi-Purpose Audio-Visual Corpus for Multi-Modal Persian Speech Recognition: the Arman-AV Datasetcited by 4
- 2024Cross-Attention Fusion of Visual and Geometric Features for Large Vocabulary Arabic Lipreadingcited by 1
- 2024AnnoTheia: A Semi-Automatic Annotation Toolkit for Audio-Visual Speech Technologiescited by 1
- 2025Evaluation of End-to-End Continuous Spanish Lipreading in Different Data Conditionscited by 0
- 2025LRW-Persian: Lip-reading in the Wild Dataset for Persian Languagecited by 0
- 2025LRW-Persian: Lip-reading in the Wild Dataset for Persian Language26 Oct 2025
- 2025Evaluation of End-to-End Continuous Spanish Lipreading in Different Data Conditions1 Feb 2025
- 2024AnnoTheia: A Semi-Automatic Annotation Toolkit for Audio-Visual Speech Technologies20 Feb 2024
- 2024Cross-Attention Fusion of Visual and Geometric Features for Large Vocabulary Arabic Lipreading18 Feb 2024
- 2023A Multi-Purpose Audio-Visual Corpus for Multi-Modal Persian Speech Recognition: the Arman-AV Dataset21 Jan 2023