CNVSRC 2024: The Second Chinese Continuous Visual Speech Recognition Challenge
Not on the map. Why?
Abstract (arXiv)
This paper presents the second Chinese Continuous Visual Speech Recognition Challenge (CNVSRC 2024), which builds on CNVSRC 2023 to advance research in Chinese Large Vocabulary Continuous Visual Speech Recognition (LVC-VSR). The challenge evaluates two test scenarios: reading in recording studios and Internet speech. CNVSRC 2024 uses the same datasets as its predecessor CNVSRC 2023, which involves CN-CVS for training and CNVSRC-Single/Multi for development and evaluation. However, CNVSRC 2024 introduced two key improvements: (1) a stronger baseline system, and (2) an additional dataset, CN-CVS2-P1, for open tracks to improve data volume and diversity. The new challenge has demonstrated several important innovations in data preprocessing, feature extraction, model design, and training strategies, further pushing the state-of-the-art in Chinese LVC-VSR. More details and resources are available at the official website.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 27 May 2025.
Builds on
20 of 28 references.
References · 20
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 424
- 2020Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery Detectioncited by 287
- 2022Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Predictioncited by 287
- 2023Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labelscited by 114
- 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 92
- 2017Combining Residual Networks with LSTMs for Lipreadingcited by 68
- 2018Large-Scale Visual Speech Recognitioncited by 57
- 2022MFA-Conformer: Multi-scale Feature Aggregation Conformer for Automatic Speaker Verificationcited by 47
- 2022Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Readingcited by 39
- 2022Transformer-Based Video Front-Ends for Audio-Visual Speech Recognition for Single and Multi-Person Videocited by 31
8 more
- 2021U2++: Unified Two-pass Bidirectional End-to-end Model for Speech Recognitioncited by 29
- 2022Training Strategies for Improved Lip-readingcited by 25
- 2022Structured State Space Decoder for Speech Recognition and Synthesiscited by 11
- 2023Multi-Temporal Lip-Audio Memory for Visual Speech Recognitioncited by 9
- 2024CNVSRC 2023: The First Chinese Continuous Visual Speech Recognition Challengecited by 5
- 2014Visual Speech Recognitioncited by 4
- 2024Enhancing Lip Reading with Multi-Scale Video and Multi-Encodercited by 4
- 2024The NPU-ASLP-LiAuto System Description for Visual Speech Recognition in CNVSRC 2023cited by 3
Built on by
Citing papers per year: 2025: 1.
1 paper.