mlsanityData to 7 Oct 2026

CNVSRC 2023: The First Chinese Continuous Visual Speech Recognition Challenge

arXiv 2406.10313 ↗First posted 14 Jun 2024cs.CL cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

The first Chinese Continuous Visual Speech Recognition Challenge aimed to probe the performance of Large Vocabulary Continuous Visual Speech Recognition (LVC-VSR) on two tasks: (1) Single-speaker VSR for a particular speaker and (2) Multi-speaker VSR for a set of registered speakers. The challenge yielded highly successful results, with the best submission significantly outperforming the baseline, particularly in the single-speaker task. This paper comprehensively reviews the challenge, encompassing the data profile, task specifications, and baseline system construction. It also summarises the representative techniques employed by the submitted systems, highlighting the most effective approaches. Additional information and resources about this challenge can be accessed through the official website at http://cnceleb.org/competition.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 14 Jun 2024.

Builds on

18 of 29 references.

References · 18

  1. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,973
  2. 2018VoxCeleb2: Deep Speaker Recognitioncited by 862
  3. 2017VoxCeleb: a large-scale speaker identification datasetcited by 714
  4. 2017How far are we from solving the 2D & 3D Face Alignment problem? (and a dataset of 230,000 3D facial landmarks)cited by 524
  5. 2018Deep Audio-Visual Speech Recognitioncited by 318
  6. 2019RetinaFace: Single-stage Dense Face Localisation in the Wildcited by 164
  7. 2021End-to-end Audio-visual Speech Recognition with Conformerscited by 147
  8. 2022Paraformer: Fast and Accurate Parallel Transformer for Non-autoregressive End-to-End Speech Recognitioncited by 139
  9. 2023Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labelscited by 113
  10. 2021Intermediate Loss Regularization for CTC-based Speech Recognitioncited by 95
  11. 2022Visual Speech Recognition for Multiple Languages in the Wildcited by 94
  12. 2022Branchformer: Parallel MLP-Attention Architectures to Capture Local and Global Context for Speech Recognition and Understandingcited by 90
6 more
  1. 2022E-Branchformer: Branchformer with Enhanced merging for speech recognitioncited by 90
  2. 2016LipNet: End-to-End Sentence-level Lipreadingcited by 79
  3. 2018Large-Scale Visual Speech Recognitioncited by 57
  4. 2018LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wildcited by 51
  5. 2022WeNet 2.0: More Productive End-to-End Speech Recognition Toolkitcited by 46
  6. 2020Lip-reading with Densely Connected Temporal Convolutional Networkscited by 26

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 3.

5 papers.

  1. 2024AlignVSR: Audio-Visual Cross-Modal Alignment for Visual Speech Recognitioncited by 4
  2. 2025CNVSRC 2024: The Second Chinese Continuous Visual Speech Recognition Challengecited by 1
  3. 2025Leveraging Large Language Models in Visual Speech Recognition: Model Scaling, Context-Aware Decoding, and Iterative Polishingcited by 1
  4. 2024Quantitative Analysis of Audio-Visual Tasks: An Information-Theoretic Perspectivecited by 0
  5. 2025VALLR-Pin: Uncertainty-Factorized Visual Speech Recognition for Mandarin with Pinyin Guidancecited by 0