mlsanityData to 7 Oct 2026

A Hong Kong Sign Language Corpus Collected from Sign-interpreted TV News

arXiv 2405.00980 ↗First posted 2 May 2024cs.CL cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

This paper introduces TVB-HKSL-News, a new Hong Kong sign language (HKSL) dataset collected from a TV news program over a period of 7 months. The dataset is collected to enrich resources for HKSL and support research in large-vocabulary continuous sign language recognition (SLR) and translation (SLT). It consists of 16.07 hours of sign videos of two signers with a vocabulary of 6,515 glosses (for SLR) and 2,850 Chinese characters or 18K Chinese words (for SLT). One signer has 11.66 hours of sign videos and the other has 4.41 hours. One objective in building the dataset is to support the investigation of how well large-vocabulary continuous sign language recognition/translation can be done for a single signer given a (relatively) large amount of his/her training data, which could potentially lead to the development of new modeling methods. Besides, most parts of the data collection pipeline are automated with little human intervention; we believe that our collection method can be scaled up to collect more sign language data easily for SLT in the future for any sign languages if such sign-interpreted videos are available. We also run a SOTA SLR/SLT model on the dataset and get a baseline SLR word error rate of 34.08% and a baseline SLT BLEU-4 score of 23.58 for benchmarking future research on the dataset.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 26 of its 45 references that are in the map. First posted on arXiv 2 May 2024.

Builds on

26 of 45 references.

References · 26

  1. 2017Attention Is All You Needcited by 59,932
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  5. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  6. 2019Deep High-Resolution Representation Learning for Human Pose Estimationcited by 1,339
  7. 2017Rethinking Spatiotemporal Feature Learning: Speed-Accuracy Trade-offs in Video Classificationcited by 521
  8. 2019Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparisoncited by 217
  9. 2016Temporal Convolutional Networks: A Unified Approach to Action Segmentationcited by 199
  10. 2020Whole-Body Human Pose Estimation in the Wildcited by 178
  11. 2021Improving Sign Language Translation with Monolingual Data by Sign Back-Translationcited by 177
  12. 2018QANet: Combining Local Convolution with Global Self-Attention for Reading Comprehensioncited by 164
14 more
  1. 2022Two-Stream Network for Sign Language Recognition and Translationcited by 122
  2. 2018MS-ASL: A Large-Scale Data Set and Benchmark for Understanding American Sign Languagecited by 118
  3. 2020BSL-1K: Scaling up co-articulated sign language recognition using mouthing cuescited by 106
  4. 2021Skeleton Aware Multi-modal Sign Language Recognitioncited by 101
  5. 2018Video-based Sign Language Recognition without Temporal Segmentationcited by 88
  6. 2020AUTSL: A Large Scale Multi-modal Turkish Sign Language Dataset and Baseline Methodscited by 75
  7. 2020Spatial-Temporal Multi-Cue Network for Continuous Sign Language Recognitioncited by 74
  8. 2018Neural Sign Language Translation based on Human Keypoint Estimationcited by 65
  9. 2020Watch, read and lookup: learning to spot signs from multiple supervisorscited by 35
  10. 2020BosphorusSign22k Sign Language Recognition Datasetcited by 19
  11. 2019Is Word Segmentation Necessary for Deep Learning of Chinese Representations?cited by 18
  12. 2024Towards Online Continuous Sign Language Recognition and Translationcited by 13
  13. 2018Chinese Lexical Analysis with Deep Bi-GRU-CRF Networkcited by 9
  14. 2021Towards Automatic Speech to Sign Language Generationcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 1; 2026: 2.

6 papers.

  1. 2024YouTube-SL-25: A Large-Scale, Open-Domain Multilingual Sign Language Parallel Corpuscited by 36
  2. 2024Signs as Tokens: A Retrieval-Enhanced Multilingual Sign Language Generatorcited by 20
  3. 2025Isharah: A Large-Scale Multi-Scene Dataset for Continuous Sign Language Recognitioncited by 6
  4. 2026MaDiS: Taming Masked Diffusion Language Models for Sign Language Generationcited by 3
  5. 2024A Chinese Continuous Sign Language Dataset Based on Complex Environmentscited by 2
  6. 2026Think in Latent Thoughts: A New Paradigm for Gloss-Free Sign Language Translationcited by 1