Sign-Language Datasets at Scale: A Comprehensive Survey on Resources, Benchmarks, and Annotation Standards
Not on the map. Why?
Abstract (arXiv)
Sign languages are expressive visual languages used by Deaf and Hard-of-Hearing (DHH) communities. Despite substantial progress in sign-language recognition, translation, and production, advances remain constrained by fragmented datasets, inconsistent annotations, and limited linguistic coverage. Existing benchmarks often fail to reflect real-world communication needs, and systematic analyses of these limitations remain limited. In this survey, we present a comprehensive index of sign-language datasets, covering 120 resources across 35 sign languages. We analyze key challenges such as modality imbalance, annotation granularity, and signer bias, and outline considerations for future dataset design. We also introduce a 24-field Sign-Language Datasheet and release a public GitHub repository (https://github.com/Ginqwerty/Open-Sign-Language) to support standardized documentation and reproducible evaluation. Overall, our work provides a unified and practical foundation for developing inclusive, robust, and scalable sign-language technologies in real-world applications.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 51 of its 134 references that are in the map. First posted on arXiv 28 Apr 2026.
Builds on
51 of 134 references.
References · 51
- 2020Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translationcited by 254
- 2019Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparisoncited by 217
- 2021Improving Sign Language Translation with Monolingual Data by Sign Back-Translationcited by 177
- 2020How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Languagecited by 172
- 2022Two-Stream Network for Sign Language Recognition and Translationcited by 122
- 2020Progressive Transformers for End-to-End Sign Language Productioncited by 119
- 2018MS-ASL: A Large-Scale Data Set and Benchmark for Understanding American Sign Languagecited by 118
- 2020BSL-1K: Scaling up co-articulated sign language recognition using mouthing cuescited by 106
- 2023Gloss-free Sign Language Translation: Improving from Visual-Language Pretrainingcited by 104
- 2018Video-based Sign Language Recognition without Temporal Segmentationcited by 88
- 2024LLMs are Good Sign Language Translatorscited by 76
- 2020AUTSL: A Large Scale Multi-modal Turkish Sign Language Dataset and Baseline Methodscited by 75
38 more
- 2023YouTube-ASL: A Large-Scale, Open-Domain American Sign Language-English Parallel Corpuscited by 74
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
- 2023SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understandingcited by 59
- 2020Adversarial Training for Multi-Channel Sign Language Productioncited by 57
- 2025Uni-Sign: Toward Unified Sign Language Understanding at Scalecited by 55
- 2024Towards Privacy-Aware Sign Language Translation at Scalecited by 42
- 2020Global-local Enhancement Network for NMFs-aware Sign Language Recognitioncited by 38
- 2020Watch, read and lookup: learning to spot signs from multiple supervisorscited by 35
- 2021Content4All Open Research Sign Language Translation Datasetscited by 30
- 2024T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Textcited by 30
- 2019Fingerspelling recognition in the wild with iterative visual attentioncited by 28
- 2023Improving Continuous Sign Language Recognition with Cross-Lingual Signscited by 27
- 2025Lost in Translation, Found in Context: Sign Language Translation with Contextual Cuescited by 25
- 2023Conditional Variational Autoencoder for Sign Language Translation with Cross-Modal Alignmentcited by 22
- 2018American Sign Language fingerspelling recognition in the wildcited by 20
- 2023Sign Language Translation with Iterative Prototypecited by 20
- 2020BosphorusSign22k Sign Language Recognition Datasetcited by 19
- 2024A Simple Baseline for Spoken Language to Sign Language Translation with 3D Avatarscited by 18
- 2024SignMusketeers: An Efficient Multi-Stream Approach for Sign Language Translation at Scalecited by 18
- 2024A Data-Driven Representation for Sign Language Productioncited by 17
- 2023Isolated Sign Language Recognition based on Tree Structure Skeleton Imagescited by 15
- 2023LSA64: An Argentinian Sign Language Datasetcited by 15
- 2022ASL Video Corpora & Sign Bank: Resources Available through the American Sign Language Linguistic Research Project (ASLLRP)cited by 10
- 2024Multi-Stream Keypoint Attention Network for Sign Language Recognition and Translationcited by 9
- 2024BdSLW60: A Word-Level Bangla Sign Language Datasetcited by 6
- 2024FSboard: Over 3 million characters of ASL fingerspelling collected via smartphonescited by 6
- 2025Sign Language Translation with Sentence Embedding Supervisioncited by 6
- 2022A Comprehensive Review of Sign Language Recognition: Different Types, Modalities, and Datasetscited by 5
- 2023RGB Arabic Alphabets Sign Language Datasetcited by 5
- 2024SignVTCL: Multi-Modal Continuous Sign Language Recognition Enhanced by Visual-Textual Contrastive Learningcited by 5
- 2024Improvement in Sign Language Translation Using Text CTC Alignmentcited by 5
- 2024Linguistics-Vision Monotonic Consistent Network for Sign Language Productioncited by 5
- 2020A New Dataset and Proposed Convolutional Neural Network Architecture for Classification of American Sign Language Digitscited by 4
- 2025BdSLW401: Transformer-Based Word-Level Bangla Sign Language Recognition Using Relative Quantization Encoding (RQE)cited by 4
- 2022A New 27 Class Sign Language Dataset Collected from 173 Individualscited by 3
- 2024Continuous Sign Language Recognition Based on Motor attention mechanism and frame-level Self-distillationcited by 3
- 2022ASL-Homework-RGBD Dataset: An annotated dataset of 45 fluent and non-fluent signers performing American Sign Language homeworkscited by 1
- 2024AzSLD: Azerbaijani Sign Language Dataset for Fingerspelling, Word, and Sentence Translation with Baseline Softwarecited by 1
50 most cited of 51 All 51 (JSON)
Built on by
Not cited yet.