Content4All Open Research Sign Language Translation Datasets
Not on the map. Why?
Abstract (arXiv)
Computational sign language research lacks the large-scale datasets that enables the creation of useful reallife applications. To date, most research has been limited to prototype systems on small domains of discourse, e.g. weather forecasts. To address this issue and to push the field forward, we release six datasets comprised of 190 hours of footage on the larger domain of news. From this, 20 hours of footage have been annotated by Deaf experts and interpreters and is made publicly available for research purposes. In this paper, we share the dataset collection process and tools developed to enable the alignment of sign language video and subtitles, as well as baseline translation results to underpin future research.
Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Builds on 13 of its 43 references that are in the map. First posted on arXiv 5 May 2021.
Builds on
13 of 43 references.
References · 13
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,475
- 2020Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translationcited by 256
- 2019The VIA Annotation Software for Images, Audio and Videocited by 167
- 2020Progressive Transformers for End-to-End Sign Language Productioncited by 120
- 2018MS-ASL: A Large-Scale Data Set and Benchmark for Understanding American Sign Languagecited by 118
- 2020Spatial-Temporal Multi-Cue Network for Continuous Sign Language Recognitioncited by 74
- 2020Multi-channel Transformers for Multi-articulatory Sign Language Translationcited by 71
- 2020Adversarial Training for Multi-Channel Sign Language Productioncited by 57
- 2020Quantitative Survey of the State of the Art in Sign Language Recognitioncited by 50
- 2019Single-Network Whole-Body Pose Estimationcited by 24
Built on by
Citing papers per year: 2021: 4; 2022: 4; 2023: 8; 2024: 5; 2025: 7; 2026: 2.
30 papers.
Sort:
By area:
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 130
- 2023YouTube-ASL: A Large-Scale, Open-Domain American Sign Language-English Parallel Corpuscited by 75
- 2022Open-Domain Sign Language Translation Learned from Online Videocited by 72
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
- 2025Uni-Sign: Toward Unified Sign Language Understanding at Scalecited by 56
- 2021Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitivescited by 50
- 2023Sign Language Translation from Instructional Videoscited by 39
- 2024T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Textcited by 30
- 2021BBC-Oxford British Sign Language Datasetcited by 28
- 2022Machine Translation from Signed to Spoken Languages: State of the Art and Challengescited by 20
- 2022Automatic dense annotation of large-vocabulary sign language videoscited by 20
- 2023JWSign: A Highly Multilingual Corpus of Bible Translations for more Diversity in Sign Language Processingcited by 18
18 more
- 2021AnonySIGN: Novel Human Appearance Synthesis for Sign Language Video Anonymisationcited by 16
- 2023Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discoursecited by 15
- 2025Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language Translationcited by 12
- 2021Skeletal Graph Self-Attention: Embedding a Skeleton Inductive Bias into Sign Language Productioncited by 11
- 2023A New Dataset for End-to-End Sign Language Translation: The Greek Elementary School Datasetcited by 6
- 2024iSign: A Benchmark for Indian Sign Language Processingcited by 6
- 2025Deep Understanding of Sign Language for Sign to Subtitle Alignmentcited by 6
- 2025Isharah: A Large-Scale Multi-Scene Dataset for Continuous Sign Language Recognitioncited by 6
- 2024Reconsidering Sentence-Level Sign Language Translationcited by 4
- 2023ISLTranslate: Dataset for Translating Indian Sign Languagecited by 2
- 2023Toward American Sign Language Processing in the Real World: Data, Tasks, and Methodscited by 1
- 2024E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methodscited by 1
- 2025MultimodalHugs: Enabling Sign Language Processing in Hugging Facecited by 1
- 2024SkelCap: Automated Generation of Descriptive Text from Skeleton Keypoint Sequencescited by 0
- 2025Co-creation for Sign Language Processing and Machine Translationcited by 0
- 2025Seeing, Signing, and Saying: A Vision-Language Model-Assisted Pipeline for Sign Language Data Acquisition and Curation from Social Mediacited by 0
- 2026Sign-Language Datasets at Scale: A Comprehensive Survey on Resources, Benchmarks, and Annotation Standardscited by 0
- 2026OneSign: Unifying Sign Language Understanding Tasks with One Modelcited by 0
- 2026OneSign: Unifying Sign Language Understanding Tasks with One Model27 Sep 2026
- 2026Sign-Language Datasets at Scale: A Comprehensive Survey on Resources, Benchmarks, and Annotation Standards28 Apr 2026
- 2025Seeing, Signing, and Saying: A Vision-Language Model-Assisted Pipeline for Sign Language Data Acquisition and Curation from Social Media29 Oct 2025
- 2025MultimodalHugs: Enabling Sign Language Processing in Hugging Face10 Sep 2025
- 2025Isharah: A Large-Scale Multi-Scene Dataset for Continuous Sign Language Recognition4 Jun 2025
- 2025Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language Translation30 May 2025
- 2025Deep Understanding of Sign Language for Sign to Subtitle Alignment5 Mar 2025
- 2025Co-creation for Sign Language Processing and Machine Translation3 Mar 2025
- 2025Uni-Sign: Toward Unified Sign Language Understanding at Scale25 Jan 2025
- 2024iSign: A Benchmark for Indian Sign Language Processing7 Jul 2024
- 2024Reconsidering Sentence-Level Sign Language Translation16 Jun 2024
- 2024T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text11 Jun 2024
18 more
- 2024E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methods5 May 2024
- 2024SkelCap: Automated Generation of Descriptive Text from Skeleton Keypoint Sequences5 May 2024
- 2023JWSign: A Highly Multilingual Corpus of Bible Translations for more Diversity in Sign Language Processing16 Nov 2023
- 2023A New Dataset for End-to-End Sign Language Translation: The Greek Elementary School Dataset7 Oct 2023
- 2023Toward American Sign Language Processing in the Real World: Data, Tasks, and Methods23 Aug 2023
- 2023Is context all you need? Scaling Neural Sign Language Translation to Large Domains of Discourse18 Aug 2023
- 2023ISLTranslate: Dataset for Translating Indian Sign Language11 Jul 2023
- 2023YouTube-ASL: A Large-Scale, Open-Domain American Sign Language-English Parallel Corpus27 Jun 2023
- 2023Sign Language Translation from Instructional Videos13 Apr 2023
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformer28 Mar 2023
- 2022Automatic dense annotation of large-vocabulary sign language videos4 Aug 2022
- 2022Open-Domain Sign Language Translation Learned from Online Video25 May 2022
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production29 Mar 2022
- 2022Machine Translation from Signed to Spoken Languages: State of the Art and Challenges7 Feb 2022
- 2021Skeletal Graph Self-Attention: Embedding a Skeleton Inductive Bias into Sign Language Production6 Dec 2021
- 2021BBC-Oxford British Sign Language Dataset5 Nov 2021
- 2021Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitives23 Jul 2021
- 2021AnonySIGN: Novel Human Appearance Synthesis for Sign Language Video Anonymisation22 Jul 2021
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 130
- 2023YouTube-ASL: A Large-Scale, Open-Domain American Sign Language-English Parallel Corpuscited by 75
- 2022Open-Domain Sign Language Translation Learned from Online Videocited by 72
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
- 2025Uni-Sign: Toward Unified Sign Language Understanding at Scalecited by 56
- 2021Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitivescited by 50
- 2023Sign Language Translation from Instructional Videoscited by 39
- 2024T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Textcited by 30
- 2021BBC-Oxford British Sign Language Datasetcited by 28
- 2022Machine Translation from Signed to Spoken Languages: State of the Art and Challengescited by 20
- 2022Automatic dense annotation of large-vocabulary sign language videoscited by 20
- 2023JWSign: A Highly Multilingual Corpus of Bible Translations for more Diversity in Sign Language Processingcited by 18
12 most cited of 28 All 28 (JSON)
- 2026Sign-Language Datasets at Scale: A Comprehensive Survey on Resources, Benchmarks, and Annotation Standards28 Apr 2026
- 2025MultimodalHugs: Enabling Sign Language Processing in Hugging Face10 Sep 2025
- 2025Isharah: A Large-Scale Multi-Scene Dataset for Continuous Sign Language Recognition4 Jun 2025
- 2025Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language Translation30 May 2025
- 2025Deep Understanding of Sign Language for Sign to Subtitle Alignment5 Mar 2025
- 2025Co-creation for Sign Language Processing and Machine Translation3 Mar 2025
- 2025Uni-Sign: Toward Unified Sign Language Understanding at Scale25 Jan 2025
- 2024iSign: A Benchmark for Indian Sign Language Processing7 Jul 2024
- 2024Reconsidering Sentence-Level Sign Language Translation16 Jun 2024
- 2024T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text11 Jun 2024
- 2024E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methods5 May 2024
- 2024SkelCap: Automated Generation of Descriptive Text from Skeleton Keypoint Sequences5 May 2024
12 newest of 28 All 28 (JSON)