ASL STEM Wiki: Dataset and Benchmark for Interpreting STEM Articles
Not on the map. Why?
Abstract (arXiv)
Deaf and hard-of-hearing (DHH) students face significant barriers in accessing science, technology, engineering, and mathematics (STEM) education, notably due to the scarcity of STEM resources in signed languages. To help address this, we introduce ASL STEM Wiki: a parallel corpus of 254 Wikipedia articles on STEM topics in English, interpreted into over 300 hours of American Sign Language (ASL). ASL STEM Wiki is the first continuous signing dataset focused on STEM, facilitating the development of AI resources for STEM education in ASL. We identify several use cases of ASL STEM Wiki with human-centered applications. For example, because this dataset highlights the frequent use of fingerspelling for technical concepts, which inhibits DHH students' ability to learn, we develop models to identify fingerspelled words -- which can later be used to query for appropriate ASL signs to suggest to interpreters.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 8 of its 25 references that are in the map. First posted on arXiv 8 Nov 2024.
Builds on
8 of 25 references.
References · 8
- 2017Attention Is All You Needcited by 60,361
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021CANINE: Pre-training an Efficient Tokenization-Free Encoder for Language Representationcited by 232
- 2019Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparisoncited by 218
- 2020How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Languagecited by 173
- 2020MediaPipe Hands: On-device Real-time Hand Trackingcited by 161
- 2023YouTube-ASL: A Large-Scale, Open-Domain American Sign Language-English Parallel Corpuscited by 75
- 2022Open-Domain Sign Language Translation Learned from Online Videocited by 72
Built on by
Citing papers per year: 2024: 1; 2025: 2; 2026: 4.
7 papers.
- 2024SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Predictioncited by 22
- 2025EmoSign: A Multimodal Dataset for Understanding Emotions in American Sign Languagecited by 4
- 2025How Pragmatics Shape Articulation: A Computational Case Study in STEM ASL Discoursecited by 1
- 2026Bootstrapping Sign Language Annotations with Sign Language Modelscited by 1
- 2026Targeted Linguistic Analysis of Sign Language Models with Minimal Translation Pairscited by 0
- 2026DiscoSign: Discourse-Aware Text to Sign Language Gloss Translationcited by 0
- 2026SignDino: Self-Supervised Sign Language Representation Learning via Temporal-Axis Self-Distillationcited by 0
- 2026SignDino: Self-Supervised Sign Language Representation Learning via Temporal-Axis Self-Distillation5 Sep 2026
- 2026DiscoSign: Discourse-Aware Text to Sign Language Gloss Translation2 Sep 2026
- 2026Targeted Linguistic Analysis of Sign Language Models with Minimal Translation Pairs29 Apr 2026
- 2026Bootstrapping Sign Language Annotations with Sign Language Models8 Apr 2026
- 2025How Pragmatics Shape Articulation: A Computational Case Study in STEM ASL Discourse27 Oct 2025
- 2025EmoSign: A Multimodal Dataset for Understanding Emotions in American Sign Language20 May 2025
- 2024SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Prediction25 Nov 2024