How Pragmatics Shape Articulation: A Computational Case Study in STEM ASL Discourse
Not on the map. Why?
Abstract (arXiv)
Most state-of-the-art sign language models are trained on interpreter or isolated vocabulary data, which overlooks the variability that characterizes natural dialogue. However, human communication dynamically adapts to contexts and interlocutors through spatiotemporal changes and articulation style. This specifically manifests itself in educational settings, where novel vocabularies are used by teachers, and students. To address this gap, we collect a motion capture dataset of American Sign Language (ASL) STEM (Science, Technology, Engineering, and Mathematics) dialogue that enables quantitative comparison between dyadic interactive signing, solo signed lecture, and interpreted articles. Using continuous kinematic features, we disentangle dialogue-specific entrainment from individual effort reduction and show spatiotemporal changes across repeated mentions of STEM terms. On average, dialogue signs are 24.6%-44.6% shorter in duration than the isolated signs, and show significant reductions absent in monologue contexts. Finally, we evaluate sign embedding models on their ability to recognize STEM signs and approximate how entrained the participants become over time. Our study bridges linguistic analysis and computational modeling to understand how pragmatics shape sign articulation and its representation in sign language technologies.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 13 of its 61 references that are in the map. First posted on arXiv 27 Oct 2025.
Builds on
13 of 61 references.
References · 13
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,270
- 2021Improving Sign Language Translation with Monolingual Data by Sign Back-Translationcited by 179
- 2020How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Languagecited by 173
- 2020MediaPipe Hands: On-device Real-time Hand Trackingcited by 161
- 2020BSL-1K: Scaling up co-articulated sign language recognition using mouthing cuescited by 106
- 2021Read and Attend: Temporal Localisation in Sign Language Videoscited by 34
- 2024SignCLIP: Connecting Text and Sign Language by Contrastive Learningcited by 20
- 2024Systemic Biases in Sign Language AI Research: A Deaf-Led Call to Reevaluate Research Agendascited by 19
- 2023The Sem-Lex Benchmark: Modeling ASL Signs and Their Phonemescited by 17
- 2024ASL STEM Wiki: Dataset and Benchmark for Interpreting STEM Articlescited by 7
1 more
Built on by
Citing papers per year: 2026: 1.
1 paper.