mlsanityData to 7 Oct 2026

Considerations for meaningful sign language machine translation based on glosses

arXiv 2211.15464 ↗First posted 28 Nov 2022cs.CL cs.AIcited by 24

Not on the map. Why?

Abstract (arXiv)

Automatic sign language processing is gaining popularity in Natural Language Processing (NLP) research (Yin et al., 2021). In machine translation (MT) in particular, sign language translation based on glosses is a prominent approach. In this paper, we review recent works on neural gloss translation. We find that limitations of glosses in general and limitations of specific datasets are not discussed in a transparent manner and that there is no common standard for evaluation. To address these issues, we put forward concrete recommendations for future research on gloss translation. Our suggestions advocate awareness of the inherent limitations of gloss-based approaches, realistic datasets, stronger baselines and convincing evaluation.

Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 20 of its 43 references that are in the map. First posted on arXiv 28 Nov 2022.

Builds on

20 of 43 references.

References · 20

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  3. 2020COMET: A Neural Framework for MT Evaluationcited by 1,024
  4. 2020Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translationcited by 254
  5. 2021To Ship or Not to Ship: An Extensive Evaluation of Automatic Metrics for Machine Translationcited by 161
  6. 2020Progressive Transformers for End-to-End Sign Language Productioncited by 119
  7. 2018Troubling Trends in Machine Learning Scholarshipcited by 107
  8. 2017Evaluating Discourse Phenomena in Neural Machine Translationcited by 87
  9. 2020Multi-channel Transformers for Multi-articulatory Sign Language Translationcited by 71
  10. 2021Scientific Credibility of Machine Translation Research: A Meta-Evaluation of 769 Paperscited by 70
  11. 2021Including Signed Languages in Natural Language Processingcited by 67
  12. 2019Revisiting Low-Resource Neural Machine Translation: A Case Studycited by 61
8 more
  1. 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
  2. 2019A Call for Prudent Choice of Subword Merge Operations in Neural Machine Translationcited by 30
  3. 2021Data Augmentation for Sign Language Gloss Translationcited by 28
  4. 2022Ham2Pose: Animating Sign Language Notation into Pose Sequencescited by 21
  5. 2022Machine Translation from Signed to Spoken Languages: State of the Art and Challengescited by 20
  6. 2020Neural Sign Language Translation by Learning Tokenizationcited by 19
  7. 2022Changing the Representation: Examining Language Representation for Neural Sign Language Productioncited by 15
  8. 2017Stronger Baselines for Trustable Results in Neural Machine Translationcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 4; 2024: 10; 2025: 6; 2026: 4.

24 papers.

Sort:

By area:

  1. 2024Towards Privacy-Aware Sign Language Translation at Scalecited by 42
  2. 2023SLTUNET: A Simple Unified Model for Sign Language Translationcited by 35
  3. 2024Signs as Tokens: A Retrieval-Enhanced Multilingual Sign Language Generatorcited by 20
  4. 2023JWSign: A Highly Multilingual Corpus of Bible Translations for more Diversity in Sign Language Processingcited by 18
  5. 2024Towards Online Continuous Sign Language Recognition and Translationcited by 13
  6. 2023An Open-Source Gloss-Based Baseline for Spoken to Signed Language Translationcited by 9
  7. 2023Autoregressive Sign Language Production: A Gloss-Free Approach with Discrete Representationscited by 9
  8. 2025Multilingual Gloss-free Sign Language Translation: Towards Building a Sign Language Foundation Modelcited by 7
  9. 2025Meaningful Pose-Based Sign Language Evaluationcited by 6
  10. 2025Lost in Translation, Found in Embeddings: Sign Language Translation and Alignmentcited by 6
  11. 2024iSign: A Benchmark for Indian Sign Language Processingcited by 5
  12. 2024Reconsidering Sentence-Level Sign Language Translationcited by 4
12 more
  1. 2024Generating Signed Language Instructions in Large-Scale Dialogue Systemscited by 3
  2. 2025SONAR-SLT: Multilingual Sign Language Translation via Language-Agnostic Sentence Embedding Supervisioncited by 3
  3. 2026SignVLA: A Gloss-Free Vision-Language-Action Framework for Real-Time Sign Language-Guided Robotic Manipulationcited by 3
  4. 2024SignBLEU: Automatic Evaluation of Multi-channel Sign Language Translationcited by 2
  5. 2024ELMI: Interactive and Intelligent Sign Language Translation of Lyrics for Song Signingcited by 1
  6. 2024The American Sign Language Knowledge Graph: Infusing ASL Models with Linguistic Knowledgecited by 1
  7. 2025MultimodalHugs: Enabling Sign Language Processing in Hugging Facecited by 1
  8. 2024Semi-Supervised Spoken Language Glossificationcited by 0
  9. 2025Evaluation of a Sign Language Avatar on Comprehensibility, User Experience & Acceptabilitycited by 0
  10. 2026DiscoSign: Discourse-Aware Text to Sign Language Gloss Translationcited by 0
  11. 2026Zero-Shot Cross-Lingual Recognition of Sign Language Handshapescited by 0
  12. 2026Machine Translation for Sign Languagescited by 0