mlsanityData to 7 Oct 2026

YouTube-SL-25: A Large-Scale, Open-Domain Multilingual Sign Language Parallel Corpus

arXiv 2407.11144 ↗First posted 15 Jul 2024cs.CLcited by 36

Not on the map. Why?

Abstract (arXiv)

Even for better-studied sign languages like American Sign Language (ASL), data is the bottleneck for machine learning research. The situation is worse yet for the many other sign languages used by Deaf/Hard of Hearing communities around the world. In this paper, we present YouTube-SL-25, a large-scale, open-domain multilingual corpus of sign language videos with seemingly well-aligned captions drawn from YouTube. With >3000 hours of videos across >25 sign languages, YouTube-SL-25 is a) >3x the size of YouTube-ASL, b) the largest parallel sign language dataset to date, and c) the first or largest parallel dataset for many of its component languages. We provide baselines for sign-to-text tasks using a unified multilingual multitask model based on T5 and report scores on benchmarks across 4 sign languages. The results demonstrate that multilingual transfer benefits both higher- and lower-resource sign languages within YouTube-SL-25.

Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). Builds on 14 of its 35 references that are in the map. First posted on arXiv 15 Jul 2024.

Builds on

14 of 35 references.

References · 14

  1. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  2. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,813
  3. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,790
  4. 2020BLEURT: Learning Robust Metrics for Text Generationcited by 1,196
  5. 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 896
  6. 2021Quality at a Glance: An Audit of Web-Crawled Multilingual Datasetscited by 241
  7. 2021Improving Sign Language Translation with Monolingual Data by Sign Back-Translationcited by 177
  8. 2020How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Languagecited by 172
  9. 2021Learning Compact Metrics for MTcited by 93
  10. 2022Open-Domain Sign Language Translation Learned from Online Videocited by 72
  11. 2018Neural Sign Language Translation based on Human Keypoint Estimationcited by 65
  12. 2024A Hong Kong Sign Language Corpus Collected from Sign-interpreted TV Newscited by 6
2 more
  1. 2024iSign: A Benchmark for Indian Sign Language Processingcited by 5
  2. 2024E-TSL: A Continuous Educational Turkish Sign Language Dataset with Baseline Methodscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 3; 2025: 16; 2026: 17.

36 papers.

Sort:

By area:

  1. 2025Uni-Sign: Toward Unified Sign Language Understanding at Scalecited by 55
  2. 2024SHuBERT: Self-Supervised Sign Language Representation Learning via Multi-Stream Cluster Predictioncited by 22
  3. 2025SignRep: Enhancing Self-Supervised Sign Representationscited by 15
  4. 2025Geo-Sign: Hyperbolic Contrastive Regularisation for Geometrically Aware Sign Language Translationcited by 11
  5. 2026Gloss-Free Sign Language Translation: An Unbiased Evaluation of Progress in the Fieldcited by 9
  6. 2024Scaling Sign Language Translationcited by 8
  7. 2024FSboard: Over 3 million characters of ASL fingerspelling collected via smartphonescited by 6
  8. 2025Isharah: A Large-Scale Multi-Scene Dataset for Continuous Sign Language Recognitioncited by 6
  9. 2025Lost in Translation, Found in Embeddings: Sign Language Translation and Alignmentcited by 6
  10. 2025SignSplat: Rendering Sign Language via Gaussian Splattingcited by 5
  11. 2025Exploring Pose-based Sign Language Translation: Ablation Studies and Attention Insightscited by 2
  12. 2025Segment, Embed, and Align: A Universal Recipe for Aligning Subtitles to Signingcited by 2
24 more
  1. 2026SignSparK: Efficient Multilingual Sign Language Production via Sparse Keyframe Learningcited by 2
  2. 2026CNSL-bench: Benchmarking the Sign Language Understanding Capabilities of MLLMs on Chinese National Sign Languagecited by 2
  3. 2026Sign Language Question Answering: A New Task, Benchmark, and Baseline for Sign Language Understandingcited by 2
  4. 2025Sign Spotting Disambiguation using Large Language Modelscited by 1
  5. 2025SAGE: Segment-Aware Gloss-Free Encoding for Token-Efficient Sign Language Translationcited by 1
  6. 2025MultimodalHugs: Enabling Sign Language Processing in Hugging Facecited by 1
  7. 2025Saudi Sign Language Translation Using T5cited by 1
  8. 2026Bootstrapping Sign Language Annotations with Sign Language Modelscited by 1
  9. 2026SIGNET: Motion-Level Knowledge Transfer for Cross-Language Sign Language Translationcited by 1
  10. 2025The TUB Sign Language Corpus Collectioncited by 0
  11. 2025Diverse Signer Avatars with Manual and Non-Manual Feature Modelling for Sign Language Productioncited by 0
  12. 2025SSL-SLR: Self-Supervised Representation Learning for Sign Language Recognitioncited by 0
  13. 2025Seeing, Signing, and Saying: A Vision-Language Model-Assisted Pipeline for Sign Language Data Acquisition and Curation from Social Mediacited by 0
  14. 2026Beyond a Single Reference: Training and Evaluation with Paraphrases in Sign Language Translationcited by 0
  15. 2026Towards Multi-View Sign Language Understanding: A Benchmark Dataset and Baselinecited by 0
  16. 2026Targeted Linguistic Analysis of Sign Language Models with Minimal Translation Pairscited by 0
  17. 2026Towards Continuous Sign Language Conversation from Isolated Signscited by 0
  18. 2026ODE-Based Transformer Decoders for Iterative Sign Language Translationcited by 0
  19. 2026SignMatch: Matching Dictionary Signs to Continuous Sign Language Videocited by 0
  20. 2026Beyond BLEU: A Case for Redefining Sign Language Translation Benchmarkscited by 0
  21. 2026SignDino: Self-Supervised Sign Language Representation Learning via Temporal-Axis Self-Distillationcited by 0
  22. 2026SignRefine: Adapting Foundational Video Models for Sign Language Generationcited by 0
  23. 2026Zero-Shot Cross-Lingual Recognition of Sign Language Handshapescited by 0
  24. 2026Machine Translation for Sign Languagescited by 0