mlsanityData to 14 Oct 2026

SignNet-1M: Large-Scale Multilingual Sign Language Video Dataset with Downstream Benchmarks

arXiv 2606.24361 ↗First posted 23 Jun 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Sign language models are typically trained on datasets captured under constrained conditions, with limited viewpoint, background, and signer-identity diversity, leading to poor robustness under real-world distribution shifts. We introduce SignNet-1M, a large-scale augmented dataset spanning ASL, CSL, and German Sign Language (DGS). SignNet-1M synthesizes realistic variations along three axes: (i) novel-view rendering (rotation and zoom) via 3D Gaussian Splatting (3DGS), (ii) scene/identity editing via diffusion models for background replacement and signer substitution while preserving sign motion and linguistic content, and (iii) post-rendering augmentations that emulate capture and compression artifacts (e.g., pose/temporal perturbations and video-level corruptions) to better match in-the-wild recordings. Beyond data release, we provide a unified benchmark suite across downstream tasks (e.g., translation and recognition) and ablations that isolate each augmentation component. Experiments across backbones show that training with SignNet-1M consistently improves generalization under cross-view, cross-background, cross-identity, and post-rendering shifts, while maintaining strong in-distribution performance. The dataset, full augmentation pipeline, and benchmark are available at https://signnet.chatsign.ai/.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 43 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

29 of 43 references.

References · 29

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,183
  5. 2022Scaling Instruction-Finetuned Language Modelscited by 3,024
  6. 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,884
  7. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,269
  8. 2020mT5: A massively multilingual pre-trained text-to-text transformercited by 1,818
  9. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,612
  10. 2022VideoMAE: Masked Autoencoders are Data-Efficient Learners for Self-Supervised Video Pre-Trainingcited by 1,322
  11. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,301
  12. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
17 more
  1. 2019AugMix: A Simple Data Processing Method to Improve Robustness and Uncertaintycited by 901
  2. 2023Text2Video-Zero: Text-to-Image Diffusion Models are Zero-Shot Video Generatorscited by 670
  3. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
  4. 2023Effective Whole-body Pose Estimation with Two-stages Distillationcited by 311
  5. 2020Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translationcited by 256
  6. 2021Improving Sign Language Translation with Monolingual Data by Sign Back-Translationcited by 179
  7. 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 175
  8. 2020How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Languagecited by 173
  9. 2024Bilateral Reference for High-Resolution Dichotomous Image Segmentationcited by 112
  10. 2023YouTube-ASL: A Large-Scale, Open-Domain American Sign Language-English Parallel Corpuscited by 75
  11. 2022Open-Domain Sign Language Translation Learned from Online Videocited by 72
  12. 2024Sign2GPT: Leveraging Large Language Models for Gloss-Free Sign Language Translationcited by 57
  13. 2025Uni-Sign: Toward Unified Sign Language Understanding at Scalecited by 56
  14. 2023Gloss Attention for Gloss-free Sign Language Translationcited by 51
  15. 2021Learning Representational Invariances for Data-Efficient Action Recognitioncited by 22
  16. 2025GUAVA: Generalizable Upper Body 3D Gaussian Avatarcited by 22
  17. 2025FlowPortal: Residual-Corrected Flow for Training-Free Video Relighting and Background Replacementcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Beyond Gloss: A Hand-Centric Framework for Gloss-Free Sign Language Translation
  2. 2026Corpus Augmentation for Sign Language Translation via LLM-Guided Video Stitching
  3. 2026SignRefine: Adapting Foundational Video Models for Sign Language Generation
  4. 2024LLMs are Good Sign Language Translators
  5. 2024DiffSLT: Enhancing Diversity in Sign Language Translation via Diffusion Model
  6. 2024LLaVA-SLT: Visual Language Tuning for Sign Language Translation
  7. 2024SignLLM: Sign Language Production Large Language Models
  8. 2026Attention-Steered Vision-Language Models for Sign Language Translation