Can Everybody Sign Now? Exploring Sign Language Video Generation from 2D Poses
Not on the map. Why?
Abstract (arXiv)
Recent work have addressed the generation of human poses represented by 2D/3D coordinates of human joints for sign language. We use the state of the art in Deep Learning for motion transfer and evaluate them on How2Sign, an American Sign Language dataset, to generate videos of signers performing sign language given a 2D pose skeleton. We evaluate the generated videos quantitatively and qualitatively showing that the current models are not enough to generated adequate videos for Sign Language due to lack of detail in hands.
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). First posted on arXiv 20 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 1; 2022: 3; 2023: 3; 2024: 3; 2025: 2.
12 papers.
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
- 2023SignDiff: Diffusion Model for American Sign Language Productioncited by 25
- 2022Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generationcited by 14
- 2023An Open-Source Gloss-Based Baseline for Spoken to Signed Language Translationcited by 9
- 2024Sign Stitching: A Novel Approach to Sign Language Productioncited by 8
- 2024Pose-Guided Fine-Grained Sign Language Video Generationcited by 8
- 2025Text-Driven 3D Hand Motion Generation from Sign Language Datacited by 5
- 2021Pose-Guided Sign Language Video GAN with Dynamic Lambdacited by 3
- 2023A Survey on Deep Multi-modal Learning for Body Language Recognition and Generationcited by 3
- 2022Neural Sign Reenactor: Deep Photorealistic Sign Language Retargetingcited by 2
- 2024SignLLM: Sign Language Production Large Language Modelscited by 2
- 2025HandCraft: Dynamic Sign Generation for Synthetic Data Augmentationcited by 0
- 2025Text-Driven 3D Hand Motion Generation from Sign Language Data21 Aug 2025
- 2025HandCraft: Dynamic Sign Generation for Synthetic Data Augmentation20 Aug 2025
- 2024Pose-Guided Fine-Grained Sign Language Video Generation25 Sep 2024
- 2024SignLLM: Sign Language Production Large Language Models17 May 2024
- 2024Sign Stitching: A Novel Approach to Sign Language Production13 May 2024
- 2023SignDiff: Diffusion Model for American Sign Language Production30 Aug 2023
- 2023A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation17 Aug 2023
- 2023An Open-Source Gloss-Based Baseline for Spoken to Signed Language Translation28 May 2023
- 2022Neural Sign Reenactor: Deep Photorealistic Sign Language Retargeting3 Sep 2022
- 2022Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generation8 Jul 2022
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production29 Mar 2022
- 2021Pose-Guided Sign Language Video GAN with Dynamic Lambda6 May 2021