mlsanityData to 14 Oct 2026

Pose-Guided Sign Language Video GAN with Dynamic Lambda

arXiv 2105.02742 ↗First posted 6 May 2021cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

We propose a novel approach for the synthesis of sign language videos using GANs. We extend the previous work of Stoll et al. by using the human semantic parser of the Soft-Gated Warping-GAN from to produce photorealistic videos guided by region-level spatial layouts. Synthesizing target poses improves performance on independent and contrasting signers. Therefore, we have evaluated our system with the highly heterogeneous MS-ASL dataset with over 200 signers resulting in a SSIM of 0.893. Furthermore, we introduce a periodic weighting approach to the generator that reactivates the training and leads to quantitatively better results.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 18 of its 26 references that are in the map. First posted on arXiv 6 May 2021.

Builds on

18 of 26 references.

References · 18

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  2. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  3. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  4. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
  5. 2020Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translationcited by 256
  6. 2017Pose Guided Person Image Generationcited by 251
  7. 2019Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparisoncited by 218
  8. 2020How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Languagecited by 173
  9. 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
  10. 2018MS-ASL: A Large-Scale Data Set and Benchmark for Understanding American Sign Languagecited by 118
  11. 2018Synthesizing Images of Humans in Unseen Posescited by 97
  12. 2018Look into Person: Joint Body Parsing & Pose Estimation Network and A New Benchmarkcited by 79
6 more
  1. 2018Soft-Gated Warping-GAN for Pose-Guided Person Image Synthesiscited by 59
  2. 2020Adversarial Training for Multi-Channel Sign Language Productioncited by 57
  3. 2020Can Everybody Sign Now? Exploring Sign Language Video Generation from 2D Posescited by 12
  4. 2018DeepASL: Enabling Ubiquitous and Non-Intrusive Word and Sentence-Level Sign Language Translationcited by 10
  5. 2017Using Deep Convolutional Networks for Gesture Recognition in American Sign Languagecited by 4
  6. 2019American Sign Language Alphabet Recognition using Deep Learningcited by 1

Built on by

Cited by year

Citing papers per year: 2024: 2; 2025: 1.

3 papers.

  1. 2024A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insightscited by 25
  2. 2024Pose-Guided Fine-Grained Sign Language Video Generationcited by 8
  3. 2025EverybodyDance: Bipartite Graph-Based Identity Correspondence for Multi-Character Animationcited by 3