All You Need In Sign Language Production
Not on the map. Why?
Abstract (arXiv)
Sign Language is the dominant form of communication language used in the deaf and hearing-impaired community. To make an easy and mutual communication between the hearing-impaired and the hearing communities, building a robust system capable of translating the spoken language into sign language and vice versa is fundamental. To this end, sign language recognition and production are two necessary parts for making such a two-way system. Sign language recognition and production need to cope with some critical challenges. In this survey, we review recent advances in Sign Language Production (SLP) and related areas using deep learning. To have more realistic perspectives to sign language, we present an introduction to the Deaf culture, Deaf centers, psychological perspective of sign language, the main differences between spoken language and sign language. Furthermore, we present the fundamental components of a bi-directional sign language translation system, discussing the main challenges in this area. Also, the backbone architectures and methods in SLP are briefly introduced and the proposed taxonomy on SLP is presented. Finally, a general framework for SLP and performance evaluation, and also a discussion on the recent developments, advantages, and limitations in SLP, commenting on possible lines for future research are presented.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 50 of its 173 references that are in the map. First posted on arXiv 5 Jan 2022.
Builds on
50 of 173 references.
References · 50
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,530
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2014Sequence to Sequence Learning with Neural Networkscited by 2,974
- 2014Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modelingcited by 2,341
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,027
- 2015Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcastingcited by 1,428
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2015Effective Approaches to Attention-based Neural Machine Translationcited by 1,024
38 more
- 2016Conditional Image Generation with PixelCNN Decoderscited by 859
- 2016Pixel Recurrent Neural Networkscited by 814
- 2013Speech Recognition with Deep Recurrent Neural Networkscited by 666
- 2017Understanding the Effective Receptive Field in Deep Convolutional Neural Networkscited by 549
- 2017Word Translation Without Parallel Datacited by 480
- 2019MLQA: Evaluating Cross-lingual Extractive Question Answeringcited by 339
- 2018Everybody Dance Nowcited by 313
- 2015Deep multi-scale video prediction beyond mean square errorcited by 297
- 2017Dilated Residual Networkscited by 293
- 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 272
- 2016Unsupervised Learning for Physical Interaction through Video Predictioncited by 256
- 2017Pose Guided Person Image Generationcited by 251
- 2016Multi30K: Multilingual English-German Image Descriptionscited by 250
- 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
- 2015Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networkscited by 214
- 2015DRAW: A Recurrent Neural Network For Image Generationcited by 190
- 2020How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Languagecited by 172
- 2017Decomposing Motion and Content for Natural Video Sequence Predictioncited by 168
- 2017Deformable GANs for Pose-based Human Image Generationcited by 166
- 2020Progressive Transformers for End-to-End Sign Language Productioncited by 119
- 2019Understanding LSTM -- a tutorial into Long Short-Term Memory Recurrent Neural Networkscited by 103
- 2015Attribute2Image: Conditional Image Generation from Visual Attributescited by 93
- 2019High Fidelity Video Prediction with Large Stochastic Recurrent Neural Networkscited by 88
- 2019Sign Language Recognition, Generation, and Translation: An Interdisciplinary Perspectivecited by 87
- 2020Multi-channel Transformers for Multi-articulatory Sign Language Translationcited by 71
- 2016Neural Machine Translation in Linear Timecited by 65
- 2018Neural Sign Language Translation based on Human Keypoint Estimationcited by 65
- 2019Memory-Attended Recurrent Network for Video Captioningcited by 65
- 2020Adversarial Training for Multi-Channel Sign Language Productioncited by 57
- 2018MTNT: A Testbed for Machine Translation of Noisy Textcited by 54
- 2018Generating Multi-Agent Trajectories using Programmatic Weak Supervisioncited by 46
- 2020Everybody Sign Now: Translating Spoken Language to Photo Realistic Sign Language Videocited by 34
- 2021Sign Language Production: A Reviewcited by 26
- 2015Unsupervised Learning of Visual Structure using Predictive Generative Networkscited by 12
- 2021English to Bangla Machine Translation Using Recurrent Neural Networkcited by 6
- 2015Avatar-independent scripting for real-time gesture animationcited by 4
- 2021ZS-SLR: Zero-Shot Sign Language Recognition from RGB-D Videoscited by 4
- 2021Multi-Modal Zero-Shot Sign Language Recognitioncited by 3
Built on by
Citing papers per year: 2022: 3; 2023: 0; 2024: 1; 2025: 2; 2026: 2.
8 papers.
- 2022TriHorn-Net: A Model for Accurate Depth-Based 3D Hand Pose Estimationcited by 7
- 2025Beyond Gloss: A Hand-Centric Framework for Gloss-Free Sign Language Translationcited by 7
- 2025Hierarchical Feature Alignment for Gloss-Free Sign Language Translationcited by 6
- 2024iSign: A Benchmark for Indian Sign Language Processingcited by 5
- 2022Word separation in continuous sign language using isolated signs and post-processingcited by 3
- 2022A Non-Anatomical Graph Structure for isolated hand gesture separation in continuous gesture sequencescited by 1
- 2026FEA-SLT: A Gloss-Free End-to-End Framework for Facial-Expression-Aware Sign Language Translationcited by 0
- 2026KAN Text to Vision? The Exploration of Kolmogorov-Arnold Networks for Multi-Scale Sequence-Based Pose Animation from Sign Language Notationcited by 0
- 2026KAN Text to Vision? The Exploration of Kolmogorov-Arnold Networks for Multi-Scale Sequence-Based Pose Animation from Sign Language Notation10 May 2026
- 2026FEA-SLT: A Gloss-Free End-to-End Framework for Facial-Expression-Aware Sign Language Translation7 Jan 2026
- 2025Beyond Gloss: A Hand-Centric Framework for Gloss-Free Sign Language Translation31 Jul 2025
- 2025Hierarchical Feature Alignment for Gloss-Free Sign Language Translation9 Jul 2025
- 2024iSign: A Benchmark for Indian Sign Language Processing7 Jul 2024
- 2022A Non-Anatomical Graph Structure for isolated hand gesture separation in continuous gesture sequences15 Jul 2022
- 2022TriHorn-Net: A Model for Accurate Depth-Based 3D Hand Pose Estimation14 Jun 2022
- 2022Word separation in continuous sign language using isolated signs and post-processing2 Apr 2022