Quantitative Survey of the State of the Art in Sign Language Recognition
Not on the map. Why?
Abstract (arXiv)
This work presents a meta study covering around 300 published sign language recognition papers with over 400 experimental results. It includes most papers between the start of the field in 1983 and 2020. Additionally, it covers a fine-grained analysis on over 25 studies that have compared their recognition approaches on RWTH-PHOENIX-Weather 2014, the standard benchmark task of the field. Research in the domain of sign language recognition has progressed significantly in the last decade, reaching a point where the task attracts much more attention than ever before. This study compiles the state of the art in a concise way to help advance the field and reveal open questions. Moreover, all of this meta study's source data is made public, easing future work with it and further expansion. The analyzed papers have been manually labeled with a set of categories. The data reveals many insights, such as, among others, shifts in the field from intrusive to non-intrusive capturing, from local to global features and the lack of non-manual parameters included in medium and larger vocabulary recognition systems. Surprisingly, RWTH-PHOENIX-Weather with a vocabulary of 1080 signs represents the only resource for large vocabulary continuous sign language recognition benchmarking world wide.
Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 10; 2022: 10; 2023: 6; 2024: 10; 2025: 7; 2026: 7.
50 papers.
Sort:
By area:
- 2022Two-Stream Network for Sign Language Recognition and Translationcited by 122
- 2021Including Signed Languages in Natural Language Processingcited by 67
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
- 2021SignBERT: Pre-Training of Hand-Model-Aware Representation for Sign Language Recognitioncited by 59
- 2023SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understandingcited by 59
- 2021Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitivescited by 50
- 2021Stochastic Transformer Networks with Linear Competing Units: Application to end-to-end SL Translationcited by 35
- 2023ASL Citizen: A Community-Sourced Dataset for Advancing Isolated Sign Language Recognitioncited by 34
- 2021Content4All Open Research Sign Language Translation Datasetscited by 30
- 2021OpenHands: Making Sign Language Recognition Accessible with Pose-based Pretrained Models across Languagescited by 30
- 2021Aligning Subtitles in Sign Language Videoscited by 26
- 2023SignDiff: Diffusion Model for American Sign Language Productioncited by 25
38 more
- 2022Sign Language Video Retrieval with Free-Form Textual Queriescited by 21
- 2022Automatic dense annotation of large-vocabulary sign language videoscited by 20
- 2024Scaling up Multimodal Pre-training for Sign Language Understandingcited by 20
- 2024Discrete to Continuous: Generating Smooth Transition Poses from Sign Language Observationcited by 16
- 2024Sign-IDD: Iconicity Disentangled Diffusion for Sign Language Productioncited by 16
- 2024MASA: Motion-aware Masked Autoencoder with Semantic Alignment for Sign Language Recognitioncited by 13
- 2021Using Motion History Images with 3D Convolutional Networks in Isolated Sign Language Recognitioncited by 12
- 2022Improving Continuous Sign Language Recognition with Consistency Constraints and Signer Removalcited by 11
- 2021Sign Segmentation with Changepoint-Modulated Pseudo-Labellingcited by 10
- 2021ChaLearn LAP Large Scale Signer Independent Isolated Sign Language Recognition Challenge: Design, Results and Future Researchcited by 10
- 2023Human Part-wise 3D Motion Context Learning for Sign Language Recognitioncited by 8
- 2024A Methodological and Structural Review of Hand Gesture Recognition Across Diverse Data Modalitiescited by 8
- 2022ArabSign: A Multi-modality Dataset and Benchmark for Continuous Arabic Sign Language Recognitioncited by 7
- 2024Self-Supervised Representation Learning with Spatial-Temporal Consistency for Sign Language Recognitioncited by 6
- 2022WLASL-LEX: a Dataset for Recognising Phonological Properties in American Sign Languagecited by 5
- 2022LSA-T: The first continuous Argentinian Sign Language dataset for Sign Language Translationcited by 4
- 2024TCNet: Continuous Sign Language Recognition from Trajectories and Correlated Regionscited by 4
- 2022Multi-scale temporal network for continuous sign language recognitioncited by 3
- 2023A Survey on Deep Multi-modal Learning for Body Language Recognition and Generationcited by 3
- 20243D-LEX v1.0: 3D Lexicons for American Sign Language and Sign Language of the Netherlandscited by 3
- 2025SignX: Continuous Sign Recognition in Compact Pose-Rich Latent Spacecited by 3
- 2022Neural Sign Reenactor: Deep Photorealistic Sign Language Retargetingcited by 2
- 2024SignLLM: Sign Language Production Large Language Modelscited by 2
- 2024The NGT200 Dataset: Geometric Multi-View Isolated Sign Recognitioncited by 2
- 2023Toward American Sign Language Processing in the Real World: Data, Tasks, and Methodscited by 1
- 2025Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Languagecited by 1
- 2025The Importance of Facial Features in Vision-based Sign Language Recognition: Eyes, Mouth or Full Face?cited by 1
- 2025Large Sign Language Models: Toward 3D American Sign Language Translationcited by 1
- 2025StgcDiff: Spatial-Temporal Graph Condition Diffusion for Sign Language Transition Generationcited by 0
- 2025Hybrid Autoregressive-Diffusion Model for Real-Time Sign Language Productioncited by 0
- 2025Bringing Balance to Hand Shape Classification: Mitigating Data Imbalance Through Generative Modelscited by 0
- 2026How Do Lexical Senses Correspond Between Spoken German and German Sign Language?cited by 0
- 2026VGGT-HPE: Reframing Head Pose Estimation as Relative Pose Predictioncited by 0
- 2026SignVerse-2M: A Two-Million-Clip Pose-Native Universe of 55+ Sign Languagescited by 0
- 2026Emotion Recognition in Sign Language Conversationcited by 0
- 2026Sign Language Recognition Using Original and Synthetic Depth Image Based Point Cloud Data Modelscited by 0
- 2026Gloss-Free Representation Learning for Cross-Dataset Sign Spottingcited by 0
- 2026Isolated Sign Language Recognition for Icelandic Sign Language: Experiments in a Low-resource Settingcited by 0
- 2026Isolated Sign Language Recognition for Icelandic Sign Language: Experiments in a Low-resource Setting22 Sep 2026
- 2026Gloss-Free Representation Learning for Cross-Dataset Sign Spotting11 Aug 2026
- 2026Sign Language Recognition Using Original and Synthetic Depth Image Based Point Cloud Data Models10 Aug 2026
- 2026Emotion Recognition in Sign Language Conversation22 May 2026
- 2026SignVerse-2M: A Two-Million-Clip Pose-Native Universe of 55+ Sign Languages3 May 2026
- 2026VGGT-HPE: Reframing Head Pose Estimation as Relative Pose Prediction11 Apr 2026
- 2026How Do Lexical Senses Correspond Between Spoken German and German Sign Language?14 Feb 2026
- 2025Large Sign Language Models: Toward 3D American Sign Language Translation11 Nov 2025
- 2025The Importance of Facial Features in Vision-based Sign Language Recognition: Eyes, Mouth or Full Face?28 Jul 2025
- 2025Bringing Balance to Hand Shape Classification: Mitigating Data Imbalance Through Generative Models22 Jul 2025
- 2025Hybrid Autoregressive-Diffusion Model for Real-Time Sign Language Production12 Jul 2025
- 2025StgcDiff: Spatial-Temporal Graph Condition Diffusion for Sign Language Transition Generation16 Jun 2025
38 more
- 2025Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Language20 May 2025
- 2025SignX: Continuous Sign Recognition in Compact Pose-Rich Latent Space22 Apr 2025
- 2024Sign-IDD: Iconicity Disentangled Diffusion for Sign Language Production18 Dec 2024
- 2024Discrete to Continuous: Generating Smooth Transition Poses from Sign Language Observation25 Nov 2024
- 2024The NGT200 Dataset: Geometric Multi-View Isolated Sign Recognition3 Sep 2024
- 20243D-LEX v1.0: 3D Lexicons for American Sign Language and Sign Language of the Netherlands3 Sep 2024
- 2024Scaling up Multimodal Pre-training for Sign Language Understanding16 Aug 2024
- 2024A Methodological and Structural Review of Hand Gesture Recognition Across Diverse Data Modalities10 Aug 2024
- 2024Self-Supervised Representation Learning with Spatial-Temporal Consistency for Sign Language Recognition15 Jun 2024
- 2024MASA: Motion-aware Masked Autoencoder with Semantic Alignment for Sign Language Recognition31 May 2024
- 2024SignLLM: Sign Language Production Large Language Models17 May 2024
- 2024TCNet: Continuous Sign Language Recognition from Trajectories and Correlated Regions18 Mar 2024
- 2023SignDiff: Diffusion Model for American Sign Language Production30 Aug 2023
- 2023Toward American Sign Language Processing in the Real World: Data, Tasks, and Methods23 Aug 2023
- 2023Human Part-wise 3D Motion Context Learning for Sign Language Recognition18 Aug 2023
- 2023A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation17 Aug 2023
- 2023SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understanding8 May 2023
- 2023ASL Citizen: A Community-Sourced Dataset for Advancing Isolated Sign Language Recognition12 Apr 2023
- 2022Improving Continuous Sign Language Recognition with Consistency Constraints and Signer Removal26 Dec 2022
- 2022LSA-T: The first continuous Argentinian Sign Language dataset for Sign Language Translation14 Nov 2022
- 2022Two-Stream Network for Sign Language Recognition and Translation2 Nov 2022
- 2022ArabSign: A Multi-modality Dataset and Benchmark for Continuous Arabic Sign Language Recognition8 Oct 2022
- 2022Neural Sign Reenactor: Deep Photorealistic Sign Language Retargeting3 Sep 2022
- 2022Automatic dense annotation of large-vocabulary sign language videos4 Aug 2022
- 2022Multi-scale temporal network for continuous sign language recognition8 Apr 2022
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Production29 Mar 2022
- 2022WLASL-LEX: a Dataset for Recognising Phonological Properties in American Sign Language11 Mar 2022
- 2022Sign Language Video Retrieval with Free-Form Textual Queries7 Jan 2022
- 2021Using Motion History Images with 3D Convolutional Networks in Isolated Sign Language Recognition24 Oct 2021
- 2021OpenHands: Making Sign Language Recognition Accessible with Pose-based Pretrained Models across Languages12 Oct 2021
- 2021SignBERT: Pre-Training of Hand-Model-Aware Representation for Sign Language Recognition11 Oct 2021
- 2021Stochastic Transformer Networks with Linear Competing Units: Application to end-to-end SL Translation1 Sep 2021
- 2021Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitives23 Jul 2021
- 2021Including Signed Languages in Natural Language Processing11 May 2021
- 2021ChaLearn LAP Large Scale Signer Independent Isolated Sign Language Recognition Challenge: Design, Results and Future Research11 May 2021
- 2021Aligning Subtitles in Sign Language Videos6 May 2021
- 2021Content4All Open Research Sign Language Translation Datasets5 May 2021
- 2021Sign Segmentation with Changepoint-Modulated Pseudo-Labelling28 Apr 2021
- 2022Two-Stream Network for Sign Language Recognition and Translationcited by 122
- 2021Including Signed Languages in Natural Language Processingcited by 67
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
- 2021SignBERT: Pre-Training of Hand-Model-Aware Representation for Sign Language Recognitioncited by 59
- 2023SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understandingcited by 59
- 2021Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitivescited by 50
- 2021Stochastic Transformer Networks with Linear Competing Units: Application to end-to-end SL Translationcited by 35
- 2023ASL Citizen: A Community-Sourced Dataset for Advancing Isolated Sign Language Recognitioncited by 34
- 2021Content4All Open Research Sign Language Translation Datasetscited by 30
- 2021OpenHands: Making Sign Language Recognition Accessible with Pose-based Pretrained Models across Languagescited by 30
- 2021Aligning Subtitles in Sign Language Videoscited by 26
- 2022Sign Language Video Retrieval with Free-Form Textual Queriescited by 21
12 most cited of 47 All 47 (JSON)
- 2026Isolated Sign Language Recognition for Icelandic Sign Language: Experiments in a Low-resource Setting22 Sep 2026
- 2026Gloss-Free Representation Learning for Cross-Dataset Sign Spotting11 Aug 2026
- 2026Sign Language Recognition Using Original and Synthetic Depth Image Based Point Cloud Data Models10 Aug 2026
- 2026Emotion Recognition in Sign Language Conversation22 May 2026
- 2026SignVerse-2M: A Two-Million-Clip Pose-Native Universe of 55+ Sign Languages3 May 2026
- 2026VGGT-HPE: Reframing Head Pose Estimation as Relative Pose Prediction11 Apr 2026
- 2026How Do Lexical Senses Correspond Between Spoken German and German Sign Language?14 Feb 2026
- 2025Large Sign Language Models: Toward 3D American Sign Language Translation11 Nov 2025
- 2025The Importance of Facial Features in Vision-based Sign Language Recognition: Eyes, Mouth or Full Face?28 Jul 2025
- 2025Bringing Balance to Hand Shape Classification: Mitigating Data Imbalance Through Generative Models22 Jul 2025
- 2025StgcDiff: Spatial-Temporal Graph Condition Diffusion for Sign Language Transition Generation16 Jun 2025
- 2025Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Language20 May 2025
12 newest of 47 All 47 (JSON)