CSLRConformer: A Data-Centric Conformer Approach for Continuous Arabic Sign Language Recognition on the Isharah Datase
Not on the map. Why?
Abstract (arXiv)
The field of Continuous Sign Language Recognition (CSLR) poses substantial technical challenges, including fluid inter-sign transitions, the absence of temporal boundaries, and co-articulation effects. This paper, developed for the MSLR 2025 Workshop Challenge at ICCV 2025, addresses the critical challenge of signer-independent recognition to advance the generalization capabilities of CSLR systems across diverse signers. A data-centric methodology is proposed, centered on systematic feature engineering, a robust preprocessing pipeline, and an optimized model architecture. Key contributions include a principled feature selection process guided by Exploratory Data Analysis (EDA) to isolate communicative keypoints, a rigorous preprocessing pipeline incorporating DBSCAN-based outlier filtering and spatial normalization, and the novel CSLRConformer architecture. This architecture adapts the hybrid CNN-Transformer design of the Conformer model, leveraging its capacity to model local temporal dependencies and global sequence context; a characteristic uniquely suited for the spatio-temporal dynamics of sign language. The proposed methodology achieved a competitive performance, with a Word Error Rate (WER) of 5.60% on the development set and 12.01% on the test set, a result that secured a 3rd place ranking on the official competition platform. This research validates the efficacy of cross-domain architectural adaptation, demonstrating that the Conformer model, originally conceived for speech recognition, can be successfully repurposed to establish a new state-of-the-art performance in keypoint-based CSLR.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 25 references that are in the map. First posted on arXiv 3 Aug 2025.
Builds on
8 of 25 references.
References · 8
- 2017Attention Is All You Needcited by 60,361
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
- 2021Skeleton-Contrastive 3D Action Representation Learningcited by 76
- 2022ArabSign: A Multi-modality Dataset and Benchmark for Continuous Arabic Sign Language Recognitioncited by 7
- 2025Isharah: A Large-Scale Multi-Scene Dataset for Continuous Sign Language Recognitioncited by 6
- 2024Continuous Sign Language Recognition with Adapted Conformer via Unsupervised Pretrainingcited by 1
Built on by
Not cited yet.