mlsanityData to 14 Oct 2026

CSLRConformer: A Data-Centric Conformer Approach for Continuous Arabic Sign Language Recognition on the Isharah Datase

arXiv 2508.01791 ↗First posted 3 Aug 2025cs.CV cs.AI cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

The field of Continuous Sign Language Recognition (CSLR) poses substantial technical challenges, including fluid inter-sign transitions, the absence of temporal boundaries, and co-articulation effects. This paper, developed for the MSLR 2025 Workshop Challenge at ICCV 2025, addresses the critical challenge of signer-independent recognition to advance the generalization capabilities of CSLR systems across diverse signers. A data-centric methodology is proposed, centered on systematic feature engineering, a robust preprocessing pipeline, and an optimized model architecture. Key contributions include a principled feature selection process guided by Exploratory Data Analysis (EDA) to isolate communicative keypoints, a rigorous preprocessing pipeline incorporating DBSCAN-based outlier filtering and spatial normalization, and the novel CSLRConformer architecture. This architecture adapts the hybrid CNN-Transformer design of the Conformer model, leveraging its capacity to model local temporal dependencies and global sequence context; a characteristic uniquely suited for the spatio-temporal dynamics of sign language. The proposed methodology achieved a competitive performance, with a Word Error Rate (WER) of 5.60% on the development set and 12.01% on the test set, a result that secured a 3rd place ranking on the official competition platform. This research validates the efficacy of cross-domain architectural adaptation, demonstrating that the Conformer model, originally conceived for speech recognition, can be successfully repurposed to establish a new state-of-the-art performance in keypoint-based CSLR.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 8 of its 25 references that are in the map. First posted on arXiv 3 Aug 2025.

Builds on

8 of 25 references.

References · 8

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
  3. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  4. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
  5. 2021Skeleton-Contrastive 3D Action Representation Learningcited by 76
  6. 2022ArabSign: A Multi-modality Dataset and Benchmark for Continuous Arabic Sign Language Recognitioncited by 7
  7. 2025Isharah: A Large-Scale Multi-Scene Dataset for Continuous Sign Language Recognitioncited by 6
  8. 2024Continuous Sign Language Recognition with Adapted Conformer via Unsupervised Pretrainingcited by 1

Built on by

Not cited yet.