Toward Deployable Bangla Sign Language Recognition with Expert-Validated Data and a Lightweight Attention-Based Model
Not on the map. Why?
Abstract (arXiv)
Deaf and hard-of-hearing people in Bangladesh communicate mainly through Bangla Sign Language (BdSL). Automatic BdSL recognition on personal devices could widen access to education and services. Existing systems use controlled-setting datasets without expert verification and heavyweight pretrained backbones unsuited to on-device use. We introduce RSBdSL38, 10,874 expert-validated images spanning all 38 BdSL hand signs, representing the 51 letters of the Bangla alphabet, recorded from real signers at three special-needs schools across Bangladesh. We propose a lightweight attention based convolutional network of 298,470 parameters, built from grouped bottleneck residual blocks, channel and spatial attention, a multi-scale depthwise hand-feature block, dual pooling, and Swish activations. Trained from scratch, it attains 96.37% accuracy (95.72% +- 0.54% over five seeds), within 1.08 percentage points of the best of nine ImageNet-pretrained efficient architectures under an identical protocol, using 8.5 to 68x fewer parameters and 1.3 to 21.7x fewer MACs. Retrained, it reaches 92.95 to 98.33% on six public BdSL benchmarks, 97.04% on a merged corpus, and 76.25% zero-shot on BdSL-38. Removing any architectural stage costs 7.61 to 89.30 points, against at most 3.17 for the training recipe. Grad-CAM with deletion-insertion and weight-randomization checks confirms that predictions follow the signing hand. A signer-independent split holding out 6 of 36 signers yields 85.18%. Quantized to 0.48 MB, it runs at 3.98 ms per image within a 15.5 MB footprint on a commodity smartphone. Together, RSBdSL38 and our from-scratch model turn benchmark accuracy into deployable accessibility at a fraction of pretrained-backbone cost; dataset, code, and models are released.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 19 of its 48 references that are in the map. First posted on arXiv 6 Aug 2026.
Builds on
19 of 48 references.
References · 19
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,690
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,320
- 2018Sanity Checks for Saliency Mapscited by 1,149
- 2017Grad-CAM++: Improved Visual Explanations for Deep Convolutional Networkscited by 936
- 2018RISE: Randomized Input Sampling for Explanation of Black-box Modelscited by 825
7 more
- 2021MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformercited by 636
- 2014Efficient Object Localization Using Convolutional Networkscited by 226
- 2022Separable Self-attention for Mobile Vision Transformerscited by 163
- 2024MobileNetV4 -- Universal Models for the Mobile Ecosystemcited by 98
- 2022GhostNetV2: Enhance Cheap Operation with Long-Range Attentioncited by 44
- 2021BdSL36: A Dataset for Bangladeshi Sign Letters Recognitioncited by 7
- 2024BAUST Lipi: A BdSL Dataset with Deep Learning Based Bangla Sign Language Recognitioncited by 3
Built on by
Not cited yet.