Tamaththul3D: High-Fidelity 3D Saudi Sign Language Avatars from Monocular Video
Not on the map. Why?
Abstract (arXiv)
Existing 3D sign language avatar reconstruction methods are developed and evaluated exclusively on Western sign languages, and no 3D parametric annotations exist for any Arabic Sign Language dataset, a gap that blocks the development of avatar-based accessibility applications for the Arab Deaf community. We release the first SMPL-X parametric annotations for the Ishara-500 Saudi Sign Language dataset, enabling quantitative evaluation and downstream sign language generation for Arabic Sign Language. We introduce Tamaththul3D, a reconstruction pipeline that aligns hand and body estimates through geometric inverse kinematics on the forearm chain followed by 2D-supervised shoulder refinement. The closed-form integration is decoupled from the specific choice of body and hand estimators: any SMPL-X-compatible body estimator and any MANO-compatible hand estimator can be substituted, as we demonstrate by swapping each module independently. Tamaththul3D achieves up to 32% lower hand error than prior methods, runs 32x faster than the strongest baseline, and generalizes across five typologically distinct sign languages without dataset-specific adaptation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 43 references that are in the map. First posted on arXiv 6 May 2026.
Builds on
31 of 43 references.
References · 31
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2017End-to-end Recovery of Human Shape and Posecited by 883
- 2019Learning to Reconstruct 3D Human Pose and Shape via Model-fitting in the Loopcited by 625
- 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 615
- 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
- 2020End-to-End Human Pose and Mesh Reconstruction with Transformerscited by 417
- 2020HybrIK: A Hybrid Analytical-Neural Inverse Kinematics Solution for 3D Human Pose and Shape Estimationcited by 304
- 2023Reconstructing Hands in 3D with Transformerscited by 298
- 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
- 2021Mesh Graphormercited by 264
- 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
- 2019Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparisoncited by 217
19 more
- 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 205
- 2021Improving Sign Language Translation with Monolingual Data by Sign Back-Translationcited by 177
- 2020How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Languagecited by 172
- 2023SMPLer-X: Scaling Up Expressive Human Pose and Shape Estimationcited by 154
- 2022PyMAF-X: Towards Well-aligned Full-body Model Regression from Monocular Imagescited by 152
- 2021Collaborative Regression of Expressive Bodies using Moderationcited by 137
- 2023One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformercited by 128
- 2020Progressive Transformers for End-to-End Sign Language Productioncited by 119
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 117
- 2020Accurate 3D Hand Pose Estimation for Whole-Body 3D Human Mesh Estimationcited by 81
- 2020FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and Integrationcited by 72
- 2023SignBERT+: Hand-model-aware Self-supervised Pre-training for Sign Language Understandingcited by 59
- 2023Neural Sign Actors: A diffusion model for 3D sign language production from textcited by 48
- 2024Hamba: Single-view 3D Hand Reconstruction with Graph-guided Bi-Scanning Mambacited by 45
- 2025SMPLest-X: Ultimate Scaling for Expressive Human Pose and Shape Estimationcited by 31
- 2023Reconstructing Signing Avatars From Video Using Linguistic Priorscited by 12
- 2015Swing-twist decomposition in Clifford algebracited by 8
- 2022ArabSign: A Multi-modality Dataset and Benchmark for Continuous Arabic Sign Language Recognitioncited by 7
- 2025DexAvatar: 3D Sign Language Reconstruction with Hand and Body Pose Priorscited by 1
Built on by
Not cited yet.