SignSparK: Efficient Multilingual Sign Language Production via Sparse Keyframe Learning
Not on the map. Why?
Abstract (arXiv)
Sign Language Production (SLP) faces a fundamental trade-off: direct text-to-pose models suffer from regression-to-the-mean effects, while dictionary-retrieval methods produce disjointed transitions. To resolve this, we propose a novel training paradigm that leverages sparse keyframes to capture the underlying kinematic distribution of human signing. By generating dense motion from discrete anchors, our approach mitigates regression-to-the-mean while ensuring fluid articulation. To achieve this at scale, we introduce FAST, an ultra-efficient sign segmentation model that automatically mines precise temporal boundaries. We then present SignSparK, a Conditional Flow Matching (CFM) framework that utilizes these temporal anchors to synthesize 3D signing sequences. This keyframe-driven formulation also unlocks Keyframe-to-Pose (KF2P) generation, making precise spatiotemporal editing of signing sequences possible. Furthermore, SignSparK scales across four distinct sign languages, constituting the largest multilingual SLP framework to date, and integrates 3D Gaussian Splatting for photorealistic rendering. Extensive evaluations demonstrate that SignSparK achieves state-of-the-art across diverse SLP tasks and multilingual benchmarks. Our code is available at https://github.com/JianHe0628/SignSparK.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 73 of its 108 references that are in the map. First posted on arXiv 11 Mar 2026.
Builds on
73 of 108 references.
References · 73
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
- 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
- 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
- 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
38 more
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
- 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
- 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
- 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
- 2023Human Motion Diffusion as a Generative Priorcited by 354
- 2016The KIT Motion-Language Datasetcited by 334
- 2023Reconstructing Hands in 3D with Transformerscited by 298
- 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
- 2020Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translationcited by 254
- 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
- 2021Improving Sign Language Translation with Monolingual Data by Sign Back-Translationcited by 177
- 2020How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Languagecited by 172
- 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 172
- 2020Progressive Transformers for End-to-End Sign Language Productioncited by 119
- 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 117
- 2023Gloss-free Sign Language Translation: Improving from Visual-Language Pretrainingcited by 104
- 2024Flexible Motion In-betweening with Diffusion Modelscited by 69
- 2024Video Interpolation with Diffusion Modelscited by 67
- 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
- 2020Adversarial Training for Multi-Channel Sign Language Productioncited by 57
- 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 57
- 2025Uni-Sign: Toward Unified Sign Language Understanding at Scalecited by 55
- 2017Deep Video Generation, Prediction and Completion of Human Action Sequencescited by 50
- 2021Continuous 3D Multi-Channel Sign Language Production via Progressive Transformers and Mixture Density Networkscited by 50
- 2021Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitivescited by 50
- 2017Audio to Body Dynamicscited by 48
- 2023Neural Sign Actors: A diffusion model for 3D sign language production from textcited by 48
- 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 45
- 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolationcited by 42
- 2024YouTube-SL-25: A Large-Scale, Open-Domain Multilingual Sign Language Parallel Corpuscited by 36
- 2024T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Textcited by 30
- 2023SignAvatars: A Large-scale 3D Sign Language Holistic Motion Dataset and Benchmarkcited by 29
- 2020Structure-Aware Human-Action Generationcited by 28
- 2020Real-Time Sign Language Detection using Human Pose Estimationcited by 28
- 2021BBC-Oxford British Sign Language Datasetcited by 27
- 2021Aligning Subtitles in Sign Language Videoscited by 26
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026SignNet-1M: Large-Scale Multilingual Sign Language Video Dataset with Downstream Benchmarks
- 2025Beyond Gloss: A Hand-Centric Framework for Gloss-Free Sign Language Translation
- 2026SignMimic: Robust High-Quality Sign Language Motion Generation via Human-Shape-Oblivious Pose Transfer Guidance
- 2026SignRefine: Adapting Foundational Video Models for Sign Language Generation
- 2025Stable Signer: Hierarchical Sign Language Generative Model
- 2025Text-Driven Diffusion Model for Sign Language Production
- 2025Text2Sign Diffusion: A Generative Approach for Gloss-Free Sign Language Production
- 2026Attention-Steered Vision-Language Models for Sign Language Translation