mlsanityData to 7 Oct 2026

SignSparK: Efficient Multilingual Sign Language Production via Sparse Keyframe Learning

arXiv 2603.10446 ↗First posted 11 Mar 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Sign Language Production (SLP) faces a fundamental trade-off: direct text-to-pose models suffer from regression-to-the-mean effects, while dictionary-retrieval methods produce disjointed transitions. To resolve this, we propose a novel training paradigm that leverages sparse keyframes to capture the underlying kinematic distribution of human signing. By generating dense motion from discrete anchors, our approach mitigates regression-to-the-mean while ensuring fluid articulation. To achieve this at scale, we introduce FAST, an ultra-efficient sign segmentation model that automatically mines precise temporal boundaries. We then present SignSparK, a Conditional Flow Matching (CFM) framework that utilizes these temporal anchors to synthesize 3D signing sequences. This keyframe-driven formulation also unlocks Keyframe-to-Pose (KF2P) generation, making precise spatiotemporal editing of signing sequences possible. Furthermore, SignSparK scales across four distinct sign languages, constituting the largest multilingual SLP framework to date, and integrates 3D Gaussian Splatting for photorealistic rendering. Extensive evaluations demonstrate that SignSparK achieves state-of-the-art across diverse SLP tasks and multilingual benchmarks. Our code is available at https://github.com/JianHe0628/SignSparK.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 73 of its 108 references that are in the map. First posted on arXiv 11 Mar 2026.

Builds on

73 of 108 references.

References · 73

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  3. 2022Classifier-Free Diffusion Guidancecited by 5,717
  4. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  5. 2017Quo Vadis, Action Recognition? A New Model and the Kinetics Datasetcited by 3,259
  6. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,600
  7. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  8. 2022Human Motion Diffusion Modelcited by 1,062
  9. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  10. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  11. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  12. 2023MotionGPT: Human Motion as a Foreign Languagecited by 521
38 more
  1. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  2. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  3. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 463
  4. 2022MotionCLIP: Exposing Human Motion Generation to CLIP Spacecited by 406
  5. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  6. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  7. 2023Human Motion Diffusion as a Generative Priorcited by 354
  8. 2016The KIT Motion-Language Datasetcited by 334
  9. 2023Reconstructing Hands in 3D with Transformerscited by 298
  10. 2021BABEL: Bodies, Action and Behavior with English Labelscited by 261
  11. 2020Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translationcited by 254
  12. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
  13. 2021Improving Sign Language Translation with Monolingual Data by Sign Back-Translationcited by 177
  14. 2020How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Languagecited by 172
  15. 2023SparseCtrl: Adding Sparse Controls to Text-to-Video Diffusion Modelscited by 172
  16. 2020Progressive Transformers for End-to-End Sign Language Productioncited by 119
  17. 2024WiLoR: End-to-end 3D Hand Localization and Reconstruction in-the-wildcited by 117
  18. 2023Gloss-free Sign Language Translation: Improving from Visual-Language Pretrainingcited by 104
  19. 2024Flexible Motion In-betweening with Diffusion Modelscited by 69
  20. 2024Video Interpolation with Diffusion Modelscited by 67
  21. 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
  22. 2020Adversarial Training for Multi-Channel Sign Language Productioncited by 57
  23. 2024Neural Localizer Fields for Continuous 3D Human Pose and Shape Estimationcited by 57
  24. 2025Uni-Sign: Toward Unified Sign Language Understanding at Scalecited by 55
  25. 2017Deep Video Generation, Prediction and Completion of Human Action Sequencescited by 50
  26. 2021Continuous 3D Multi-Channel Sign Language Production via Progressive Transformers and Mixture Density Networkscited by 50
  27. 2021Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitivescited by 50
  28. 2017Audio to Body Dynamicscited by 48
  29. 2023Neural Sign Actors: A diffusion model for 3D sign language production from textcited by 48
  30. 2019Learning Diverse Stochastic Human-Action Generators by Learning Smooth Latent Transitionscited by 45
  31. 2024Generative Inbetweening: Adapting Image-to-Video Models for Keyframe Interpolationcited by 42
  32. 2024YouTube-SL-25: A Large-Scale, Open-Domain Multilingual Sign Language Parallel Corpuscited by 36
  33. 2024T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Textcited by 30
  34. 2023SignAvatars: A Large-scale 3D Sign Language Holistic Motion Dataset and Benchmarkcited by 29
  35. 2020Structure-Aware Human-Action Generationcited by 28
  36. 2020Real-Time Sign Language Detection using Human Pose Estimationcited by 28
  37. 2021BBC-Oxford British Sign Language Datasetcited by 27
  38. 2021Aligning Subtitles in Sign Language Videoscited by 26

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026SignNet-1M: Large-Scale Multilingual Sign Language Video Dataset with Downstream Benchmarks
  2. 2025Beyond Gloss: A Hand-Centric Framework for Gloss-Free Sign Language Translation
  3. 2026SignMimic: Robust High-Quality Sign Language Motion Generation via Human-Shape-Oblivious Pose Transfer Guidance
  4. 2026SignRefine: Adapting Foundational Video Models for Sign Language Generation
  5. 2025Stable Signer: Hierarchical Sign Language Generative Model
  6. 2025Text-Driven Diffusion Model for Sign Language Production
  7. 2025Text2Sign Diffusion: A Generative Approach for Gloss-Free Sign Language Production
  8. 2026Attention-Steered Vision-Language Models for Sign Language Translation