mlsanityData to 14 Oct 2026

Autoregressive Sign Language Production: A Gloss-Free Approach with Discrete Representations

arXiv 2309.12179 ↗First posted 21 Sep 2023cs.CVcited by 9

Not on the map. Why?

Abstract (arXiv)

Gloss-free Sign Language Production (SLP) offers a direct translation of spoken language sentences into sign language, bypassing the need for gloss intermediaries. This paper presents the Sign language Vector Quantization Network, a novel approach to SLP that leverages Vector Quantization to derive discrete representations from sign pose sequences. Our method, rooted in both manual and non-manual elements of signing, supports advanced decoding methods and integrates latent-level alignment for enhanced linguistic coherence. Through comprehensive evaluations, we demonstrate superior performance of our method over prior SLP methods and highlight the reliability of Back-Translation and Fr'echet Gesture Distance as evaluation metrics.

Key facts. Cited by 9 papers in the map (data through 14 Oct 2026). Builds on 25 of its 36 references that are in the map. First posted on arXiv 21 Sep 2023.

Builds on

25 of 36 references.

References · 25

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  4. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  5. 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
  6. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,162
  7. 2016The Concrete Distribution: A Continuous Relaxation of Discrete Random Variablescited by 1,148
  8. 2020Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translationcited by 256
  9. 2020Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identitycited by 202
  10. 2020How2Sign: A Large-scale Multimodal Dataset for Continuous American Sign Languagecited by 173
  11. 2020Progressive Transformers for End-to-End Sign Language Productioncited by 120
  12. 2018Robots Learn Social Skills: End-to-End Learning of Co-Speech Gesture Generation for Humanoid Robotscited by 110
13 more
  1. 2018A Neural Temporal Model for Human Motion Predictioncited by 87
  2. 2022Open-Domain Sign Language Translation Learned from Online Videocited by 72
  3. 2022Signing at Scale: Learning to Co-Articulate Signs for Large-Scale Photo-Realistic Sign Language Productioncited by 61
  4. 2020Adversarial Training for Multi-Channel Sign Language Productioncited by 57
  5. 2023Gloss Attention for Gloss-free Sign Language Translationcited by 51
  6. 2021Mixed SIGNals: Sign Language Production via a Mixture of Motion Primitivescited by 50
  7. 2023CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learningcited by 33
  8. 2023Gloss-Free End-to-End Sign Language Translationcited by 32
  9. 2022Considerations for meaningful sign language machine translation based on glossescited by 25
  10. 2022Sign Language Video Retrieval with Free-Form Textual Queriescited by 23
  11. 2022Ham2Pose: Animating Sign Language Notation into Pose Sequencescited by 21
  12. 2023Discrete Prompt Optimization via Constrained Generation for Zero-shot Re-rankercited by 20
  13. 2021Unsupervised Document Expansion for Information Retrieval with Stochastic Text Generationcited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 4; 2026: 1.

9 papers.

  1. 2024SignCLIP: Connecting Text and Sign Language by Contrastive Learningcited by 20
  2. 2024A Data-Driven Representation for Sign Language Productioncited by 17
  3. 2024Sign Stitching: A Novel Approach to Sign Language Productioncited by 8
  4. 2025Meaningful Pose-Based Sign Language Evaluationcited by 6
  5. 2025Disentangle and Regularize: Sign Language Production with Articulator-Based Disentanglement and Channel-Aware Regularizationcited by 5
  6. 2025SLRTP2025 Sign Language Production Challenge: Methodology, Results, and Future Workcited by 4
  7. 2024Studying and Mitigating Biases in Sign Language Understanding Modelscited by 1
  8. 2025Teach Me Sign: Stepwise Prompting LLM for Sign Language Productioncited by 1
  9. 2026A2V-SLP: Alignment-Aware Variational Modeling for Disentangled Sign Language Productioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text
  2. 2025Text2Sign Diffusion: A Generative Approach for Gloss-Free Sign Language Production
  3. 2024LLMs are Good Sign Language Translators
  4. 2022G2P-DDM: Generating Sign Pose Sequence from Gloss Sequence with Discrete Diffusion Model
  5. 2022Non-Autoregressive Sign Language Production via Knowledge Distillation
  6. 2026Corpus Augmentation for Sign Language Translation via LLM-Guided Video Stitching
  7. 2025Hierarchical Feature Alignment for Gloss-Free Sign Language Translation
  8. 2025RVLF: A Reinforcing Vision-Language Framework for Gloss-Free Sign Language Translation