mlsanityData to 14 Oct 2026

A2V-SLP: Alignment-Aware Variational Modeling for Disentangled Sign Language Production

arXiv 2602.11861 ↗First posted 12 Feb 2026cs.LG cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Building upon recent structural disentanglement frameworks for sign language production, we propose A2V-SLP, an alignment-aware variational framework that learns articulator-wise disentangled latent distributions rather than deterministic embeddings. A disentangled Variational Autoencoder (VAE) encodes ground-truth sign pose sequences and extracts articulator-specific mean and variance vectors, which are used as distributional supervision for training a non-autoregressive Transformer. Given text embeddings, the Transformer predicts both latent means and log-variances, while the VAE decoder reconstructs the final sign pose sequences through stochastic sampling at the decoding stage. This formulation maintains articulator-level representations by avoiding deterministic latent collapse through distributional latent modeling. In addition, we integrate a gloss attention mechanism to strengthen alignment between linguistic input and articulated motion. Experimental results show consistent gains over deterministic latent regression, achieving state-of-the-art back-translation performance and improved motion realism in a fully gloss-free setting.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 16 of its 25 references that are in the map. First posted on arXiv 12 Feb 2026.

Builds on

16 of 25 references.

References · 16

  1. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 583
  2. 2021Improving Sign Language Translation with Monolingual Data by Sign Back-Translationcited by 179
  3. 2020Progressive Transformers for End-to-End Sign Language Productioncited by 120
  4. 2020Adversarial Training for Multi-Channel Sign Language Productioncited by 57
  5. 2023Gloss Attention for Gloss-free Sign Language Translationcited by 51
  6. 2021Continuous 3D Multi-Channel Sign Language Production via Progressive Transformers and Mixture Density Networkscited by 50
  7. 2022G2P-DDM: Generating Sign Pose Sequence from Gloss Sequence with Discrete Diffusion Modelcited by 38
  8. 2024A Data-Driven Representation for Sign Language Productioncited by 17
  9. 2023Improving 3D Pose Estimation for Sign Languagecited by 16
  10. 2024Sign-IDD: Iconicity Disentangled Diffusion for Sign Language Productioncited by 16
  11. 2023Autoregressive Sign Language Production: A Gloss-Free Approach with Discrete Representationscited by 9
  12. 2024Sign Stitching: A Novel Approach to Sign Language Productioncited by 8
4 more
  1. 2025Disentangle and Regularize: Sign Language Production with Articulator-Based Disentanglement and Channel-Aware Regularizationcited by 5
  2. 2022Non-Autoregressive Sign Language Production via Knowledge Distillationcited by 4
  3. 2025SLRTP2025 Sign Language Production Challenge: Methodology, Results, and Future Workcited by 4
  4. 2025Motion is the Choreographer: Learning Latent Pose Dynamics for Seamless Sign Language Generationcited by 1

Built on by

Not cited yet.