mlsanityData to 14 Oct 2026

EASL: Multi-Emotion Guided Semantic Disentanglement for Expressive Sign Language Generation

arXiv 2511.22135 ↗First posted 27 Nov 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models have revolutionized sign language generation by automatically transforming text into high-quality sign language videos, providing accessible communication for the Deaf community. However, existing LLM-based approaches prioritize semantic accuracy while overlooking emotional expressions, resulting in outputs that lack naturalness and expressiveness. We propose EASL (Emotion-Aware Sign Language), a multi-emotion-guided generation architecture for fine-grained emotional integration. We introduce emotion-semantic disentanglement modules with progressive training to separately extract semantic and affective features. During pose decoding, the emotional representations guide semantic interaction to generate sign poses with 7-class emotion confidence scores, enabling emotional expression recognition. Experimental results demonstrate that EASL achieves pose accuracy superior to all compared baselines by integrating multi-emotion information and effectively adapts to diffusion models to generate expressive sign language videos.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 11 of its 19 references that are in the map. First posted on arXiv 27 Nov 2025.

Builds on

11 of 19 references.

References · 11

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  4. 2020Progressive Transformers for End-to-End Sign Language Productioncited by 120
  5. 2020Adversarial Training for Multi-Channel Sign Language Productioncited by 57
  6. 2023Neural Sign Actors: A diffusion model for 3D sign language production from textcited by 49
  7. 2023SignDiff: Diffusion Model for American Sign Language Productioncited by 25
  8. 2023Sign Language Production with Latent Motion Transformercited by 13
  9. 2025Towards AI-driven Sign Language Generation with Non-manual Markerscited by 13
  10. 2022Including Facial Expressions in Contextual Embeddings for Sign Language Generationcited by 12
  11. 2024From Rule-Based Models to Deep Learning Transformers Architectures for Natural Language Processing and Sign Language Translation Systems: Survey, Taxonomy and Performance Evaluationcited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SignRefine: Adapting Foundational Video Models for Sign Language Generation
  2. 2026M3T: Discrete Multi-Modal Motion Tokens for Sign Language Production
  3. 2025Taming Transformer for Emotion-Controllable Talking Face Generation
  4. 2025Advanced Sign Language Video Generation with Compressed and Quantized Multi-Condition Tokenization
  5. 2026SignNet-1M: Large-Scale Multilingual Sign Language Video Dataset with Downstream Benchmarks
  6. 2026MaDiS: Taming Masked Diffusion Language Models for Sign Language Generation
  7. 2025Stable Signer: Hierarchical Sign Language Generative Model
  8. 2025Text2Sign Diffusion: A Generative Approach for Gloss-Free Sign Language Production