mlsanityData to 7 Oct 2026

Mudragen: Geometrically Supervised Generation of Interacting Two-Hand Mudras for Preserving Indian Classical Dance Heritage

arXiv 2609.03415 ↗First posted 3 Sep 2026cs.CV cs.MMcited by 0

Not on the map. Why?

Abstract (arXiv)

Automatic generation of hand gestures is essential for the transmission of Indian classical dance and critical for its preservation. Indian classical dance gesture datasets are inherently low-resource, and the canonical Sanskrit definitions of many mudras lack precise textual descriptions, limiting the effectiveness of conventional text-conditioned image generation models. We present MudraGen, a conditional diffusion framework that synthesizes realistic RGB images of textitSamyukta Hasta Mudras -- interactive two-hand gestures from Bharatanatyam (an Indian classical dance form). Unlike prior work on simple hand signs or single-hand gestures, MudraGen introduces geometry-aware supervision to capture the precise coordination, anatomical validity, and cultural nuance of interacting hands. We formulate three geometry-aware objectives: Keypoint Loss for 3D joint alignment, Joint Offset Loss for inter-hand spatial coherence, and Shape Consistency, which serves as an anatomical regularizer by encouraging consistent hand morphology while allowing independent hand poses. Together, these objectives guide the diffusion model toward anatomically plausible and well-coordinated hand configurations, enabling the synthesis of photorealistic and pose-accurate gesture images. Experimental results show that MudraGen surpasses existing state-of-the-art generative approaches in visual realism, anatomical correctness, and preservation of fine hand-pose structure, enabling faithful reproduction of complex Samyukta Hasta mudras. Beyond quantitative gains, its ability to generate culturally grounded and structurally consistent gestures highlights practical applications in cultural preservation and dance education.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 25 of its 48 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

25 of 48 references.

References · 25

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2022Classifier-Free Diffusion Guidancecited by 5,717
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  6. 2014Conditional Generative Adversarial Netscited by 2,152
  7. 2018Demystifying MMD GANscited by 1,268
  8. 2019MediaPipe: A Framework for Building Perception Pipelinescited by 572
  9. 2019Learning joint reconstruction of hands and manipulated objectscited by 377
  10. 2019FreiHAND: A Dataset for Markerless Capture of Hand Pose and Shape from Single RGB Imagescited by 271
  11. 2020InterHand2.6M: A Dataset and Baseline for 3D Interacting Hand Pose Estimation from a Single RGB Imagecited by 244
  12. 2017Learning to Estimate 3D Hand Pose from Single RGB Imagescited by 234
13 more
  1. 2022Interacting Attention Graph for Single Image Two-Hand Reconstructioncited by 87
  2. 2017Real-time Hand Tracking under Occlusion from an Egocentric RGB-D Sensorcited by 84
  3. 2022HaGRID - HAnd Gesture Recognition Image Datasetcited by 43
  4. 2023HandRefiner: Refining Malformed Hands in Generated Images by Diffusion-based Conditional Inpaintingcited by 42
  5. 2024HanDiffuser: Text-to-Image Generation With Realistic Hand Appearancescited by 42
  6. 2018GestureGAN for Hand Gesture-to-Gesture Translation in the Wildcited by 27
  7. 2023Im2Hands: Learning Attentive Implicit Representation of Interacting Two-Hand Shapescited by 26
  8. 2024Hand1000: Generating Realistic Hands from Text with Only 1,000 Imagescited by 11
  9. 2024AttentionHand: Text-driven Controllable Hand Image Generation for 3D Hand Reconstruction in the Wildcited by 10
  10. 2023Decoupled Iterative Refinement Framework for Interacting Hands Reconstruction from a Single RGB Imagecited by 8
  11. 2024FoundHand: Large-Scale Domain-Specific Learning for Controllable Hand Image Generationcited by 8
  12. 2024Pose2Gest: A Few-Shot Model-Free Approach Applied In South Indian Classical Dance Gesture Recognitioncited by 1
  13. 2025Robust Photo-Realistic Hand Gesture Generation: from Single View to Multiple Viewcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Bimanual 3D Hand Motion and Articulation Forecasting in Everyday Images
  2. 2023BOTH2Hands: Inferring 3D Hands from Both Text Prompts and Body Dynamics
  3. 2023Affordance Diffusion: Synthesizing Hand-Object Interactions
  4. 2026CLUTCH: Contextualized Language model for Unlocking Text-Conditioned Hand motion modelling in the wild
  5. 2025Text-Driven 3D Hand Motion Generation from Sign Language Data
  6. 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generation
  7. 2024Adaptive Multi-Modal Control of Digital Human Hand Synthesis Using a Region-Aware Cycle Loss
  8. 2026UniHand: A Unified Model for Diverse Controlled 4D Hand Motion Modeling