mlsanityData to 13 Oct 2026

SARGes: Semantically Aligned Reliable Gesture Generation via Intent Chain

arXiv 2503.20202 ↗First posted 26 Mar 2025cs.CL cs.AI cs.HCcited by 1

Not on the map. Why?

Abstract (arXiv)

Co-speech gesture generation enhances human-computer interaction realism through speech-synchronized gesture synthesis. However, generating semantically meaningful gestures remains a challenging problem. We propose SARGes, a novel framework that leverages large language models (LLMs) to parse speech content and generate reliable semantic gesture labels, which subsequently guide the synthesis of meaningful co-speech gestures.First, we constructed a comprehensive co-speech gesture ethogram and developed an LLM-based intent chain reasoning mechanism that systematically parses and decomposes gesture semantics into structured inference steps following ethogram criteria, effectively guiding LLMs to generate context-aware gesture labels. Subsequently, we constructed an intent chain-annotated text-to-gesture label dataset and trained a lightweight gesture label generation model, which then guides the generation of credible and semantically coherent co-speech gestures. Experimental results demonstrate that SARGes achieves highly semantically-aligned gesture labeling (50.2% accuracy) with efficient single-pass inference (0.4 seconds). The proposed method provides an interpretable intent reasoning pathway for semantic gesture synthesis.

Key facts. Cited by 1 paper in the map (data through 13 Oct 2026). Builds on 26 of its 35 references that are in the map. First posted on arXiv 26 Mar 2025.

Builds on

26 of 35 references.

References · 26

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,156
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,541
  4. 2023Qwen Technical Reportcited by 3,310
  5. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,032
  6. 2023MotionGPT: Human Motion as a Foreign Languagecited by 525
  7. 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 393
  8. 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 268
  9. 2023Using an LLM to Help With Code Understandingcited by 227
  10. 2020Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identitycited by 200
  11. 2022Listen, Denoise, Action! Audio-Driven Motion Synthesis with Diffusion Modelscited by 189
  12. 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latentscited by 157
14 more
  1. 2021Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agentscited by 106
  2. 2023DiffuseStyleGesture: Stylized Audio-Driven Co-Speech Gesture Generation with Diffusion Modelscited by 85
  3. 2020Gesticulator: A framework for semantically-aware speech-driven gesture generationcited by 84
  4. 2023A Comprehensive Review of Data-Driven Co-Speech Gesture Generationcited by 66
  5. 2024DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generationcited by 61
  6. 2022Learning in Audio-visual Context: A Review, Analysis, and New Perspectivecited by 44
  7. 2023Digital Life Project: Autonomous 3D Characters with Social Intelligencecited by 43
  8. 2024Semantic Gesticulator: Semantics-Aware Co-Speech Gesture Synthesiscited by 40
  9. 2021Text2Video: Text-driven Talking-head Video Synthesis with Personalized Phoneme-Pose Dictionarycited by 27
  10. 2023DiffMotion: Speech-Driven Gesture Synthesis Using Denoising Diffusion Modelcited by 22
  11. 2022Audio-driven Neural Gesture Reenactment with Video Motion Graphscited by 18
  12. 2023Story-to-Motion: Synthesizing Infinite and Controllable Character Animation from Long Textcited by 15
  13. 2023GesGPT: Speech Gesture Synthesis With Text Parsing from ChatGPTcited by 6
  14. 2022Deep Gesture Generation for Social Robots Using Type-Specific Librariescited by 5

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Intentional Gesture: Deliver Your Intentions with Gestures for Speech
  2. 2025CoordSpeaker: Exploiting Gesture Captioning for Coordinated Caption-Empowered Co-Speech Gesture Generation
  3. 2025SemGes: Semantics-aware Co-Speech Gesture Generation using Semantic Coherence and Relevance Learning
  4. 2023LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generation
  5. 2026Perceptually Grounded and Semantics-Aware Evaluation for Holistic Co-Speech Gesture Generation
  6. 2025GestureHYDRA: Semantic Co-speech Gesture Synthesis via Hybrid Modality Diffusion Transformer and Cascaded-Synchronized Retrieval-Augmented Generation
  7. 2026Semantic Motion Anchors: Bridging Motion and Meaning in Co-Speech Gestures
  8. 2025GestureLSM: Latent Shortcut based Co-Speech Gesture Generation with Spatial-Temporal Modeling