mlsanityData to 7 Oct 2026

Speech2Properties2Gestures: Gesture-Property Prediction as a Tool for Generating Representational Gestures from Speech

arXiv 2106.14736 ↗First posted 28 Jun 2021cs.HC cs.CV cs.GRcited by 12

Not on the map. Why?

Abstract (arXiv)

We propose a new framework for gesture generation, aiming to allow data-driven approaches to produce more semantically rich gestures. Our approach first predicts whether to gesture, followed by a prediction of the gesture properties. Those properties are then used as conditioning for a modern probabilistic gesture-generation model capable of high-quality output. This empowers the approach to generate gestures that are both diverse and representational. Follow-ups and more information can be found on the project page: https://svito-zar.github.io/speech2properties2gestures/ .

Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 9 of its 30 references that are in the map. First posted on arXiv 28 Jun 2021.

Builds on

9 of 30 references.

References · 9

  1. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,243
  2. 2020Speech Gesture Generation from the Trimodal Context of Text, Audio, and Speaker Identitycited by 199
  3. 2018Robots Learn Social Skills: End-to-End Learning of Co-Speech Gesture Generation for Humanoid Robotscited by 110
  4. 2020Gesticulator: A framework for semantically-aware speech-driven gesture generationcited by 84
  5. 2019MoGlow: Probabilistic and controllable motion synthesis using normalising flowscited by 47
  6. 2021A large, crowdsourced evaluation of gesture generation systems on common data: The GENEA Challenge 2020cited by 38
  7. 2020Moving fast and slow: Analysis of representations and post-processing in speech-driven automatic gesture generationcited by 20
  8. 2020Sequence-to-Sequence Predictive Model: From Prosody To Communicative Gesturescited by 5
  9. 2020Understanding the Predictability of Gesture Parameters from Speech and their Perceptual Importancecited by 5

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 2; 2023: 3; 2024: 4; 2025: 2.

12 papers.

  1. 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latentscited by 156
  2. 2024ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesiscited by 41
  3. 2022The GENEA Challenge 2022: A large evaluation of data-driven co-speech gesture generationcited by 40
  4. 2024Semantic Gesticulator: Semantics-Aware Co-Speech Gesture Synthesiscited by 39
  5. 2022Rhythmic Gesticulator: Rhythm-Aware Co-Speech Gesture Synthesis with Hierarchical Neural Embeddingscited by 38
  6. 2024Enabling Synergistic Full-Body Control in Prompt-Based Co-Speech Motion Generationcited by 35
  7. 2023Evaluating gesture generation in a large-scale open challenge: The GENEA Challenge 2022cited by 29
  8. 2024Retrieving Semantics from the Deep: an RAG Solution for Gesture Synthesiscited by 25
  9. 2021Multimodal analysis of the predictability of hand-gesture propertiescited by 14
  10. 2023Vision + Language Applications: A Surveycited by 8
  11. 2025Social Agent: Mastering Dyadic Nonverbal Behavior Generation via Conversational LLM Agentscited by 8
  12. 2025Modeling Turn-Taking with Semantically Informed Gesturescited by 1