mlsanityData to 7 Oct 2026

Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agents

arXiv 2101.11101 ↗First posted 26 Jan 2021cs.HC cs.GRcited by 106

Not on the map. Why?

Cited by 38 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We present Text2Gestures, a transformer-based learning method to interactively generate emotive full-body gestures for virtual agents aligned with natural language text inputs. Our method generates emotionally expressive gestures by utilizing the relevant biomechanical features for body expressions, also known as affective features. We also consider the intended task corresponding to the text and the target virtual agents' intended gender and handedness in our generation pipeline. We train and evaluate our network on the MPI Emotional Body Expressions Database and observe that our network produces state-of-the-art performance in generating gestures for virtual agents aligned with the text for narration or conversation. Our network can generate these gestures at interactive rates on a commodity GPU. We conduct a web-based user study and observe that around 91% of participants indicated our generated gestures to be at least plausible on a five-point Likert Scale. The emotions perceived by the participants from the gestures are also strongly positively correlated with the corresponding intended emotions, with a minimum Pearson coefficient of 0.77 in the valence dimension.

Key facts. Cited by 106 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Jan 2021.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 13; 2023: 41; 2024: 24; 2025: 18; 2026: 8.

106 papers.

Sort:

By area:

  1. 2022Human Motion Diffusion Modelcited by 1,062
  2. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  3. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  4. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  5. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
  6. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  7. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
  8. 2023Guided Motion Diffusion for Controllable Human Motion Synthesiscited by 221
  9. 2022MoFusion: A Framework for Denoising-Diffusion-based Motion Synthesiscited by 218
  10. 2021FaceFormer: Speech-Driven 3D Facial Animation with Transformerscited by 208
  11. 2022BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesiscited by 177
  12. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 164
38 more
  1. 2023GestureDiffuCLIP: Gesture Diffusion Model with CLIP Latentscited by 156
  2. 2023Taming Diffusion Models for Audio-Driven Co-Speech Gesture Generationcited by 128
  3. 2022IMos: Intent-Driven Full-Body Motion Synthesis for Human-Object Interactionscited by 121
  4. 2023AttT2M: Text-Driven Human Motion Generation with Multi-Perspective Attention Mechanismcited by 116
  5. 2024Motion Mamba: Efficient and Long Sequence Motion Generationcited by 111
  6. 2022Learning Hierarchical Cross-Modal Association for Co-Speech Gesture Generationcited by 106
  7. 2023Human Motion Generation: A Surveycited by 95
  8. 2023Diffusion Models for Reinforcement Learning: A Surveycited by 84
  9. 2023Fg-T2M: Fine-Grained Text-Driven Human Motion Generation via Diffusion Modelcited by 79
  10. 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
  11. 2024Flexible Motion In-betweening with Diffusion Modelscited by 69
  12. 2025Go to Zero: Towards Zero-shot Motion Generation with Million-scale Datacited by 67
  13. 2023A Comprehensive Review of Data-Driven Co-Speech Gesture Generationcited by 66
  14. 2023Priority-Centric Human Motion Generation in Discrete Latent Spacecited by 66
  15. 2023Single Motion Diffusioncited by 65
  16. 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
  17. 2024DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generationcited by 61
  18. 2022MoDi: Unconditional Motion Synthesis from Diverse Datacited by 59
  19. 2021Speech2AffectiveGestures: Synthesizing Co-Speech Gestures with Generative Adversarial Affective Expression Learningcited by 58
  20. 2022Audio-Driven Co-Speech Gesture Video Generationcited by 54
  21. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 52
  22. 2024ParCo: Part-Coordinating Text-to-Motion Synthesiscited by 51
  23. 2024MambaTalk: Efficient Holistic Gesture Synthesis with Selective State Space Modelscited by 46
  24. 2023Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphscited by 44
  25. 2022Diffusion Motion: Generate Text-Guided 3D Human Motion by Diffusion Modelcited by 41
  26. 2024ConvoFusion: Multi-Modal Conversational Diffusion for Co-Speech Gesture Synthesiscited by 41
  27. 2023LivelySpeaker: Towards Semantic-Aware Co-Speech Gesture Generationcited by 40
  28. 2024MoGenTS: Motion Generation based on Spatial-Temporal Joint Modelingcited by 40
  29. 2023Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusioncited by 39
  30. 2022Rhythmic Gesticulator: Rhythm-Aware Co-Speech Gesture Synthesis with Hierarchical Neural Embeddingscited by 38
  31. 2025Absolute Coordinates Make Motion Generation Easycited by 27
  32. 2025SimMotionEdit: Text-Based Human Motion Editing with Motion Similarity Predictioncited by 26
  33. 2024M2D2M: Multi-Motion Generation from Text with Discrete Diffusion Modelscited by 23
  34. 2023InterControl: Zero-shot Human Interaction Generation by Controlling Every Jointcited by 22
  35. 2024GUESS:GradUally Enriching SyntheSis for Text-Driven Human Motion Generationcited by 22
  36. 2023BodyFormer: Semantics-guided 3D Body Gesture Synthesis with Transformercited by 21
  37. 2024HUMOS: Human Motion Model Conditioned on Body Shapecited by 20
  38. 2023Language-guided Human Motion Synthesis with Atomic Actionscited by 17

50 most cited of 106 All 106 (JSON)