Dance Generation by Sound Symbolic Words
Not on the map. Why?
Abstract (arXiv)
This study introduces a novel approach to generate dance motions using onomatopoeia as input, with the aim of enhancing creativity and diversity in dance generation. Unlike text and music, onomatopoeia conveys rhythm and meaning through abstract word expressions without constraints on expression and without need for specialized knowledge. We adapt the AI Choreographer framework and employ the Sakamoto system, a feature extraction method for onomatopoeia focusing on phonemes and syllables. Additionally, we present a new dataset of 40 onomatopoeia-dance motion pairs collected through a user survey. Our results demonstrate that the proposed method enables more intuitive dance generation and can create dance motions using sound-symbolic words from a variety of languages, including those without onomatopoeia. This highlights the potential for diverse dance creation across different languages and cultures, accessible to a wider audience. Qualitative samples from our model can be found at: https://sites.google.com/view/onomatopoeia-dance/home/.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 32 of its 66 references that are in the map. First posted on arXiv 6 Jun 2023.
Builds on
32 of 66 references.
References · 32
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2022Human Motion Diffusion Modelcited by 1,062
- 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2022EDGE: Editable Dance Generation From Musiccited by 284
- 2015Structural-RNN: Deep Learning on Spatio-Temporal Graphscited by 234
- 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
- 2019Learning Individual Styles of Conversational Gesturecited by 190
20 more
- 2021Character Controllers Using Motion VAEscited by 182
- 2018Human Motion Prediction via Spatio-Temporal Inpaintingcited by 114
- 2021DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformercited by 111
- 2021Text2Gestures: A Transformer-Based Network for Generating Emotive Body Gestures for Virtual Agentscited by 106
- 2017Deep representation learning for human motion prediction and classificationcited by 97
- 2019Structured Prediction Helps 3D Human Motion Modellingcited by 96
- 2018Neural Kinematic Networks for Unsupervised Motion Retargettingcited by 85
- 2020Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learningcited by 81
- 2017Learning Human Motion Models for Long-term Predictionscited by 67
- 2018Action-Agnostic Human Pose Forecastingcited by 56
- 2019Imitation Learning for Human Pose Predictioncited by 44
- 2020ChoreoNet: Towards Music to Dance Synthesis with Choreographic Action Unitcited by 31
- 2018Weakly Supervised Deep Recurrent Neural Networks for Basic Dance Step Generationcited by 22
- 2020Temporally Guided Music-to-Body-Movement Generationcited by 21
- 2022Dance Style Transfer with Cross-modal Transformercited by 20
- 2019Generative Autoregressive Networks for 3D Dancing Move Synthesis from Musiccited by 14
- 2018Bio-LSTM: A Biomechanically Inspired Recurrent Neural Network for 3D Pedestrian Pose and Gait Predictioncited by 13
- 2016Generative Choreography using Deep Learningcited by 12
- 2020Towards 3D Dance Motion Synthesis and Controlcited by 7
- 2020Feel The Music: Automatically Generating A Dance For An Input Songcited by 5
Built on by
Citing papers per year: 2024: 2.
2 papers.