mlsanityData to 7 Oct 2026

Harmonious Group Choreography with Trajectory-Controllable Diffusion

arXiv 2403.06189 ↗First posted 10 Mar 2024cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Creating group choreography from music is crucial in cultural entertainment and virtual reality, with a focus on generating harmonious movements. Despite growing interest, recent approaches often struggle with two major challenges: multi-dancer collisions and single-dancer foot sliding. To address these challenges, we propose a Trajectory-Controllable Diffusion (TCDiff) framework, which leverages non-overlapping trajectories to ensure coherent and aesthetically pleasing dance movements. To mitigate collisions, we introduce a Dance-Trajectory Navigator that generates collision-free trajectories for multiple dancers, utilizing a distance-consistency loss to maintain optimal spacing. Furthermore, to reduce foot sliding, we present a footwork adaptor that adjusts trajectory displacement between frames, supported by a relative forward-kinematic loss to further reinforce the correlation between movements and trajectories. Experiments demonstrate our method's superiority.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 33 of its 61 references that are in the map. First posted on arXiv 10 Mar 2024.

Builds on

33 of 61 references.

References · 33

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  6. 2018On the Continuity of Rotation Representations in Neural Networkscited by 1,186
  7. 2021Diffusion Probabilistic Models for 3D Point Cloud Generationcited by 734
  8. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  9. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  10. 2022EDGE: Editable Dance Generation From Musiccited by 284
  11. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  12. 2019Local Relation Networks for Image Recognitioncited by 210
21 more
  1. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
  2. 2022Stochastic Trajectory Prediction via Motion Indeterminacy Diffusioncited by 184
  3. 2020We are More than Our Joints: Predicting how 3D Bodies Movecited by 115
  4. 2019SR-LSTM: State Refinement for LSTM towards Pedestrian Trajectory Predictioncited by 111
  5. 2021Learning Motion Priors for 4D Human Body Capture in 3D Scenescited by 98
  6. 2021SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Predictioncited by 97
  7. 2022FineDance: A Fine-grained Choreography Dataset for 3D Full Body Dance Generationcited by 87
  8. 2020Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learningcited by 81
  9. 2023TM2D: Bimodality Driven 3D Dance Generation via Music-Text Integrationcited by 76
  10. 2021THUNDR: Transformer-based 3D HUmaN Reconstruction with Markerscited by 50
  11. 2020Multimodal Deep Generative Models for Trajectory Prediction: A Conditional Variational Autoencoder Approachcited by 47
  12. 20233D Human Mesh Estimation from Virtual Markerscited by 44
  13. 2023Trajectory-Aware Body Interaction Transformer for Multi-Person Pose Forecastingcited by 25
  14. 2018Weakly Supervised Deep Recurrent Neural Networks for Basic Dance Step Generationcited by 22
  15. 2023Dance with You: The Diversity Controllable Dancer Generation via Diffusion Modelscited by 17
  16. 2023Realistic Human Motion Generation with Cross-Diffusion Modelscited by 17
  17. 2021When Creators Meet the Metaverse: A Survey on Computational Artscited by 12
  18. 2023LongDanceDiff: Long-term Dance Generation with Conditional Diffusion Modelcited by 12
  19. 2024Exploring Multi-Modal Control in Music-Driven Dance Generationcited by 10
  20. 2019An Extensive Review of Computational Dance Automation Techniques and Applicationscited by 8
  21. 2023EnchantDance: Unveiling the Potential of Music-Driven Dance Movementcited by 7

Built on by

Cited by year

Citing papers per year: 2025: 3.

3 papers.