mlsanityData to 7 Oct 2026

Synergy and Synchrony in Couple Dances

arXiv 2409.04440 ↗First posted 6 Sep 2024cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

This paper asks to what extent social interaction influences one's behavior. We study this in the setting of two dancers dancing as a couple. We first consider a baseline in which we predict a dancer's future moves conditioned only on their past motion without regard to their partner. We then investigate the advantage of taking social information into account by conditioning also on the motion of their dancing partner. We focus our analysis on Swing, a dance genre with tight physical coupling for which we present an in-the-wild video dataset. We demonstrate that single-person future motion prediction in this context is challenging. Instead, we observe that prediction greatly benefits from considering the interaction partners' behavior, resulting in surprisingly compelling couple dance synthesis results (see supp. video). Our contributions are a demonstration of the advantages of socially conditioned future motion prediction and an in-the-wild, couple dance video dataset to enable future research in this direction. Video results are available on the project website: https://von31.github.io/synNsync

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 44 of its 60 references that are in the map. First posted on arXiv 6 Sep 2024.

Builds on

44 of 60 references.

References · 44

  1. 2017Attention Is All You Needcited by 59,932
  2. 2017Neural Discrete Representation Learningcited by 4,650
  3. 2022Human Motion Diffusion Modelcited by 1,062
  4. 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
  5. 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
  6. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  7. 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
  8. 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
  9. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
  10. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
  11. 2023Human Motion Diffusion as a Generative Priorcited by 354
  12. 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
32 more
  1. 2017On human motion prediction using recurrent neural networkscited by 336
  2. 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
  3. 2022EDGE: Editable Dance Generation From Musiccited by 284
  4. 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 237
  5. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
  6. 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
  7. 2021Stochastic Scene-Aware Motion Predictioncited by 203
  8. 2019Learning Individual Styles of Conversational Gesturecited by 190
  9. 2022Generating Holistic 3D Human Motion from Speechcited by 180
  10. 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
  11. 2022BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesiscited by 177
  12. 2022TEACH: Temporal Action Composition for 3D Humanscited by 173
  13. 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
  14. 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
  15. 2022COUCH: Towards Controllable Human-Chair Interactionscited by 134
  16. 2022Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motioncited by 125
  17. 2024TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representationcited by 93
  18. 2022Towards Diverse and Natural Scene-aware 3D Human Motion Synthesiscited by 91
  19. 2023Hi4D: 4D Instance Segmentation of Close Human Interactioncited by 87
  20. 2020Learning to Generate Diverse Dance Motions with Transformercited by 85
  21. 2019Context-aware Human Motion Predictioncited by 83
  22. 2024From Audio to Photoreal Embodiment: Synthesizing Humans in Conversationscited by 82
  23. 2021Multi-Person Extreme Motion Predictioncited by 74
  24. 2021Responsive Listening Head Generation: A Benchmark Dataset and Baselinecited by 67
  25. 2024Humanoid Locomotion as Next Token Predictioncited by 63
  26. 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
  27. 2024Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompanimentcited by 46
  28. 2023Generative Proxemics: A Prior for 3D Social Interaction from Imagescited by 43
  29. 2022Interaction Transformer for Human Reaction Generationcited by 42
  30. 2023Music-Driven Group Choreographycited by 36
  31. 2022Contact-aware Human Motion Forecastingcited by 27
  32. 2023Reconstructing Three-Dimensional Models of Interacting Humanscited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 5; 2026: 3.

8 papers.