Synergy and Synchrony in Couple Dances
Not on the map. Why?
Abstract (arXiv)
This paper asks to what extent social interaction influences one's behavior. We study this in the setting of two dancers dancing as a couple. We first consider a baseline in which we predict a dancer's future moves conditioned only on their past motion without regard to their partner. We then investigate the advantage of taking social information into account by conditioning also on the motion of their dancing partner. We focus our analysis on Swing, a dance genre with tight physical coupling for which we present an in-the-wild video dataset. We demonstrate that single-person future motion prediction in this context is challenging. Instead, we observe that prediction greatly benefits from considering the interaction partners' behavior, resulting in surprisingly compelling couple dance synthesis results (see supp. video). Our contributions are a demonstration of the advantages of socially conditioned future motion prediction and an in-the-wild, couple dance video dataset to enable future research in this direction. Video results are available on the project website: https://von31.github.io/synNsync
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 44 of its 60 references that are in the map. First posted on arXiv 6 Sep 2024.
Builds on
44 of 60 references.
References · 44
- 2017Attention Is All You Needcited by 59,932
- 2017Neural Discrete Representation Learningcited by 4,650
- 2022Human Motion Diffusion Modelcited by 1,062
- 2016Keep it SMPL: Automatic Estimation of 3D Human Pose and Shape from a Single Imagecited by 692
- 2021DROID-SLAM: Deep Visual SLAM for Monocular, Stereo, and RGB-D Camerascited by 673
- 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
- 2021Action-Conditioned 3D Human Motion Synthesis with Transformer VAEcited by 497
- 2022TEMOS: Generating diverse human motions from textual descriptionscited by 486
- 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 479
- 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 438
- 2023Human Motion Diffusion as a Generative Priorcited by 354
- 2023Humans in 4D: Reconstructing and Tracking Humans with Transformerscited by 344
32 more
- 2017On human motion prediction using recurrent neural networkscited by 336
- 2021HuMoR: 3D Human Motion Model for Robust Pose Estimationcited by 319
- 2022EDGE: Editable Dance Generation From Musiccited by 284
- 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 237
- 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 210
- 2023InterGen: Diffusion-based Multi-human Motion Generation under Complex Interactionscited by 205
- 2021Stochastic Scene-Aware Motion Predictioncited by 203
- 2019Learning Individual Styles of Conversational Gesturecited by 190
- 2022Generating Holistic 3D Human Motion from Speechcited by 180
- 2021Synthesis of Compositional Animations from Textual Descriptionscited by 177
- 2022BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesiscited by 177
- 2022TEACH: Temporal Action Composition for 3D Humanscited by 173
- 2021GOAL: Generating 4D Whole-Body Motion for Hand-Object Graspingcited by 142
- 2023Decoupling Human and Camera Motion from Videos in the Wildcited by 140
- 2022COUCH: Towards Controllable Human-Chair Interactionscited by 134
- 2022Learning to Listen: Modeling Non-Deterministic Dyadic Facial Motioncited by 125
- 2024TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representationcited by 93
- 2022Towards Diverse and Natural Scene-aware 3D Human Motion Synthesiscited by 91
- 2023Hi4D: 4D Instance Segmentation of Close Human Interactioncited by 87
- 2020Learning to Generate Diverse Dance Motions with Transformercited by 85
- 2019Context-aware Human Motion Predictioncited by 83
- 2024From Audio to Photoreal Embodiment: Synthesizing Humans in Conversationscited by 82
- 2021Multi-Person Extreme Motion Predictioncited by 74
- 2021Responsive Listening Head Generation: A Benchmark Dataset and Baselinecited by 67
- 2024Humanoid Locomotion as Next Token Predictioncited by 63
- 2023ReMoS: 3D Motion-Conditioned Reaction Synthesis for Two-Person Interactionscited by 62
- 2024Duolando: Follower GPT with Off-Policy Reinforcement Learning for Dance Accompanimentcited by 46
- 2023Generative Proxemics: A Prior for 3D Social Interaction from Imagescited by 43
- 2022Interaction Transformer for Human Reaction Generationcited by 42
- 2023Music-Driven Group Choreographycited by 36
- 2022Contact-aware Human Motion Forecastingcited by 27
- 2023Reconstructing Three-Dimensional Models of Interacting Humanscited by 14
Built on by
Citing papers per year: 2025: 5; 2026: 3.
8 papers.
- 2025DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked Modelingcited by 21
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generationcited by 12
- 2026MultiAnimate: Pose-Guided Image Animation Made Extensiblecited by 6
- 2025Diffusion Forcing for Multi-Agent Interaction Sequence Modelingcited by 4
- 2025CoMPAS3D: A Dataset and Benchmark for Interactive Motioncited by 2
- 2025Poly-Autoregressive Prediction for Modeling Interactionscited by 1
- 2026DyaPlex: Full-Duplex Speech-Motion Model for Dyadic Interactioncited by 1
- 2026GNOCHI: Generative Neural mOdel for Close Human-Human Interactionscited by 0
- 2026GNOCHI: Generative Neural mOdel for Close Human-Human Interactions11 Jul 2026
- 2026DyaPlex: Full-Duplex Speech-Motion Model for Dyadic Interaction2 Jun 2026
- 2026MultiAnimate: Pose-Guided Image Animation Made Extensible25 Feb 2026
- 2025Diffusion Forcing for Multi-Agent Interaction Sequence Modeling19 Dec 2025
- 2025CoMPAS3D: A Dataset and Benchmark for Interactive Motion25 Jul 2025
- 2025DuetGen: Music Driven Two-Person Dance Generation via Hierarchical Masked Modeling23 Jun 2025
- 2025DanceTogether! Identity-Preserving Multi-Person Interactive Video Generation23 May 2025
- 2025Poly-Autoregressive Prediction for Modeling Interactions12 Feb 2025