mlsanityData to 14 Oct 2026

Spatial-Temporal Graph Mamba for Music-Guided Dance Video Synthesis

arXiv 2507.06689 ↗First posted 9 Jul 2025cs.CVcited by 4

On the map: State-space sequence models (S4, Mamba) → Video, motion and generative Mamba models

Abstract (arXiv)

We propose a novel spatial-temporal graph Mamba (STG-Mamba) for the music-guided dance video synthesis task, i.e., to translate the input music to a dance video. STG-Mamba consists of two translation mappings: music-to-skeleton translation and skeleton-to-video translation. In the music-to-skeleton translation, we introduce a novel spatial-temporal graph Mamba (STGM) block to effectively construct skeleton sequences from the input music, capturing dependencies between joints in both the spatial and temporal dimensions. For the skeleton-to-video translation, we propose a novel self-supervised regularization network to translate the generated skeletons, along with a conditional image, into a dance video. Lastly, we collect a new skeleton-to-video translation dataset from the Internet, containing 54,944 video clips. Extensive experiments demonstrate that STG-Mamba achieves significantly better results than existing methods.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Video, motion and generative Mamba models, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 66 of its 89 references that are in the map. First posted on arXiv 9 Jul 2025.

Builds on

66 of 89 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Motion Mamba: Efficient and Long Sequence Motion Generation12 Mar
  2. 2023Selective Structured State-Spaces for Long-Form Video Understanding25 Mar

Other references · 64

  1. 2017Attention Is All You Needcited by 60,361
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2017Graph Attention Networkscited by 8,923
  5. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  6. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  7. 2014On the Properties of Neural Machine Translation: Encoder-Decoder Approachescited by 1,304
  8. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,209
  9. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
  10. 2016Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,064
  11. 2022Simplified State Space Layers for Sequence Modelingcited by 788
  12. 2022Hungry Hungry Hippos: Towards Language Modeling with State Space Modelscited by 499
38 more
  1. 2021AI Choreographer: Music Conditioned 3D Dance Generation with AIST++cited by 485
  2. 2020Action2Motion: Conditioned Generation of 3D Human Motionscited by 441
  3. 2024U-Mamba: Enhancing Long-range Dependency for Biomedical Image Segmentationcited by 419
  4. 2018Video-to-Video Synthesiscited by 390
  5. 2018Graph Convolutional Networks for Text Classificationcited by 345
  6. 2018Everybody Dance Nowcited by 315
  7. 2020Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentationcited by 300
  8. 2022EDGE: Editable Dance Generation From Musiccited by 287
  9. 2024VM-UNet: Vision Mamba UNet for Medical Image Segmentationcited by 287
  10. 2020StyleRig: Rigging StyleGAN for 3D Control over Portrait Imagescited by 268
  11. 2024SegMamba: Long-range Sequential Modeling Mamba For 3D Medical Image Segmentationcited by 266
  12. 2022Long Range Language Modeling via Gated State Spacescited by 265
  13. 2019Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 228
  14. 2022Bailando: 3D Dance Generation by Actor-Critic GPT with Choreographic Memorycited by 212
  15. 2019Scaling and Benchmarking Self-Supervised Visual Representation Learningcited by 201
  16. 2020Unsupervised Intra-domain Adaptation for Semantic Segmentation through Self-Supervisioncited by 198
  17. 2019Few-shot Video-to-Video Synthesiscited by 197
  18. 2019Learning Individual Styles of Conversational Gesturecited by 191
  19. 2024Swin-UMamba: Mamba-based UNet with ImageNet-based pretrainingcited by 179
  20. 2019Graph Convolutional Label Noise Cleaner: Train a Plug-and-play Action Classifier for Anomaly Detectioncited by 171
  21. 2019Knowledge-Embedded Routing Network for Scene Graph Generationcited by 164
  22. 2019Liquid Warping GAN: A Unified Framework for Human Motion Imitation, Appearance Transfer and Novel View Synthesiscited by 161
  23. 2019An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognitioncited by 151
  24. 2020Learning by Analogy: Reliable Supervision from Transformations for Unsupervised Optical Flow Estimationcited by 120
  25. 2021DanceFormer: Music Conditioned 3D Dance Generation with Parametric Motion Transformercited by 111
  26. 2022Long Movie Clip Classification with State-Space Video Modelscited by 106
  27. 2019Fast Interactive Object Annotation with Curve-GCNcited by 95
  28. 2020Learning to Generate Diverse Dance Motions with Transformercited by 85
  29. 2020Video Representation Learning by Recognizing Temporal Transformationscited by 83
  30. 2019Attention Guided Graph Convolutional Networks for Relation Extractioncited by 82
  31. 2020Dance Revolution: Long-Term Dance Generation with Music via Curriculum Learningcited by 81
  32. 2022Efficient Movie Scene Detection using State-Space Transformerscited by 51
  33. 2019Learning to Cluster Faces on an Affinity Graphcited by 50
  34. 2017Audio to Body Dynamicscited by 48
  35. 2020Bipartite Graph Reasoning GANs for Person Image Generationcited by 34
  36. 2020Learning to dance: A graph convolutional adversarial network to generate realistic dance motions from audiocited by 33
  37. 2020ChoreoNet: Towards Music to Dance Synthesis with Choreographic Action Unitcited by 31
  38. 2019Dance Dance Generation: Motion Transfer for Internet Videoscited by 28

50 most cited of 64 All 64 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.

  1. 2025Consistent and Controllable Image Animation with Motion Linear Diffusion Transformerscited by 3
  2. 2026OmniDance: Multimodal Driven Dance Video Generation with Large-scale Internet Datacited by 3
  3. 2025ReactionMamba: Generating Short & Long Human Reaction Sequencescited by 0
  4. 2026TrajMamba: An Ego-Motion-Guided Mamba Model for Pedestrian Trajectory Prediction from an Egocentric Perspectivecited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026Not Like Transformers: Drop the Beat Representation for Dance Generation with Mamba-Based Diffusion Model
  2. 2025How Animals Dance (When You're Not Looking)
  3. 2024DanceFusion: A Spatio-Temporal Skeleton Diffusion Transformer for Audio-Driven Dance Motion Reconstruction
  4. 2026Listen to Rhythm, Choose Movements: Autoregressive Multimodal Dance Generation via Diffusion and Mamba with Decoupled Dance Dataset
  5. 2026Wan-Dancer: A Hierarchical Framework for Minute-scale Coherent Music-to-Dance Generation
  6. 2024Dance Any Beat: Blending Beats with Visuals in Dance Video Generation
  7. 2025MATHDance: Mamba-Transformer Architecture with Uniform Tokenization for High-Quality 3D Dance Generation
  8. 2025X-Dancer: Expressive Music to Human Dance Video Generation