mlsanityData to 14 Oct 2026

Learning Quantised Structure-Preserving Motion Representations for Dance Fingerprinting

arXiv 2604.00927 ↗First posted 1 Apr 2026cs.CV cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

We present DANCEMATCH, an end-to-end framework for motion-based dance retrieval, the task of identifying semantically similar choreographies directly from raw video, defined as DANCE FINGERPRINTING. While existing motion analysis and retrieval methods can compare pose sequences, they rely on continuous embeddings that are difficult to index, interpret, or scale. In contrast, DANCEMATCH constructs compact, discrete motion signatures that capture the spatio-temporal structure of dance while enabling efficient large-scale retrieval. Our system integrates Skeleton Motion Quantisation (SMQ) with Spatio-Temporal Transformers (STT) to encode human poses, extracted via Apple CoMotion, into a structured motion vocabulary. We further design DANCE RETRIEVAL ENGINE (DRE), which performs sub-linear retrieval using a histogram-based index followed by re-ranking for refined matching. To facilitate reproducible research, we release DANCETYPESBENCHMARK, a pose-aligned dataset annotated with quantised motion tokens. Experiments demonstrate robust retrieval across diverse dance styles and strong generalisation to unseen choreographies, establishing a foundation for scalable motion fingerprinting and quantitative choreographic analysis.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 45 references that are in the map. First posted on arXiv 1 Apr 2026.

Builds on

25 of 45 references.

References · 25

  1. 2019VIBE: Video Inference for Human Body Pose and Shape Estimationcited by 620
  2. 2017Single-Shot Multi-Person 3D Pose Estimation From Monocular RGBcited by 195
  3. 2020A Spatio-temporal Transformer for 3D Human Motion Predictioncited by 133
  4. 2020HMOR: Hierarchical Multi-Person Ordinal Relations for Monocular Multi-Person 3D Pose Estimationcited by 44
  5. 2021Graph-Based 3D Multi-Person Pose Estimation Using Multi-View Imagescited by 38
  6. 2023Music-Driven Group Choreographycited by 37
  7. 2025BioPose: Biomechanically-accurate 3D Pose Estimation from Monocular Videoscited by 16
  8. 2020PI-Net: Pose Interacting Network for Multi-Person Monocular 3D Pose Estimationcited by 15
  9. 2024Dance Any Beat: Blending Beats with Visuals in Dance Video Generationcited by 14
  10. 2021Audio-based Musical Version Identification: Elements and Challengescited by 13
  11. 2022Dual networks based 3D Multi-Person Pose Estimation from Monocular Videocited by 13
  12. 2025CoMotion: Concurrent Multi-person 3D Motioncited by 13
13 more
  1. 2023BeatDance: A Beat-Based Model-Agnostic Contrastive Learning Framework for Music-Dance Retrievalcited by 12
  2. 2018Let's Dance: Learning From Online Dance Videoscited by 7
  3. 2023EnchantDance: Unveiling the Potential of Music-Driven Dance Movementcited by 7
  4. 2025Skeleton Motion Words for Unsupervised Skeleton-Based Temporal Action Segmentationcited by 6
  5. 2021Will You Ever Become Popular? Learning to Predict Virality of Dance Clipscited by 2
  6. 2024Digital Fingerprinting on Multimedia: A Surveycited by 2
  7. 2025Just Another Hour on TikTok: ID sampling to obtain a complete slice of TikTokcited by 2
  8. 2022SpectroMap: Peak detection algorithm for audio fingerprintingcited by 1
  9. 2024Music Genre Classification: Training an AI modelcited by 1
  10. 2024Automatic Dance Video Segmentation for Understanding Choreographycited by 1
  11. 2024Skeleton-Based Action Recognition with Spatial-Structural Graph Convolutioncited by 1
  12. 2025Cooperative Inference for Real-Time 3D Human Pose Estimation in Multi-Device Edge Networkscited by 1
  13. 2025MotionRAG-Diff: A Retrieval-Augmented Diffusion Framework for Long-Term Music-to-Dance Generationcited by 1

Built on by

Not cited yet.