mlsanityData to 7 Oct 2026

GenPrior: Unleashing Text-to-Motion Generative Priors for Zero-Shot Skeleton-based Action Recognition

arXiv 2608.02236 ↗First posted 3 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Zero-shot skeleton-based action recognition (ZSAR) aims to recognize unseen action categories by aligning skeleton features with textual semantics. However, existing methods rely on text-derived prototypes that inherently lack geometric structure and physical constraints, resulting in a pronounced textitsemantic-kinematic gap. To bridge this gap, we propose GenPrior, the first framework to exploit generative priors from pre-trained Text-to-Motion (T2M) models for ZSAR. Specifically, we introduce Dispersion-Gated Feature Fusion, which distills kinematic prototypes and intra-class dispersion from generative motion sequences and employs a learned gating network to adaptively inject reliable structural cues into textual embeddings while suppressing synthetic artifacts. Furthermore, we propose Generative Prototype Refinement, which leverages these generation-enhanced prototypes as anchors to mine high-confidence unseen samples, calibrating class prototypes toward the true distribution and thereby unleashing strong performance gains. Extensive experiments on NTU-60, NTU-120, and PKU-MMD demonstrate that GenPrior achieves state-of-the-art performance under both zero-shot and generalized zero-shot settings. Code is available at https://github.com/jidongkuang/GenPrior.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 50 references that are in the map. First posted on arXiv 3 Aug 2026.

Builds on

36 of 50 references.

References · 36

  1. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,208
  2. 2022MotionDiffuse: Text-Driven Human Motion Generation with Diffusion Modelcited by 768
  3. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
  4. 2023T2M-GPT: Generating Human Motion from Textual Descriptions with Discrete Representationscited by 577
  5. 2022Executing your Commands via Motion Diffusion in Latent Spacecited by 567
  6. 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 530
  7. 2023MoMask: Generative Masked Modeling of 3D Human Motionscited by 388
  8. 2022PhysDiff: Physics-Guided Human Motion Diffusion Modelcited by 365
  9. 2022TM2T: Stochastic and Tokenized Modeling for the Reciprocal Generation of 3D Human Motions and Textscited by 357
  10. 2023ReMoDiffuse: Retrieval-Augmented Motion Diffusion Modelcited by 282
  11. 2017Feature Generating Networks for Zero-Shot Learningcited by 257
  12. 2022FLAME: Free-form Language-based Motion Synthesis & Editingcited by 217
24 more
  1. 2018Generalized Zero- and Few-Shot Learning via Aligned Variational Autoencoderscited by 206
  2. 2019f-VAEGAN-D2: A Feature Generating Framework for Any-Shot Learningcited by 164
  3. 2019Fine-Grained Action Retrieval Through Multiple Parts-of-Speech Embeddingscited by 101
  4. 2021Contrastive Embedding for Generalized Zero-Shot Learningcited by 94
  5. 2021FREE: Feature Refinement for Generalized Zero-Shot Learningcited by 67
  6. 2021HSVA: Hierarchical Semantic-Visual Adaptation for Zero-Shot Learningcited by 57
  7. 2017Learning Robust Visual-Semantic Embeddingscited by 56
  8. 2024ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Modelcited by 52
  9. 2020Invertible Zero-Shot Recognition Flowscited by 48
  10. 2024StableMoFusion: Towards Robust and Efficient Diffusion-based Motion Generation Frameworkcited by 48
  11. 2024MoGenTS: Motion Generation based on Spatial-Temporal Joint Modelingcited by 40
  12. 2024EnergyMoGen: Compositional Human Motion Generation with Energy-Based Diffusion Model in Latent Spacecited by 30
  13. 2021Syntactically Guided Generative Embeddings for Zero-Shot Skeleton Action Recognitioncited by 24
  14. 2023Zero-shot Skeleton-based Action Recognition via Mutual Information Estimation and Maximizationcited by 24
  15. 2019Skeleton based Zero Shot Action Recognition in Joint Pose-Language Semantic Spacecited by 19
  16. 2024Fine-Grained Side Information Guided Dual-Prompts for Zero-Shot Skeleton Action Recognitioncited by 19
  17. 2024SA-DVAE: Improving Zero-Shot Skeleton-Based Action Recognition by Disentangled Variational Autoencoderscited by 19
  18. 2024USDRL: Unified Skeleton-Based Dense Representation Learning with Multi-Grained Feature Decorrelationcited by 15
  19. 2025Heterogeneous Skeleton-Based Action Representation Learningcited by 12
  20. 2024Zero-Shot Skeleton-based Action Recognition with Dual Visual-Text Alignmentcited by 9
  21. 2024Discriminative Image Generation with Diffusion Models for Zero-Shot Learningcited by 5
  22. 2025Zero-Shot Skeleton-Based Action Recognition With Prototype-Guided Feature Alignmentcited by 4
  23. 2025Learning by Neighbor-Aware Semantics, Deciding by Open-form Flows: Towards Robust Zero-Shot Skeleton Action Recognitioncited by 3
  24. 2025Boosting Skeleton-based Zero-Shot Action Recognition with Training-Free Test-Time Adaptationcited by 3

Built on by

Not cited yet.