mlsanityData to 7 Oct 2026

DynaPURLS: Dynamic Refinement of Part-Aware Representations for Skeleton-Based Zero-Shot Action Recognition

arXiv 2512.11941 ↗First posted 12 Dec 2025cs.CV cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Zero-shot skeleton-based action recognition (ZS-SAR) is fundamentally constrained by prevailing approaches that rely on aligning skeleton features with static, class-level semantics. This coarse-grained alignment fails to bridge the domain shift between seen and unseen classes, thereby impeding the effective transfer of fine-grained visual knowledge. To address these limitations, we introduce DynaPURLS, a unified framework that establishes robust, multi-scale visual-semantic correspondences and dynamically refines them at inference time to enhance generalization. Our framework leverages a large language model to generate hierarchical textual descriptions that encompass both global movements and local body-part dynamics. Concurrently, an adaptive partitioning module produces fine-grained visual representations by semantically grouping skeleton joints. To fortify this fine-grained alignment against the train-test domain shift, DynaPURLS incorporates a dynamic refinement module. During inference, this module adapts textual features to the incoming visual stream via a lightweight learnable projection. This refinement process is stabilized by a confidence-aware, class-balanced memory bank, which mitigates error propagation from noisy pseudo-labels. Extensive experiments on three large-scale benchmark datasets, including NTU RGB+D 60/120 and PKU-MMD, demonstrate that DynaPURLS significantly outperforms prior art, setting new state-of-the-art records. The source code is made publicly available at https://github.com/Alchemist0754/DynaPURLS

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 47 of its 73 references that are in the map. First posted on arXiv 12 Dec 2025.

Builds on

47 of 73 references.

References · 47

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020Language Models are Few-Shot Learnerscited by 32,199
  3. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  4. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
  5. 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
  6. 2020Center-based 3D Object Detection and Trackingcited by 1,143
  7. 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
  8. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
  9. 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 530
  10. 2022Continual Test-Time Domain Adaptationcited by 520
  11. 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
  12. 2021PointCLIP: Point Cloud Understanding by CLIPcited by 461
35 more
  1. 2022Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Modelscited by 379
  2. 2021MEMO: Test Time Robustness via Adaptation and Augmentationcited by 376
  3. 2021Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognitioncited by 317
  4. 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 262
  5. 2021Revisiting Skeleton-based Action Recognitioncited by 256
  6. 2019Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 228
  7. 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
  8. 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 197
  9. 2020A Review of Generalized Zero-Shot Learning Methodscited by 159
  10. 2016Learning a Deep Embedding Model for Zero-Shot Learningcited by 153
  11. 2022NOTE: Robust Continual Test-time Adaptation Against Temporal Correlationcited by 150
  12. 2023Diverse Data Augmentation with Diffusions for Effective Test-time Prompt Tuningcited by 150
  13. 2024Efficient Test-Time Adaptation of Vision-Language Modelscited by 138
  14. 2017Semantic Autoencoder for Zero-Shot Learningcited by 133
  15. 2020Entropy Maximization and Meta Classification for Out-Of-Distribution Detection in Semantic Segmentationcited by 133
  16. 2019Skeleton-Based Action Recognition with Multi-Stream Adaptive Graph Convolutional Networkscited by 103
  17. 2022CALIP: Zero-Shot Enhancement of CLIP with Parameter-free Attentioncited by 103
  18. 2017PKU-MMD: A Large Scale Benchmark for Continuous Multi-Modal Human Action Understandingcited by 101
  19. 2019Fine-Grained Action Retrieval Through Multiple Parts-of-Speech Embeddingscited by 101
  20. 2017Learning Robust Visual-Semantic Embeddingscited by 56
  21. 2021Semantics Disentangling for Generalized Zero-Shot Learningcited by 56
  22. 2014Improving zero-shot learning by mitigating the hubness problemcited by 53
  23. 2022MSDN: Mutually Semantic Distillation Network for Zero-Shot Learningcited by 48
  24. 2023AdaNPC: Exploring Non-Parametric Classifier for Test-Time Adaptationcited by 48
  25. 2019Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Predictioncited by 46
  26. 2021Syntactically Guided Generative Embeddings for Zero-Shot Skeleton Action Recognitioncited by 24
  27. 2023Zero-shot Skeleton-based Action Recognition via Mutual Information Estimation and Maximizationcited by 24
  28. 2024Part-aware Unified Representation of Language and Skeleton for Zero-shot Action Recognitioncited by 23
  29. 2024Fine-Grained Side Information Guided Dual-Prompts for Zero-Shot Skeleton Action Recognitioncited by 19
  30. 2024SA-DVAE: Improving Zero-Shot Skeleton-Based Action Recognition by Disentangled Variational Autoencoderscited by 19
  31. 2024Unified Entropy Optimization for Open-Set Test-Time Adaptationcited by 17
  32. 2023Spatiotemporal Decouple-and-Squeeze Contrastive Learning for Semi-Supervised Skeleton-based Action Recognitioncited by 16
  33. 2023Deep Learning for Video-Text Retrieval: a Reviewcited by 15
  34. 2024Neuron: Learning Context-Aware Evolving Representations for Zero-Shot Skeleton Action Recognitioncited by 13
  35. 2019Spatio-Temporal Pyramid Graph Convolutions for Human Action Recognition and Postural Assessmentcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.