DynaPURLS: Dynamic Refinement of Part-Aware Representations for Skeleton-Based Zero-Shot Action Recognition
Not on the map. Why?
Abstract (arXiv)
Zero-shot skeleton-based action recognition (ZS-SAR) is fundamentally constrained by prevailing approaches that rely on aligning skeleton features with static, class-level semantics. This coarse-grained alignment fails to bridge the domain shift between seen and unseen classes, thereby impeding the effective transfer of fine-grained visual knowledge. To address these limitations, we introduce DynaPURLS, a unified framework that establishes robust, multi-scale visual-semantic correspondences and dynamically refines them at inference time to enhance generalization. Our framework leverages a large language model to generate hierarchical textual descriptions that encompass both global movements and local body-part dynamics. Concurrently, an adaptive partitioning module produces fine-grained visual representations by semantically grouping skeleton joints. To fortify this fine-grained alignment against the train-test domain shift, DynaPURLS incorporates a dynamic refinement module. During inference, this module adapts textual features to the incoming visual stream via a lightweight learnable projection. This refinement process is stabilized by a confidence-aware, class-balanced memory bank, which mitigates error propagation from noisy pseudo-labels. Extensive experiments on three large-scale benchmark datasets, including NTU RGB+D 60/120 and PKU-MMD, demonstrate that DynaPURLS significantly outperforms prior art, setting new state-of-the-art records. The source code is made publicly available at https://github.com/Alchemist0754/DynaPURLS
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 47 of its 73 references that are in the map. First posted on arXiv 12 Dec 2025.
Builds on
47 of 73 references.
References · 47
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,199
- 2018OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fieldscited by 1,161
- 2020Center-based 3D Object Detection and Trackingcited by 1,143
- 2017A Closer Look at Spatiotemporal Convolutions for Action Recognitioncited by 1,139
- 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
- 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 530
- 2022Continual Test-Time Domain Adaptationcited by 520
- 2022Efficient Test-Time Model Adaptation without Forgettingcited by 467
- 2021PointCLIP: Point Cloud Understanding by CLIPcited by 461
35 more
- 2022Test-Time Prompt Tuning for Zero-Shot Generalization in Vision-Language Modelscited by 379
- 2021MEMO: Test Time Robustness via Adaptation and Augmentationcited by 376
- 2021Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognitioncited by 317
- 2022ULIP: Learning a Unified Representation of Language, Images, and Point Clouds for 3D Understandingcited by 262
- 2021Revisiting Skeleton-based Action Recognitioncited by 256
- 2019Actional-Structural Graph Convolutional Networks for Skeleton-based Action Recognitioncited by 228
- 2022DeepFusion: Lidar-Camera Deep Fusion for Multi-Modal 3D Object Detectioncited by 224
- 2022SoftGroup for 3D Instance Segmentation on Point Cloudscited by 197
- 2020A Review of Generalized Zero-Shot Learning Methodscited by 159
- 2016Learning a Deep Embedding Model for Zero-Shot Learningcited by 153
- 2022NOTE: Robust Continual Test-time Adaptation Against Temporal Correlationcited by 150
- 2023Diverse Data Augmentation with Diffusions for Effective Test-time Prompt Tuningcited by 150
- 2024Efficient Test-Time Adaptation of Vision-Language Modelscited by 138
- 2017Semantic Autoencoder for Zero-Shot Learningcited by 133
- 2020Entropy Maximization and Meta Classification for Out-Of-Distribution Detection in Semantic Segmentationcited by 133
- 2019Skeleton-Based Action Recognition with Multi-Stream Adaptive Graph Convolutional Networkscited by 103
- 2022CALIP: Zero-Shot Enhancement of CLIP with Parameter-free Attentioncited by 103
- 2017PKU-MMD: A Large Scale Benchmark for Continuous Multi-Modal Human Action Understandingcited by 101
- 2019Fine-Grained Action Retrieval Through Multiple Parts-of-Speech Embeddingscited by 101
- 2017Learning Robust Visual-Semantic Embeddingscited by 56
- 2021Semantics Disentangling for Generalized Zero-Shot Learningcited by 56
- 2014Improving zero-shot learning by mitigating the hubness problemcited by 53
- 2022MSDN: Mutually Semantic Distillation Network for Zero-Shot Learningcited by 48
- 2023AdaNPC: Exploring Non-Parametric Classifier for Test-Time Adaptationcited by 48
- 2019Spatiotemporal Co-attention Recurrent Neural Networks for Human-Skeleton Motion Predictioncited by 46
- 2021Syntactically Guided Generative Embeddings for Zero-Shot Skeleton Action Recognitioncited by 24
- 2023Zero-shot Skeleton-based Action Recognition via Mutual Information Estimation and Maximizationcited by 24
- 2024Part-aware Unified Representation of Language and Skeleton for Zero-shot Action Recognitioncited by 23
- 2024Fine-Grained Side Information Guided Dual-Prompts for Zero-Shot Skeleton Action Recognitioncited by 19
- 2024SA-DVAE: Improving Zero-Shot Skeleton-Based Action Recognition by Disentangled Variational Autoencoderscited by 19
- 2024Unified Entropy Optimization for Open-Set Test-Time Adaptationcited by 17
- 2023Spatiotemporal Decouple-and-Squeeze Contrastive Learning for Semi-Supervised Skeleton-based Action Recognitioncited by 16
- 2023Deep Learning for Video-Text Retrieval: a Reviewcited by 15
- 2024Neuron: Learning Context-Aware Evolving Representations for Zero-Shot Skeleton Action Recognitioncited by 13
- 2019Spatio-Temporal Pyramid Graph Convolutions for Human Action Recognition and Postural Assessmentcited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.