SkeletonContext: Skeleton-side Context Prompt Learning for Zero-Shot Skeleton-based Action Recognition
Not on the map. Why?
Abstract (arXiv)
Zero-shot skeleton-based action recognition aims to recognize unseen actions by transferring knowledge from seen categories through semantic descriptions. Most existing methods typically align skeleton features with textual embeddings within a shared latent space. However, the absence of contextual cues, such as objects involved in the action, introduces an inherent gap between skeleton and semantic representations, making it difficult to distinguish visually similar actions. To address this, we propose SkeletonContext, a prompt-based framework that enriches skeletal motion representations with language-driven contextual semantics. Specifically, we introduce a Cross-Modal Context Prompt Module, which leverages a pretrained language model to reconstruct masked contextual prompts under guidance derived from LLMs. This design effectively transfers linguistic context to the skeleton encoder for instance-level semantic grounding and improved cross-modal alignment. In addition, a Key-Part Decoupling Module is incorporated to decouple motion-relevant joint features, ensuring robust action understanding even in the absence of explicit object interactions. Extensive experiments on multiple benchmarks demonstrate that SkeletonContext achieves state-of-the-art performance under both conventional and generalized zero-shot settings, validating its effectiveness in reasoning about context and distinguishing fine-grained, visually similar actions.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 35 of its 50 references that are in the map. First posted on arXiv 31 Mar 2026.
Builds on
35 of 50 references.
References · 35
- 2017Attention Is All You Needcited by 59,932
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2016Layer Normalizationcited by 5,579
- 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
- 2021Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural Language Processingcited by 2,222
- 2022Visual Prompt Tuningcited by 1,674
- 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,548
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
- 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,213
- 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
- 2022MaPLe: Multi-modal Prompt Learningcited by 685
- 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
23 more
- 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 530
- 2021Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognitioncited by 317
- 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 188
- 2017PKU-MMD: A Large Scale Benchmark for Continuous Multi-Modal Human Action Understandingcited by 101
- 2019Fine-Grained Action Retrieval Through Multiple Parts-of-Speech Embeddingscited by 101
- 2023Learning Discriminative Representations for Skeleton Based Action Recognitioncited by 62
- 2017Learning Robust Visual-Semantic Embeddingscited by 56
- 2022Generative Action Description Prompts for Skeleton-based Action Recognitioncited by 43
- 2022VL-BEiT: Generative Vision-Language Pretrainingcited by 39
- 2022DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learningcited by 33
- 2024Revealing Key Details to See Differences: A Novel Prototypical Perspective for Skeleton-based Action Recognitioncited by 29
- 2021Syntactically Guided Generative Embeddings for Zero-Shot Skeleton Action Recognitioncited by 24
- 2023Zero-shot Skeleton-based Action Recognition via Mutual Information Estimation and Maximizationcited by 24
- 2024Part-aware Unified Representation of Language and Skeleton for Zero-shot Action Recognitioncited by 23
- 2020Bidirectional Encoder Representations from Transformers (BERT): A sentiment analysis odysseycited by 21
- 2019Skeleton based Zero Shot Action Recognition in Joint Pose-Language Semantic Spacecited by 19
- 2024Fine-Grained Side Information Guided Dual-Prompts for Zero-Shot Skeleton Action Recognitioncited by 19
- 2024SA-DVAE: Improving Zero-Shot Skeleton-Based Action Recognition by Disentangled Variational Autoencoderscited by 19
- 2024Neuron: Learning Context-Aware Evolving Representations for Zero-Shot Skeleton Action Recognitioncited by 13
- 2023One-Shot Action Recognition via Multi-Scale Spatial-Temporal Skeleton Matchingcited by 12
- 2024CrossGLG: LLM Guides One-shot Skeleton-based 3D Action Recognition in a Cross-level Mannercited by 11
- 2023Multi-Semantic Fusion Model for Generalized Zero-Shot Skeleton-Based Action Recognitioncited by 9
- 2025Frequency-Semantic Enhanced Variational Autoencoder for Zero-Shot Skeleton-based Action Recognitioncited by 6
Built on by
Citing papers per year: 2026: 3.
3 papers.