mlsanityData to 7 Oct 2026

Learning by Neighbor-Aware Semantics, Deciding by Open-form Flows: Towards Robust Zero-Shot Skeleton Action Recognition

arXiv 2511.09388 ↗First posted 12 Nov 2025cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

Recognizing unseen skeleton action categories remains highly challenging due to the absence of corresponding skeletal priors. Existing approaches generally follow an ``align-then-classify'' paradigm but face two fundamental issues, textiti.e., (i) fragile point-to-point alignment arising from imperfect semantics, and (ii) rigid classifiers restricted by static decision boundaries and coarse-grained anchors. To address these issues, we propose a novel method for zero-shot skeleton action recognition, termed textttFlora, which builds upon FlexibLe neighbOr-aware semantic attunement and open-form distRibution-aware flow clAssifier. Specifically, we flexibly attune textual semantics by incorporating neighboring inter-class contextual cues to form direction-aware regional semantics, coupled with a cross-modal geometric consistency objective that ensures stable and robust point-to-region alignment. Furthermore, we employ noise-free flow matching to bridge the modality distribution gap between semantic and skeleton latent embeddings, while a condition-free contrastive regularization enhances discriminability, leading to a distribution-aware classifier with fine-grained decision boundaries achieved through token-level velocity predictions. Extensive experiments on three benchmark datasets validate the effectiveness of our method, showing particularly impressive performance even when trained with only 10% of the seen data. Code is available at https://github.com/cseeyangchen/Flora.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 36 of its 49 references that are in the map. First posted on arXiv 12 Nov 2025.

Builds on

36 of 49 references.

References · 36

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2022Scalable Diffusion Models with Transformerscited by 5,931
  3. 2022Flow Matching for Generative Modelingcited by 5,426
  4. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  6. 2022Building Normalizing Flows with Stochastic Interpolantscited by 964
  7. 2016NTU RGB+D: A Large Scale Dataset for 3D Human Activity Analysiscited by 683
  8. 2024Movie Gen: A Cast of Media Foundation Modelscited by 614
  9. 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 530
  10. 2024Flow Matching Guide and Codecited by 291
  11. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
  12. 2023Audiobox: Unified Audio Generation with Natural Language Promptscited by 120
24 more
  1. 2017PKU-MMD: A Large Scale Benchmark for Continuous Multi-Modal Human Action Understandingcited by 101
  2. 2019Fine-Grained Action Retrieval Through Multiple Parts-of-Speech Embeddingscited by 101
  3. 2017Learning Robust Visual-Semantic Embeddingscited by 56
  4. 2023Motion Flow Matching for Human Motion Synthesis and Editingcited by 36
  5. 2025FlowTok: Flowing Seamlessly Across Text and Image Tokenscited by 31
  6. 2021Video Pose Distillation for Few-Shot, Fine-Grained Sports Action Recognitioncited by 29
  7. 2025Contrastive Flow Matchingcited by 29
  8. 2024Connect, Collapse, Corrupt: Learning Cross-Modal Tasks with Uni-Modal Datacited by 27
  9. 2024Flowing from Words to Pixels: A Noise-Free Framework for Cross-Modality Evolutioncited by 26
  10. 2023Zero-shot Skeleton-based Action Recognition via Mutual Information Estimation and Maximizationcited by 24
  11. 2024Part-aware Unified Representation of Language and Skeleton for Zero-shot Action Recognitioncited by 23
  12. 2025VITA: Vision-to-Action Flow Matching Policycited by 23
  13. 2023Prompt-Guided Zero-Shot Anomaly Action Recognition using Pretrained Deep Skeleton Featurescited by 21
  14. 2024Towards Universal Soccer Video Understandingcited by 21
  15. 2019Skeleton based Zero Shot Action Recognition in Joint Pose-Language Semantic Spacecited by 19
  16. 2024Fine-Grained Side Information Guided Dual-Prompts for Zero-Shot Skeleton Action Recognitioncited by 19
  17. 2024SA-DVAE: Improving Zero-Shot Skeleton-Based Action Recognition by Disentangled Variational Autoencoderscited by 19
  18. 2022Skeletal Video Anomaly Detection using Deep Learning: Survey, Challenges and Future Directionscited by 14
  19. 2024Neuron: Learning Context-Aware Evolving Representations for Zero-Shot Skeleton Action Recognitioncited by 13
  20. 2023Multi-Semantic Fusion Model for Generalized Zero-Shot Skeleton-Based Action Recognitioncited by 9
  21. 2024Zero-Shot Skeleton-based Action Recognition with Dual Visual-Text Alignmentcited by 9
  22. 2024An Information Compensation Framework for Zero-Shot Skeleton-based Action Recognitioncited by 7
  23. 2025Frequency-Semantic Enhanced Variational Autoencoder for Zero-Shot Skeleton-based Action Recognitioncited by 6
  24. 2025Zero-Shot Skeleton-Based Action Recognition With Prototype-Guided Feature Alignmentcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Frequency-Enhanced Diffusion Models: Curriculum-Guided Semantic Alignment for Zero-Shot Skeleton Action Recognition
  2. 2025Boosting Skeleton-based Zero-Shot Action Recognition with Training-Free Test-Time Adaptation
  3. 2024Bridging the Skeleton-Text Modality Gap: Diffusion-Powered Modality Alignment for Zero-shot Skeleton-based Action Recognition
  4. 2025SkeletonAgent: An Agentic Interaction Framework for Skeleton-based Action Recognition
  5. 2026LLM Enhanced Action Recognition via Hierarchical Global-Local Skeleton-Language Model
  6. 2026T-MOR: Learning Motion-Aware Skeleton Representations for Human Action Recognition
  7. 2026Universal Skeleton Understanding via Differentiable Rendering and MLLMs
  8. 2026Neurosymbolic Framework for Concept-Driven Logical Reasoning in Skeleton-Based Human Action Recognition