NCSTR: Node-Centric Decoupled Spatio-Temporal Reasoning for Video-based Human Pose Estimation
Not on the map. Why?
Abstract (arXiv)
Video-based human pose estimation remains challenged by motion blur, occlusion, and complex spatiotemporal dynamics. Existing methods often rely on heatmaps or implicit spatio-temporal feature aggregation, which limits joint topology expressiveness and weakens cross-frame consistency. To address these problems, we propose a novel node-centric framework that explicitly integrates visual, temporal, and structural reasoning for accurate pose estimation. First, we design a visuo-temporal velocity-based joint embedding that fuses sub-pixel joint cues and inter-frame motion to build appearance- and motion-aware representations. Then, we introduce an attention-driven pose-query encoder, which applies attention over joint-wise heatmaps and frame-wise features to map the joint representations into a pose-aware node space, generating image-conditioned joint-aware node embeddings. Building upon these node embeddings, we propose a dual-branch decoupled spatio-temporal attention graph that models temporal propagation and spatial constraint reasoning in specialized local and global branches. Finally, a node-space expert fusion module is proposed to adaptively fuse the complementary outputs from both branches, integrating local and global cues for final joint predictions. Extensive experiments on three widely used video pose benchmarks demonstrate that our method outperforms state-of-the-art methods. The results highlight the value of explicit node-centric reasoning, offering a new perspective for advancing video-based human pose estimation.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 26 of its 33 references that are in the map. First posted on arXiv 20 Mar 2026.
Builds on
26 of 33 references.
References · 26
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2017Graph Attention Networkscited by 8,854
- 2018YOLOv3: An Incremental Improvementcited by 2,652
- 2020Deep Learning-Based Human Pose Estimation: A Surveycited by 205
- 2017PoseTrack: A Benchmark for Human Pose Estimation and Trackingcited by 173
- 2021Deep Dual Consecutive Network for Human Pose Estimationcited by 51
- 2020Combining detection and tracking for human pose estimation in videoscited by 49
- 2016PoseTrack: Joint Multi-Person Pose Estimation and Trackingcited by 44
- 2019Learning Temporal Pose Estimation from Sparsely-Labeled Videoscited by 39
- 2021Multi-modal 3D Human Pose Estimation with 2D Weak Supervision in Autonomous Drivingcited by 39
- 2021Learning Dynamics via Graph Neural Networks for Human Pose Estimation and Trackingcited by 37
- 2023DiffPose: SpatioTemporal Diffusion Model for Video-Based Human Pose Estimationcited by 36
14 more
- 2021ViPNAS: Efficient Video Pose Estimation via Neural Architecture Searchcited by 26
- 2023Bidirectionally Deformable Motion Modulation For Video-based Human Pose Transfercited by 25
- 2022Temporal Feature Alignment and Mutual Information Maximization for Video-Based Human Pose Estimationcited by 24
- 2023Vision-Based Human Pose Estimation via Deep Learning: A Surveycited by 20
- 2023Mutual Information-Based Temporal Difference Learning for Human Pose Estimation in Videocited by 17
- 2023SHaRPose: Sparse High-Resolution Representation for Human Pose Estimationcited by 11
- 2024Video-Based Human Pose Regression via Decoupled Space-Time Aggregationcited by 10
- 2021Relation-Based Associative Joint Location for Human Pose Estimation in Videoscited by 7
- 2024Joint-Motion Mutual Learning for Pose Estimation in Videoscited by 7
- 2025Causal-Inspired Multitask Learning for Video-Based Human Pose Estimationcited by 5
- 2025High-Resolution Spatiotemporal Modeling with Global-Local State Space Models for Video-Based Human Pose Estimationcited by 4
- 2023Improving Multi-Person Pose Tracking with A Confidence Networkcited by 3
- 2025Optimizing Human Pose Estimation Through Focused Human and Joint Regionscited by 3
- 2025SpatioTemporal Learning for Human Pose Estimation in Sparsely-Labeled Videoscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026HSTGFormer: Hyper Spatial-Temporal Graph Transformer for 3D Human Pose Estimation
- 2025PRGCN: A Graph Memory Network for Cross-Sequence Pattern Reuse in 3D Human Pose Estimation
- 2026Cambrian-P: Pose-Grounded Video Understanding
- 2026HYPERPOSE: Hyperbolic Kinematic Phase-Space Attention for 3D Human Pose Estimation
- 2025Efficient Diffusion-Based 3D Human Pose Estimation with Hierarchical Temporal Pruning
- 2023Seeing the Pose in the Pixels: Learning Pose-Aware Representations in Vision Transformers
- 2026Motion-Adaptive Multi-Scale Temporal Modelling with Skeleton-Constrained Spatial Graphs for Efficient 3D Human Pose Estimation
- 2026Learning Proposes, Geometry Disposes: A Modular Framework for Efficient Spatial Reasoning