mlsanityData to 13 Oct 2026

Agentic Pipeline for Self-Synchronized Multiview Joint Angle Monitoring in Uncalibrated Environments

arXiv 2605.16419 ↗First posted 14 May 2026cs.CV cs.AI cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Kinematic monitoring plays a critical role in long-term rehabilitation for patients with spinal cord injury (SCI), where multi-view markerless motion capture methods have shown significant potential. However, owing to the reliance on calibration and the difficulty of achieving multi-view synchronization, their deployment in patient self-deployed environments remains challenging. In this work, we propose an agentic pipeline for self-synchronized multi-view joint angle monitoring in uncalibrated environments using two cameras without hardware triggers. The Multimodal large language models enable automatic video synchronization and agent-driven self-verification. State-of-the-art monocular 2D pose estimation models are employed to extract candidate poses, where an agent-based selection mechanism is then applied to automatically identify and track the target subject, thereby producing consistent 2D poses in the presence of multiple individuals and occlusions. Such 2D poses are optimized to estimate joint angles from uncalibrated multi-view pose sequences, ensuring interpretability through explicit geometric modeling. Validation against Vicon system demonstrated the strong performance, achieving an MAE of 5.97^circ ± 2.36^circ and a Pearson correlation coefficient of 0.962 ± 0.014. The proposed method is expected to provide a practical, patient self-deployable system to perform daily kinematic monitoring in uncalibrated home environments.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 5 of its 19 references that are in the map. First posted on arXiv 14 May 2026.

Builds on

5 of 19 references.

References · 5

  1. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,383
  2. 2024Sapiens: Foundation for Human Vision Modelscited by 229
  3. 2023RTMPose: Real-Time Multi-Person Pose Estimation based on MMPosecited by 171
  4. 2021Neural Monocular 3D Human Motion Capture with Physical Awarenesscited by 70
  5. 2020A Single RGB Camera Based Gait Analysis with a Mobile Tele-Robot for Healthcarecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AgentSTAR: Agentic Shape Tracking and Reconstruction from Monocular Videos
  2. 2026Agentic AI for Personalized Physiotherapy: A Multi-Agent Framework for Generative Video Training and Real-Time Pose Correction
  3. 2025A Structure-aware and Motion-adaptive Framework for 3D Human Pose Estimation with Mamba
  4. 2026Motion-Adaptive Multi-Scale Temporal Modelling with Skeleton-Constrained Spatial Graphs for Efficient 3D Human Pose Estimation
  5. 2025KinTwin: Imitation Learning with Torque and Muscle Driven Biomechanical Models Enables Precise Replication of Able-Bodied and Impaired Movement from Markerless Motion Capture
  6. 2026Agentic RSR: Real-to-Sim-to-Real through Scene Reconstruction and Execution-Grounded Robot Policies
  7. 2026SPINE: Bridging the Cyber-Physical Gap with Agentic AI
  8. 2026MetaWorld: Scaling Multi-Agent Video World Model from Single-view Video Data