mlsanityData to 13 Oct 2026

Real-time body pose non-verbal communication with a consistency-based reliability measure

arXiv 2606.09390 ↗First posted 8 Jun 2026cs.CV cs.AI cs.ROcited by 0

Not on the map. Why?

Abstract (arXiv)

Body movement communicates intent at distances and in conditions where neither the face, nor speech can be captured. We study the recognition of communicative intent from 2D body pose alone. We argue that body motion is a reliable signal especially in scenarios that require real time low-cost on-device person-to-robot communication in long distance environments, such as rescue missions. However, existing resources do not isolate this signal. Affective corpora combine body, face, voice and text, while skeleton action-recognition benchmarks label the action performed rather than the message conveyed. We release a dataset of real frames of full-body pose covering ten communicative intents and we compare it against other real (IPC) and synthetic (MotionLCM, VEO3.1, Kimodo) ones that span a range of difficulty. We target systems that can run on a robot's limited onboard hardware. We benchmark multiple models, from skeleton graph classifiers to joint motion-forecasting networks, and report performance metrics together with frame rate on an embedded GPU (NVIDIA Orin~Nano), since speed matters as much as accuracy in our scenario. Finally, we show that a model's own autoregressive self-consistency works as an unsupervised reliability signal. We give a short proof that bounds the probability that a self-consistent prediction is correct, show that this probability grows with the number of consistent steps, and identify the conditions under which a confident prediction can still be false, benchmarked against industry-standard metrics.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 25 of its 48 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

25 of 48 references.

References · 25

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,550
  2. 2017On Calibration of Modern Neural Networkscited by 4,902
  3. 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,430
  4. 2019Expressive Body Capture: 3D Hands, Face, and Body from a Single Imagecited by 1,603
  5. 2019AMASS: Archive of Motion Capture as Surface Shapescited by 1,213
  6. 2018Spatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognitioncited by 1,202
  7. 2017Selective Classification for Deep Neural Networkscited by 825
  8. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 637
  9. 2019NTU RGB+D 120: A Large-Scale Benchmark for 3D Human Activity Understandingcited by 530
  10. 2023CoTracker: It is Better to Track Togethercited by 518
  11. 2021Channel-wise Topology Refinement Graph Convolution for Skeleton-Based Action Recognitioncited by 317
  12. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 255
13 more
  1. 2022MotionBERT: A Unified Perspective on Learning Human Motion Representationscited by 190
  2. 2024MotionLCM: Real-time Controllable Motion Generation via Latent Consistency Modelcited by 167
  3. 2018Bias-Reduced Uncertainty Estimation for Deep Neural Classifierscited by 109
  4. 2021Constructing Stronger and Faster Baselines for Skeleton-based Action Recognitioncited by 87
  5. 2022PYSKL: Towards Good Practices for Skeleton Action Recognitioncited by 83
  6. 2022ViTPose++: Vision Transformer for Generic Body Pose Estimationcited by 65
  7. 2018Survey on Emotional Body Gesture Recognitioncited by 47
  8. 2021Pose Transformers (POTR): Human Motion Prediction with Non-Autoregressive Transformerscited by 46
  9. 2022MotionMixer: MLP-based 3D Human Body Pose Forecastingcited by 42
  10. 2025Seamless Interaction: Dyadic Audiovisual Motion Modeling and Large-Scale Datasetcited by 37
  11. 2026Kimodo: Scaling Controllable Human Motion Generationcited by 36
  12. 2023Nonverbal Cues in Human-Robot Interaction: A Communication Studies Perspectivecited by 16
  13. 2023InfoGCN++: Learning Representation by Predicting the Future for Online Human Skeleton-based Action Recognitioncited by 11

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning to Understand Body Language from Flight through Robust 3D Avatar Placing
  2. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines
  3. 2024The Language of Motion: Unifying Verbal and Non-verbal Language of 3D Human Motion
  4. 2026Skeletons in Flow: Graph Structured Flow Matching for Human Motion Prediction
  5. 2025CoRI: Communication of Robot Intent for Physical Human-Robot Interaction ↗
  6. 2026GIVE: Grounding Human Gestures in Vision-Language-Action Models
  7. 2026Towards Motion Turing Test: Evaluating Human-Likeness in Humanoid Robots
  8. 2025An Architecture-Led Hybrid Report on Body Language Detection Project