mlsanityData to 7 Oct 2026

neuROSym: Deployment and Evaluation of a ROS-based Neuro-Symbolic Model for Human Motion Prediction

arXiv 2407.01593 ↗First posted 24 Jun 2024cs.RO cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Autonomous mobile robots can rely on several human motion detection and prediction systems for safe and efficient navigation in human environments, but the underline model architectures can have different impacts on the trustworthiness of the robot in the real world. Among existing solutions for context-aware human motion prediction, some approaches have shown the benefit of integrating symbolic knowledge with state-of-the-art neural networks. In particular, a recent neuro-symbolic architecture (NeuroSyM) has successfully embedded context with a Qualitative Trajectory Calculus (QTC) for spatial interactions representation. This work achieved better performance than neural-only baseline architectures on offline datasets. In this paper, we extend the original architecture to provide neuROSym, a ROS package for robot deployment in real-world scenarios, which can run, visualise, and evaluate previous neural-only and neuro-symbolic models for motion prediction online. We evaluated these models, NeuroSyM and a baseline SGAN, on a TIAGo robot in two scenarios with different human motion patterns. We assessed accuracy and runtime performance of the prediction models, showing a general improvement in case our neuro-symbolic architecture is used. We make the neuROSym package1 publicly available to the robotics community.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 16 of its 33 references that are in the map. First posted on arXiv 24 Jun 2024.

Builds on

16 of 33 references.

References · 16

  1. 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 687
  2. 2017DESIRE: Distant Future Prediction in Dynamic Scenes with Interacting Agentscited by 310
  3. 2020It Is Not the Journey but the Destination: Endpoint Conditioned Trajectory Predictioncited by 235
  4. 2019Human Motion Trajectory Prediction: A Surveycited by 231
  5. 2020Spatio-Temporal Graph Transformer Networks for Pedestrian Trajectory Predictioncited by 218
  6. 2020Long-term Human Motion Prediction with Scene Contextcited by 191
  7. 2018Crowd-Robot Interaction: Crowd-aware Robot Navigation with Attention-based Deep Reinforcement Learningcited by 162
  8. 2019Peeking into the Future: Predicting Future Person Activities and Locations in Videoscited by 112
  9. 2019TH"OR: Human-Robot Navigation Data Collection and Accurate Motion Trajectories Datasetcited by 36
  10. 2020Dynamic and Static Context-aware LSTM for Multi-agent Motion Predictioncited by 21
  11. 2019Social and Scene-Aware Trajectory Prediction in Crowded Spacescited by 19
  12. 2019Deep Local Trajectory Replanning and Control for Robot Navigationcited by 15
4 more
  1. 2020REFORM: Recognizing F-formations for Social Robotscited by 9
  2. 2020Experimental Evaluation of Human Motion Prediction: Toward Safe and Efficient Human Robot Collaborationcited by 7
  3. 2020Generating Reliable and Efficient Predictions of Human Motion: A Promising Encounter between Physics and Neural Networkscited by 6
  4. 2023A Neuro-Symbolic Approach for Enhanced Human Motion Predictioncited by 4

Built on by

Not cited yet.