TH"OR: Human-Robot Navigation Data Collection and Accurate Motion Trajectories Dataset
Not on the map. Why?
Abstract (arXiv)
Understanding human behavior is key for robots and intelligent systems that share a space with people. Accordingly, research that enables such systems to perceive, track, learn and predict human behavior as well as to plan and interact with humans has received increasing attention over the last years. The availability of large human motion datasets that contain relevant levels of difficulty is fundamental to this research. Existing datasets are often limited in terms of information content, annotation quality or variability of human behavior. In this paper, we present TH"OR, a new dataset with human motion trajectory and eye gaze data collected in an indoor environment with accurate ground truth for position, head orientation, gaze direction, social grouping, obstacles map and goal coordinates. TH"OR also contains sensor data collected by a 3D lidar and involves a mobile robot navigating the space. We propose a set of metrics to quantitatively analyze motion trajectory datasets such as the average tracking duration, ground truth noise, curvature and speed variation of the trajectories. In comparison to prior art, our dataset has a larger variety in human motion behavior, is less noisy, and contains annotations at higher frequencies.
Key facts. Cited by 36 papers in the map (data through 7 Oct 2026). First posted on arXiv 10 Sep 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 6; 2023: 6; 2024: 11; 2025: 8; 2026: 3.
36 papers.
Sort:
By area:
- 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigationcited by 122
- 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
- 2023Principles and Guidelines for Evaluating Social Robot Navigation Algorithmscited by 52
- 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Modelscited by 46
- 2022JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Trackingcited by 25
- 2022Causal Discovery of Dynamic Models for Predicting Human Spatial Interactionscited by 13
- 2024From Cognition to Precognition: A Future-Aware Framework for Social Navigationcited by 10
- 2022Exploiting Proximity-Aware Tasks for Embodied Social Navigationcited by 6
- 2023TBD Pedestrian Data Collection: Towards Rich, Portable, and Large-Scale Natural Pedestrian Datacited by 5
- 2024Exploring 3D Human Pose Estimation and Forecasting from the Robot's Perspective: The HARPER Datasetcited by 5
- 2025EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observationscited by 5
- 2021Robot Navigation in a Crowd by Integrating Deep Reinforcement Learning and Online Planningcited by 4
24 more
- 2021Probabilistic Trajectory Prediction with Structural Constraintscited by 4
- 2025Interaction-Merged Motion Planning: Effectively Leveraging Diverse Motion Datasets for Robust Planningcited by 4
- 2024Snapshot: Towards Application-centered Models for Pedestrian Trajectory Prediction in Urban Traffic Environmentscited by 3
- 2024A Landmark-Aware Visual Navigation Datasetcited by 2
- 2024Experimental Evaluation of ROS-Causal in Real-World Human-Robot Spatial Interaction Scenarioscited by 2
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approachescited by 2
- 2023Avoidance Navigation Based on Offline Pre-Training Reinforcement Learningcited by 1
- 2022Towards Rich, Portable, and Large-Scale Pedestrian Data Collectioncited by 0
- 2022Towards Formalizing HRI Data Collection Processescited by 0
- 2023Likely, Light, and Accurate Context-Free Clusters-based Trajectory Predictioncited by 0
- 2023Efficient Causal Discovery for Robotics Applicationscited by 0
- 2024Generating Synthetic Ground Truth Distributions for Multi-step Trajectory Prediction using Probabilistic Composite B'ezier Curvescited by 0
- 2024neuROSym: Deployment and Evaluation of a ROS-based Neuro-Symbolic Model for Human Motion Predictioncited by 0
- 2024SITUATE: Indoor Human Trajectory Prediction through Geometric Features and Self-Supervised Vision Representationcited by 0
- 2024LocoVR: Multiuser Indoor Locomotion Dataset in Virtual Realitycited by 0
- 2024Enhancing Indoor Mobility with Connected Sensor Nodes: A Real-Time, Delay-Aware Cooperative Perception Approachcited by 0
- 2025Causality-enhanced Decision-Making for Autonomous Mobile Robots in Dynamic Environmentscited by 0
- 2025Collecting Human Motion Data in Large and Occlusion-Prone Environments using Ultra-Wideband Localizationcited by 0
- 2025Trajectory prediction for heterogeneous agents: A performance analysis on small and imbalanced datasetscited by 0
- 2025Learning to Navigate Socially Through Proactive Risk Perceptioncited by 0
- 2026Context-free Self-Conditioned GAN for Trajectory Forecastingcited by 0
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Datasetcited by 0
- 2026Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environmentscited by 0
- 2026Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environments1 Oct 2026
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset24 Jul 2026
- 2026Context-free Self-Conditioned GAN for Trajectory Forecasting9 Mar 2026
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approaches18 Nov 2025
- 2025Learning to Navigate Socially Through Proactive Risk Perception9 Oct 2025
- 2025Trajectory prediction for heterogeneous agents: A performance analysis on small and imbalanced datasets4 Oct 2025
- 2025EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observations1 Oct 2025
- 2025Interaction-Merged Motion Planning: Effectively Leveraging Diverse Motion Datasets for Robust Planning7 Jul 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Collecting Human Motion Data in Large and Occlusion-Prone Environments using Ultra-Wideband Localization9 May 2025
- 2025Causality-enhanced Decision-Making for Autonomous Mobile Robots in Dynamic Environments16 Apr 2025
- 2024Enhancing Indoor Mobility with Connected Sensor Nodes: A Real-Time, Delay-Aware Cooperative Perception Approach4 Nov 2024
24 more
- 2024LocoVR: Multiuser Indoor Locomotion Dataset in Virtual Reality9 Oct 2024
- 2024From Cognition to Precognition: A Future-Aware Framework for Social Navigation20 Sep 2024
- 2024Snapshot: Towards Application-centered Models for Pedestrian Trajectory Prediction in Urban Traffic Environments3 Sep 2024
- 2024SITUATE: Indoor Human Trajectory Prediction through Geometric Features and Self-Supervised Vision Representation1 Sep 2024
- 2024neuROSym: Deployment and Evaluation of a ROS-based Neuro-Symbolic Model for Human Motion Prediction24 Jun 2024
- 2024Experimental Evaluation of ROS-Causal in Real-World Human-Robot Spatial Interaction Scenarios7 Jun 2024
- 2024Generating Synthetic Ground Truth Distributions for Multi-step Trajectory Prediction using Probabilistic Composite B'ezier Curves5 Apr 2024
- 2024VLM-Social-Nav: Socially Aware Robot Navigation through Scoring using Vision-Language Models30 Mar 2024
- 2024Exploring 3D Human Pose Estimation and Forecasting from the Robot's Perspective: The HARPER Dataset21 Mar 2024
- 2024A Landmark-Aware Visual Navigation Dataset22 Feb 2024
- 2023Efficient Causal Discovery for Robotics Applications23 Oct 2023
- 2023TBD Pedestrian Data Collection: Towards Rich, Portable, and Large-Scale Natural Pedestrian Data29 Sep 2023
- 2023Avoidance Navigation Based on Offline Pre-Training Reinforcement Learning3 Aug 2023
- 2023Likely, Light, and Accurate Context-Free Clusters-based Trajectory Prediction27 Jul 2023
- 2023Principles and Guidelines for Evaluating Social Robot Navigation Algorithms29 Jun 2023
- 2023SACSoN: Scalable Autonomous Control for Social Navigation2 Jun 2023
- 2022Exploiting Proximity-Aware Tasks for Embodied Social Navigation1 Dec 2022
- 2022Causal Discovery of Dynamic Models for Predicting Human Spatial Interactions29 Oct 2022
- 2022JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Tracking20 Oct 2022
- 2022Socially Compliant Navigation Dataset (SCAND): A Large-Scale Dataset of Demonstrations for Social Navigation28 Mar 2022
- 2022Towards Formalizing HRI Data Collection Processes16 Mar 2022
- 2022Towards Rich, Portable, and Large-Scale Pedestrian Data Collection3 Mar 2022
- 2021Probabilistic Trajectory Prediction with Structural Constraints9 Jul 2021
- 2021Robot Navigation in a Crowd by Integrating Deep Reinforcement Learning and Online Planning26 Feb 2021
- 2023SACSoN: Scalable Autonomous Control for Social Navigationcited by 60
- 2023Principles and Guidelines for Evaluating Social Robot Navigation Algorithmscited by 52
- 2022JRDB-Pose: A Large-scale Dataset for Multi-Person Pose Estimation and Trackingcited by 25
- 2022Causal Discovery of Dynamic Models for Predicting Human Spatial Interactionscited by 13
- 2024From Cognition to Precognition: A Future-Aware Framework for Social Navigationcited by 10
- 2022Exploiting Proximity-Aware Tasks for Embodied Social Navigationcited by 6
- 2023TBD Pedestrian Data Collection: Towards Rich, Portable, and Large-Scale Natural Pedestrian Datacited by 5
- 2024Exploring 3D Human Pose Estimation and Forecasting from the Robot's Perspective: The HARPER Datasetcited by 5
- 2025EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observationscited by 5
- 2021Robot Navigation in a Crowd by Integrating Deep Reinforcement Learning and Online Planningcited by 4
- 2021Probabilistic Trajectory Prediction with Structural Constraintscited by 4
- 2025Interaction-Merged Motion Planning: Effectively Leveraging Diverse Motion Datasets for Robust Planningcited by 4
12 most cited of 34 All 34 (JSON)
- 2026Beyond Leaderboard Scores: A Deployment-Focused Protocol for Interpretable Tracking Evaluation in Pedestrian-Centric Environments1 Oct 2026
- 2026ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset24 Jul 2026
- 2026Context-free Self-Conditioned GAN for Trajectory Forecasting9 Mar 2026
- 2025Socially aware navigation for mobile robots: a survey on deep reinforcement learning approaches18 Nov 2025
- 2025Learning to Navigate Socially Through Proactive Risk Perception9 Oct 2025
- 2025Trajectory prediction for heterogeneous agents: A performance analysis on small and imbalanced datasets4 Oct 2025
- 2025EgoTraj-Bench: Towards Robust Trajectory Prediction Under Ego-view Noisy Observations1 Oct 2025
- 2025Interaction-Merged Motion Planning: Effectively Leveraging Diverse Motion Datasets for Robust Planning7 Jul 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Collecting Human Motion Data in Large and Occlusion-Prone Environments using Ultra-Wideband Localization9 May 2025
- 2025Causality-enhanced Decision-Making for Autonomous Mobile Robots in Dynamic Environments16 Apr 2025
- 2024Enhancing Indoor Mobility with Connected Sensor Nodes: A Real-Time, Delay-Aware Cooperative Perception Approach4 Nov 2024
12 newest of 34 All 34 (JSON)