A Data-driven Model for Interaction-aware Pedestrian Motion Prediction in Object Cluttered Environments
Not on the map. Why?
Abstract (arXiv)
This paper reports on a data-driven, interaction-aware motion prediction approach for pedestrians in environments cluttered with static obstacles. When navigating in such workspaces shared with humans, robots need accurate motion predictions of the surrounding pedestrians. Human navigation behavior is mostly influenced by their surrounding pedestrians and by the static obstacles in their vicinity. In this paper we introduce a new model based on Long-Short Term Memory (LSTM) neural networks, which is able to learn human motion behavior from demonstrated data. To the best of our knowledge, this is the first approach using LSTMs, that incorporates both static obstacles and surrounding pedestrians for trajectory forecasting. As part of the model, we introduce a new way of encoding surrounding pedestrians based on a 1d-grid in polar angle space. We evaluate the benefit of interaction-aware motion prediction and the added value of incorporating static obstacles on both simulation and real-world datasets by comparing with state-of-the-art approaches. The results show, that our new approach outperforms the other approaches while being very computationally efficient and that taking into account static obstacles for motion predictions significantly improves the prediction accuracy, especially in cluttered environments.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 3; 2023: 3; 2024: 4; 2025: 2.
23 papers.
Sort:
By area:
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agentscited by 64
- 2021Interpretable Social Anchors for Human Trajectory Forecasting in Crowdscited by 44
- 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Predictioncited by 44
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Modelcited by 35
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approachescited by 30
- 2021A Survey on Human-aware Robot Navigationcited by 23
- 2021FloMo: Tractable Motion Prediction with Normalizing Flowscited by 21
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2023A Safer Vision-based Autonomous Planning System for Quadrotor UAVs with Dynamic Obstacle Trajectory Prediction and Its Application with LLMscited by 13
- 2021Learning Interaction-Aware Trajectory Predictions for Decentralized Multi-Robot Motion Planning in Dynamic Environmentscited by 12
11 more
- 2022Safety-compliant Generative Adversarial Networks for Human Trajectory Forecastingcited by 12
- 2021Predicting Vehicles Trajectories in Urban Scenarios with Transformer Networks and Augmented Informationcited by 9
- 2021Deep Social Forcecited by 8
- 2025Continuous Locomotive Crowd Behavior Generationcited by 7
- 2021Asymmetrical Bi-RNN for pedestrian trajectory encodingcited by 6
- 2022A Two-Block RNN-based Trajectory Prediction from Incomplete Trajectorycited by 6
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Surveycited by 5
- 2021IPAPRec: A promising tool for learning high-performance mapless navigation skills with deep reinforcement learningcited by 4
- 2023Data-Driven Stochastic Motion Evaluation and Optimization with Image by Spatially-Aligned Temporal Encodingcited by 3
- 2021What we see and What we don't see: Imputing Occluded Crowd Structures from Robot Sensingcited by 1
- 2024Enhancing Pedestrian Trajectory Prediction with Crowd Trip Informationcited by 0
- 2025Continuous Locomotive Crowd Behavior Generation7 Apr 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2024Enhancing Pedestrian Trajectory Prediction with Crowd Trip Information23 Sep 2024
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey29 May 2024
- 2024SingularTrajectory: Universal Trajectory Predictor Using Diffusion Model27 Mar 2024
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Prediction27 Mar 2024
- 2023A Safer Vision-based Autonomous Planning System for Quadrotor UAVs with Dynamic Obstacle Trajectory Prediction and Its Application with LLMs21 Nov 2023
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecasting18 Jul 2023
- 2023Data-Driven Stochastic Motion Evaluation and Optimization with Image by Spatially-Aligned Temporal Encoding10 Feb 2023
- 2022Safety-compliant Generative Adversarial Networks for Human Trajectory Forecasting25 Sep 2022
- 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Prediction20 Jul 2022
- 2022A Two-Block RNN-based Trajectory Prediction from Incomplete Trajectory14 Mar 2022
11 more
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approaches11 Nov 2021
- 2021Deep Social Force24 Sep 2021
- 2021What we see and What we don't see: Imputing Occluded Crowd Structures from Robot Sensing17 Sep 2021
- 2021A Survey on Human-aware Robot Navigation22 Jun 2021
- 2021Asymmetrical Bi-RNN for pedestrian trajectory encoding1 Jun 2021
- 2021Predicting Vehicles Trajectories in Urban Scenarios with Transformer Networks and Augmented Information1 Jun 2021
- 2021Interpretable Social Anchors for Human Trajectory Forecasting in Crowds7 May 2021
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agents1 Apr 2021
- 2021IPAPRec: A promising tool for learning high-performance mapless navigation skills with deep reinforcement learning22 Mar 2021
- 2021FloMo: Tractable Motion Prediction with Normalizing Flows5 Mar 2021
- 2021Learning Interaction-Aware Trajectory Predictions for Decentralized Multi-Robot Motion Planning in Dynamic Environments10 Feb 2021
- 2021LaPred: Lane-Aware Prediction of Multi-Modal Future Trajectories of Dynamic Agentscited by 64
- 2021Interpretable Social Anchors for Human Trajectory Forecasting in Crowdscited by 44
- 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Predictioncited by 44
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecastingcited by 41
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Predictioncited by 31
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approachescited by 30
- 2021A Survey on Human-aware Robot Navigationcited by 23
- 2021FloMo: Tractable Motion Prediction with Normalizing Flowscited by 21
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directionscited by 14
- 2023A Safer Vision-based Autonomous Planning System for Quadrotor UAVs with Dynamic Obstacle Trajectory Prediction and Its Application with LLMscited by 13
- 2021Learning Interaction-Aware Trajectory Predictions for Decentralized Multi-Robot Motion Planning in Dynamic Environmentscited by 12
- 2022Safety-compliant Generative Adversarial Networks for Human Trajectory Forecastingcited by 12
12 most cited of 22 All 22 (JSON)
- 2025Continuous Locomotive Crowd Behavior Generation7 Apr 2025
- 2025Trajectory Prediction for Autonomous Driving: Progress, Limitations, and Future Directions5 Mar 2025
- 2024Enhancing Pedestrian Trajectory Prediction with Crowd Trip Information23 Sep 2024
- 2024Vulnerable Road User Detection and Safety Enhancement: A Comprehensive Survey29 May 2024
- 2024Can Language Beat Numerical Regression? Language-Based Multimodal Trajectory Prediction27 Mar 2024
- 2023A Safer Vision-based Autonomous Planning System for Quadrotor UAVs with Dynamic Obstacle Trajectory Prediction and Its Application with LLMs21 Nov 2023
- 2023EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecasting18 Jul 2023
- 2023Data-Driven Stochastic Motion Evaluation and Optimization with Image by Spatially-Aligned Temporal Encoding10 Feb 2023
- 2022Safety-compliant Generative Adversarial Networks for Human Trajectory Forecasting25 Sep 2022
- 2022Learning Pedestrian Group Representations for Multi-modal Trajectory Prediction20 Jul 2022
- 2022A Two-Block RNN-based Trajectory Prediction from Incomplete Trajectory14 Mar 2022
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approaches11 Nov 2021
12 newest of 22 All 22 (JSON)