Risk-Sensitive Sequential Action Control with Multi-Modal Human Trajectory Forecasting for Safe Crowd-Robot Interaction
Not on the map. Why?
Abstract (arXiv)
This paper presents a novel online framework for safe crowd-robot interaction based on risk-sensitive stochastic optimal control, wherein the risk is modeled by the entropic risk measure. The sampling-based model predictive control relies on mode insertion gradient optimization for this risk measure as well as Trajectron++, a state-of-the-art generative model that produces multimodal probabilistic trajectory forecasts for multiple interacting agents. Our modular approach decouples the crowd-robot interaction into learning-based prediction and model-based control, which is advantageous compared to end-to-end policy learning methods in that it allows the robot's desired behavior to be specified at run time. In particular, we show that the robot exhibits diverse interaction behavior by varying the risk sensitivity parameter. A simulation study and a real-world experiment show that the proposed online framework can accomplish safe and efficient navigation while avoiding collisions with more than 50 humans in the scene.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 12 Sep 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 4; 2022: 3; 2023: 3; 2024: 5; 2025: 5; 2026: 1.
21 papers.
Sort:
By area:
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Modelscited by 27
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluationcited by 21
- 2021Risk-Conditioned Distributional Soft Actor-Critic for Risk-Sensitive Navigationcited by 13
- 2022RAP: Risk-Aware Prediction for Robust Planningcited by 12
- 2021Rethinking Trajectory Forecasting Evaluationcited by 11
- 2024From Cognition to Precognition: A Future-Aware Framework for Social Navigationcited by 10
- 2025SICNav-Diffusion: Safe and Interactive Crowd Navigation with Diffusion Trajectory Predictionscited by 10
- 2021TIP: Task-Informed Motion Prediction for Intelligent Vehiclescited by 8
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modelingcited by 7
- 2023TBD Pedestrian Data Collection: Towards Rich, Portable, and Large-Scale Natural Pedestrian Datacited by 5
- 2023ManiCast: Collaborative Manipulation with Cost-Aware Human Forecastingcited by 4
- 2024Mixed Strategy Nash Equilibrium for Crowd Navigationcited by 3
9 more
- 2024Stranger Danger! Identifying and Avoiding Unpredictable Pedestrians in RL-based Social Robot Navigationcited by 2
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Reviewcited by 2
- 2023Improving Generalization in Reinforcement Learning Training Regimes for Social Robot Navigationcited by 1
- 2024RiskMap: A Unified Driving Context Representation for Autonomous Motion Planning in Urban Driving Environmentcited by 1
- 2025Risk-Sensitive Agent Compositionscited by 1
- 2022Towards Rich, Portable, and Large-Scale Pedestrian Data Collectioncited by 0
- 2025Unified Generation-Refinement Planning: Bridging Guided Flow Matching and Sampling-Based MPC for Social Navigationcited by 0
- 2025Learning to Navigate Socially Through Proactive Risk Perceptioncited by 0
- 2026Learning-Based Motion Planning for Dynamic Environments: From Foundational Algorithms to Emerging Paradigmscited by 0
- 2026Learning-Based Motion Planning for Dynamic Environments: From Foundational Algorithms to Emerging Paradigms1 Aug 2026
- 2025Learning to Navigate Socially Through Proactive Risk Perception9 Oct 2025
- 2025Unified Generation-Refinement Planning: Bridging Guided Flow Matching and Sampling-Based MPC for Social Navigation2 Aug 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2025Risk-Sensitive Agent Compositions5 Jun 2025
- 2025SICNav-Diffusion: Safe and Interactive Crowd Navigation with Diffusion Trajectory Predictions11 Mar 2025
- 2024From Cognition to Precognition: A Future-Aware Framework for Social Navigation20 Sep 2024
- 2024Stranger Danger! Identifying and Avoiding Unpredictable Pedestrians in RL-based Social Robot Navigation8 Jul 2024
- 2024RiskMap: A Unified Driving Context Representation for Autonomous Motion Planning in Urban Driving Environment6 Jun 2024
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modeling8 Apr 2024
- 2024Mixed Strategy Nash Equilibrium for Crowd Navigation3 Mar 2024
- 2023ManiCast: Collaborative Manipulation with Cost-Aware Human Forecasting20 Oct 2023
9 more
- 2023TBD Pedestrian Data Collection: Towards Rich, Portable, and Large-Scale Natural Pedestrian Data29 Sep 2023
- 2023Improving Generalization in Reinforcement Learning Training Regimes for Social Robot Navigation29 Aug 2023
- 2022RAP: Risk-Aware Prediction for Robust Planning4 Oct 2022
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Models5 Apr 2022
- 2022Towards Rich, Portable, and Large-Scale Pedestrian Data Collection3 Mar 2022
- 2021TIP: Task-Informed Motion Prediction for Intelligent Vehicles17 Oct 2021
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluation7 Oct 2021
- 2021Rethinking Trajectory Forecasting Evaluation21 Jul 2021
- 2021Risk-Conditioned Distributional Soft Actor-Critic for Risk-Sensitive Navigation7 Apr 2021
- 2025Risk-Sensitive Agent Compositionscited by 1
- 2025Risk-Sensitive Agent Compositions5 Jun 2025
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Modelscited by 27
- 2021Injecting Planning-Awareness into Prediction and Detection Evaluationcited by 21
- 2021Risk-Conditioned Distributional Soft Actor-Critic for Risk-Sensitive Navigationcited by 13
- 2022RAP: Risk-Aware Prediction for Robust Planningcited by 12
- 2021Rethinking Trajectory Forecasting Evaluationcited by 11
- 2024From Cognition to Precognition: A Future-Aware Framework for Social Navigationcited by 10
- 2021TIP: Task-Informed Motion Prediction for Intelligent Vehiclescited by 8
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modelingcited by 7
- 2023TBD Pedestrian Data Collection: Towards Rich, Portable, and Large-Scale Natural Pedestrian Datacited by 5
- 2023ManiCast: Collaborative Manipulation with Cost-Aware Human Forecastingcited by 4
- 2024Mixed Strategy Nash Equilibrium for Crowd Navigationcited by 3
- 2024Stranger Danger! Identifying and Avoiding Unpredictable Pedestrians in RL-based Social Robot Navigationcited by 2
12 most cited of 17 All 17 (JSON)
- 2026Learning-Based Motion Planning for Dynamic Environments: From Foundational Algorithms to Emerging Paradigms1 Aug 2026
- 2025Learning to Navigate Socially Through Proactive Risk Perception9 Oct 2025
- 2025Recent Advances in Multi-Agent Human Trajectory Prediction: A Comprehensive Review13 Jun 2025
- 2024From Cognition to Precognition: A Future-Aware Framework for Social Navigation20 Sep 2024
- 2024Stranger Danger! Identifying and Avoiding Unpredictable Pedestrians in RL-based Social Robot Navigation8 Jul 2024
- 2024Normalizing Flows on the Product Space of SO(3) Manifolds for Probabilistic Human Pose Modeling8 Apr 2024
- 2024Mixed Strategy Nash Equilibrium for Crowd Navigation3 Mar 2024
- 2023ManiCast: Collaborative Manipulation with Cost-Aware Human Forecasting20 Oct 2023
- 2023TBD Pedestrian Data Collection: Towards Rich, Portable, and Large-Scale Natural Pedestrian Data29 Sep 2023
- 2023Improving Generalization in Reinforcement Learning Training Regimes for Social Robot Navigation29 Aug 2023
- 2022RAP: Risk-Aware Prediction for Robust Planning4 Oct 2022
- 2022Deep Interactive Motion Prediction and Planning: Playing Games with Motion Prediction Models5 Apr 2022
12 newest of 17 All 17 (JSON)