Decentralized Social Navigation with Non-Cooperative Robots via Bi-Level Optimization
Not on the map. Why?
Abstract (arXiv)
This paper presents a fully decentralized approach for realtime non-cooperative multi-robot navigation in social mini-games, such as navigating through a narrow doorway or negotiating right of way at a corridor intersection. Our contribution is a new realtime bi-level optimization algorithm, in which the top-level optimization consists of computing a fair and collision-free ordering followed by the bottom-level optimization which plans optimal trajectories conditioned on the ordering. We show that, given such a priority order, we can impose simple kinodynamic constraints on each robot that are sufficient for it to plan collision-free trajectories with minimal deviation from their preferred velocities, similar to how humans navigate in these scenarios. We successfully deploy the proposed algorithm in the real world using F1/10 robots, a Clearpath Jackal, and a Boston Dynamics Spot as well as in simulation using the SocialGym 2.0 multi-agent social navigation simulator, in the doorway and corridor intersection scenarios. We compare with state-of-the-art social navigation methods using multi-agent reinforcement learning, collision avoidance algorithms, and crowd simulation models. We show that (i) classical navigation performs 44% better than the state-of-the-art learning-based social navigation algorithms, (ii) without a scheduling protocol, our approach results in collisions in social mini-games (iii) our approach yields 2× and 5× fewer velocity changes than CADRL in doorways and intersections, and finally (iv) bi-level navigation in doorways at a flow rate of 2.8 - 3.3 (ms)-1 is comparable to flow rate in human navigation at a flow rate of 4 (ms)-1.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 30 of its 55 references that are in the map. First posted on arXiv 15 Jun 2023.
Builds on
30 of 55 references.
References · 30
- 2017Socially Aware Motion Planning with Deep Reinforcement Learningcited by 136
- 2016Decentralized Non-communicating Multiagent Collision Avoidance with Deep Reinforcement Learningcited by 118
- 2018Motion Planning Among Dynamic, Decision-Making Agents with Deep Reinforcement Learningcited by 111
- 2021Core Challenges of Social Robot Navigation: A Surveycited by 106
- 2020Game-Theoretic Multiagent Reinforcement Learningcited by 94
- 2017Towards Optimally Decentralized Multi-Robot Collision Avoidance via Deep Reinforcement Learningcited by 83
- 2018TraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactionscited by 82
- 2020Motion Planning and Control for Mobile Robot Navigation Using Machine Learning: a Surveycited by 58
- 2019Collision Avoidance in Pedestrian-Rich Environments with Deep Reinforcement Learningcited by 49
- 2018Hierarchical Game-Theoretic Planning for Autonomous Vehiclescited by 48
- 2019Efficient Iterative Linear-Quadratic Approximations for Nonlinear Multi-Player General-Sum Differential Gamescited by 37
- 2019Forecasting Trajectory and Behavior of Road-Agents Using Spectral Clustering in Graph-LSTMscited by 34
18 more
- 2021SocNavBench: A Grounded Simulation Testing Framework for Evaluating Social Navigationcited by 24
- 2019Stochastic Dynamic Games in Belief Spacecited by 23
- 2020CMetric: A Driving Behavior Measure Using Centrality Functionscited by 19
- 2021ALGAMES: A Fast Augmented Lagrangian Solver for Constrained Dynamic Gamescited by 16
- 2021GamePlan: Game-Theoretic Multi-Agent Planning with Human Drivers at Intersections, Roundabouts, and Mergingcited by 16
- 2021METEOR:A Dense, Heterogeneous, and Unstructured Traffic Dataset With Rare Behaviorscited by 12
- 2021Using Graph-Theoretic Machine Learning to Predict Human Driver Behaviorcited by 12
- 2021SOCIALGYM: A Framework for Benchmarking Social Robot Navigationcited by 10
- 2019GraphRQI: Classifying Driver Behaviors Using Graph Spectrumscited by 9
- 2022GAMEOPT: Optimal Real-time Multi-Agent Planning and Control for Dynamic Intersectionscited by 8
- 2020Autonomous and Semi-Autonomous Intersection Management: A Surveycited by 7
- 2022Game-Theoretic Planning for Autonomous Driving among Risk-Aware Human Driverscited by 7
- 2022SOCIALMAPF: Optimal and Efficient Multi-Agent Path Finding with Strategic Agents for Social Navigationcited by 6
- 2019Newton's Method and Differential Dynamic Programming for Unconstrained Nonlinear Dynamic Gamescited by 5
- 2023iPLAN: Intent-Aware Planning in Heterogeneous Traffic via Distributed Multi-Agent Reinforcement Learningcited by 5
- 2020First-Order Algorithms for Constrained Nonlinear Dynamic Gamescited by 3
- 2018Differential Dynamic Programming for Nonlinear Dynamic Gamescited by 2
- 2021Incorporating Gaze into Social Navigationcited by 2
Built on by
Citing papers per year: 2024: 1; 2025: 1.
2 papers.