Hybrid Multi-agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systems
Not on the map. Why?
Abstract (arXiv)
We consider the sequential decision-making problem of making proactive request assignment and rejection decisions for a profit-maximizing operator of an autonomous mobility on demand system. We formalize this problem as a Markov decision process and propose a novel combination of multi-agent Soft Actor-Critic and weighted bipartite matching to obtain an anticipative control policy. Thereby, we factorize the operator's otherwise intractable action space, but still obtain a globally coordinated decision. Experiments based on real-world taxi data show that our method outperforms state of the art benchmarks with respect to performance, stability, and computational tractability.
Key facts. Cited by 18 papers in the map (data through 14 Oct 2026). Builds on 15 of its 28 references that are in the map. First posted on arXiv 14 Dec 2022.
Builds on
15 of 28 references.
References · 15
- 2017Attention Is All You Needcited by 60,361
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2017Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environmentscited by 1,558
- 2018Actor-Attention-Critic for Multi-Agent Reinforcement Learningcited by 261
- 2019Soft Actor-Critic for Discrete Action Settingscited by 174
- 2022In Defense of the Unitary Scalarization for Deep Multi-Task Learningcited by 67
- 2019Efficient Ridesharing Order Dispatching with Mean Field Multi-Agent Reinforcement Learningcited by 57
- 2021A Deep Value-network Based Approach for Multi-Driver Order Dispatchingcited by 45
- 2019Deep Reinforcement Learning for Multi-Driver Vehicle Dispatching and Repositioning Problemcited by 29
- 2021Graph Neural Network Reinforcement Learning for Autonomous Mobility-on-Demand Systemscited by 28
- 2019Multi-Agent Reinforcement Learning for Order-dispatching via Order-Vehicle Distribution Matchingcited by 26
- 2014Control of Robotic Mobility-On-Demand Systems: a Queueing-Theoretical Perspectivecited by 25
3 more
- 2021Real-world Ride-hailing Vehicle Repositioning using Deep Reinforcement Learningcited by 22
- 2022Reinforcement Learning in the Wild: Scalable RL Dispatching Algorithm Deployed in Ridehailing Marketplacecited by 11
- 2021A Modular and Transferable Reinforcement Learning Framework for the Fleet Rebalancing Problemcited by 6
Built on by
Citing papers per year: 2023: 5; 2024: 3; 2025: 7; 2026: 3.
18 papers.
Sort:
By area:
- 2023Learning-based Online Optimization for Autonomous Mobility-on-Demand Fleet Controlcited by 14
- 2023Global Rewards in Multi-Agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systemscited by 8
- 2025BMG-Q: Localized Bipartite Match Graph Attention Q-Learning for Ride-Pooling Order Dispatchcited by 7
- 2025Structured Reinforcement Learning for Combinatorial Decision-Makingcited by 7
- 2024Risk-Sensitive Soft Actor-Critic for Robust Deep Reinforcement Learning under Distribution Shiftscited by 6
- 2024Stochastic Q-learning for Large Discrete Action Spacescited by 5
- 2025One Step is Enough: Multi-Agent Reinforcement Learning based on One-Step Policy Optimization for Order Dispatch on Ride-Sharing Platformscited by 5
- 2023Dynamic Neighborhood Construction for Structured Large Discrete Action Spacescited by 4
- 2025CoDriveVLM: VLM-Enhanced Urban Cooperative Dispatching and Motion Planning for Future Autonomous Mobility on Demand Systemscited by 4
- 2025Triple-BERT: Do We Really Need MARL for Order Dispatch on Ride-Sharing Platforms?cited by 4
- 2024Multi-Agent Soft Actor-Critic with Coordinated Loss for Autonomous Mobility-on-Demand Fleet Controlcited by 3
- 2025Coordinating Ride-Pooling with Public Transit using Reward-Guided Conservative Q-Learning: An Offline Training and Online Fine-Tuning Reinforcement Learning Frameworkcited by 3
6 more
- 2026Combinatorial Optimization Augmented Machine Learningcited by 3
- 2023Surge Routing: Event-informed Multiagent Reinforcement Learning for Autonomous Ridesharecited by 1
- 2023Approximate Multiagent Reinforcement Learning for On-Demand Urban Mobility Problem on a Large Map (extended version)cited by 1
- 2025Atomic Proximal Policy Optimization for Electric Robo-Taxi Dispatch and Charger Allocationcited by 1
- 2026RideSkill: A Hierarchical Algorithm for Generalized Ride Sharing with LLM-Driven Automatic Evolutioncited by 0
- 2026Synergizing Drone Delivery Order Pooling and Road Network Monitoring through Monitoring-Task Orderizationcited by 0
- 2026Synergizing Drone Delivery Order Pooling and Road Network Monitoring through Monitoring-Task Orderization4 Oct 2026
- 2026RideSkill: A Hierarchical Algorithm for Generalized Ride Sharing with LLM-Driven Automatic Evolution2 Sep 2026
- 2026Combinatorial Optimization Augmented Machine Learning15 Jan 2026
- 2025Triple-BERT: Do We Really Need MARL for Order Dispatch on Ride-Sharing Platforms?26 Sep 2025
- 2025One Step is Enough: Multi-Agent Reinforcement Learning based on One-Step Policy Optimization for Order Dispatch on Ride-Sharing Platforms21 Jul 2025
- 2025Structured Reinforcement Learning for Combinatorial Decision-Making25 May 2025
- 2025Atomic Proximal Policy Optimization for Electric Robo-Taxi Dispatch and Charger Allocation19 Feb 2025
- 2025Coordinating Ride-Pooling with Public Transit using Reward-Guided Conservative Q-Learning: An Offline Training and Online Fine-Tuning Reinforcement Learning Framework24 Jan 2025
- 2025BMG-Q: Localized Bipartite Match Graph Attention Q-Learning for Ride-Pooling Order Dispatch23 Jan 2025
- 2025CoDriveVLM: VLM-Enhanced Urban Cooperative Dispatching and Motion Planning for Future Autonomous Mobility on Demand Systems10 Jan 2025
- 2024Stochastic Q-learning for Large Discrete Action Spaces16 May 2024
- 2024Multi-Agent Soft Actor-Critic with Coordinated Loss for Autonomous Mobility-on-Demand Fleet Control10 Apr 2024
6 more
- 2024Risk-Sensitive Soft Actor-Critic for Robust Deep Reinforcement Learning under Distribution Shifts15 Feb 2024
- 2023Global Rewards in Multi-Agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systems14 Dec 2023
- 2023Approximate Multiagent Reinforcement Learning for On-Demand Urban Mobility Problem on a Large Map (extended version)2 Nov 2023
- 2023Surge Routing: Event-informed Multiagent Reinforcement Learning for Autonomous Rideshare5 Jul 2023
- 2023Dynamic Neighborhood Construction for Structured Large Discrete Action Spaces31 May 2023
- 2023Learning-based Online Optimization for Autonomous Mobility-on-Demand Fleet Control8 Feb 2023
- 2025BMG-Q: Localized Bipartite Match Graph Attention Q-Learning for Ride-Pooling Order Dispatchcited by 7
- 2025Structured Reinforcement Learning for Combinatorial Decision-Makingcited by 7
- 2024Risk-Sensitive Soft Actor-Critic for Robust Deep Reinforcement Learning under Distribution Shiftscited by 6
- 2024Stochastic Q-learning for Large Discrete Action Spacescited by 5
- 2026Combinatorial Optimization Augmented Machine Learningcited by 3
- 2025Atomic Proximal Policy Optimization for Electric Robo-Taxi Dispatch and Charger Allocationcited by 1
- 2026Combinatorial Optimization Augmented Machine Learning15 Jan 2026
- 2025Structured Reinforcement Learning for Combinatorial Decision-Making25 May 2025
- 2025Atomic Proximal Policy Optimization for Electric Robo-Taxi Dispatch and Charger Allocation19 Feb 2025
- 2025BMG-Q: Localized Bipartite Match Graph Attention Q-Learning for Ride-Pooling Order Dispatch23 Jan 2025
- 2024Stochastic Q-learning for Large Discrete Action Spaces16 May 2024
- 2024Risk-Sensitive Soft Actor-Critic for Robust Deep Reinforcement Learning under Distribution Shifts15 Feb 2024
- 2023Learning-based Online Optimization for Autonomous Mobility-on-Demand Fleet Controlcited by 14
- 2023Global Rewards in Multi-Agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systemscited by 8
- 2025One Step is Enough: Multi-Agent Reinforcement Learning based on One-Step Policy Optimization for Order Dispatch on Ride-Sharing Platformscited by 5
- 2023Dynamic Neighborhood Construction for Structured Large Discrete Action Spacescited by 4
- 2025CoDriveVLM: VLM-Enhanced Urban Cooperative Dispatching and Motion Planning for Future Autonomous Mobility on Demand Systemscited by 4
- 2025Triple-BERT: Do We Really Need MARL for Order Dispatch on Ride-Sharing Platforms?cited by 4
- 2024Multi-Agent Soft Actor-Critic with Coordinated Loss for Autonomous Mobility-on-Demand Fleet Controlcited by 3
- 2023Surge Routing: Event-informed Multiagent Reinforcement Learning for Autonomous Ridesharecited by 1
- 2023Approximate Multiagent Reinforcement Learning for On-Demand Urban Mobility Problem on a Large Map (extended version)cited by 1
- 2026RideSkill: A Hierarchical Algorithm for Generalized Ride Sharing with LLM-Driven Automatic Evolutioncited by 0
- 2026Synergizing Drone Delivery Order Pooling and Road Network Monitoring through Monitoring-Task Orderizationcited by 0
- 2026Synergizing Drone Delivery Order Pooling and Road Network Monitoring through Monitoring-Task Orderization4 Oct 2026
- 2026RideSkill: A Hierarchical Algorithm for Generalized Ride Sharing with LLM-Driven Automatic Evolution2 Sep 2026
- 2025Triple-BERT: Do We Really Need MARL for Order Dispatch on Ride-Sharing Platforms?26 Sep 2025
- 2025One Step is Enough: Multi-Agent Reinforcement Learning based on One-Step Policy Optimization for Order Dispatch on Ride-Sharing Platforms21 Jul 2025
- 2025CoDriveVLM: VLM-Enhanced Urban Cooperative Dispatching and Motion Planning for Future Autonomous Mobility on Demand Systems10 Jan 2025
- 2024Multi-Agent Soft Actor-Critic with Coordinated Loss for Autonomous Mobility-on-Demand Fleet Control10 Apr 2024
- 2023Global Rewards in Multi-Agent Deep Reinforcement Learning for Autonomous Mobility on Demand Systems14 Dec 2023
- 2023Approximate Multiagent Reinforcement Learning for On-Demand Urban Mobility Problem on a Large Map (extended version)2 Nov 2023
- 2023Surge Routing: Event-informed Multiagent Reinforcement Learning for Autonomous Rideshare5 Jul 2023
- 2023Dynamic Neighborhood Construction for Structured Large Discrete Action Spaces31 May 2023
- 2023Learning-based Online Optimization for Autonomous Mobility-on-Demand Fleet Control8 Feb 2023