Deep Reinforcement Learning for Demand Driven Services in Logistics and Transportation Systems: A Survey
Not on the map. Why?
Abstract (arXiv)
Recent technology development brings the boom of numerous new Demand-Driven Services (DDS) into urban lives, including ridesharing, on-demand delivery, express systems and warehousing. In DDS, a service loop is an elemental structure, including its service worker, the service providers and corresponding service targets. The service workers should transport either people or parcels from the providers to the target locations. Various planning tasks within DDS can thus be classified into two individual stages: 1) Dispatching, which is to form service loops from demand/supply distributions, and 2) Routing, which is to decide specific serving orders within the constructed loops. Generating high-quality strategies in both stages is important to develop DDS but faces several challenges. Meanwhile, deep reinforcement learning (DRL) has been developed rapidly in recent years. It is a powerful tool to solve these problems since DRL can learn a parametric model without relying on too many problem-based assumptions and optimize long-term effects by learning sequential decisions. In this survey, we first define DDS, then highlight common applications and important decision/control problems within. For each problem, we comprehensively introduce the existing DRL solutions. We also introduce open simulation environments for development and evaluation of DDS applications. Finally, we analyze remaining challenges and discuss further research opportunities in DRL solutions for DDS.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 55 of its 215 references that are in the map. First posted on arXiv 10 Aug 2021.
Builds on
55 of 215 references.
References · 55
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2015Trust Region Policy Optimizationcited by 2,503
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,302
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
- 2017Constrained Policy Optimizationcited by 928
- 2015Pointer Networkscited by 882
- 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 769
- 2018Attention, Learn to Solve Routing Problems!cited by 646
38 more
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 600
- 2017A Brief Survey of Deep Reinforcement Learningcited by 466
- 2020POMO: Policy Optimization with Multiple Optima for Reinforcement Learningcited by 341
- 2017Deep Reinforcement Learning: An Overviewcited by 327
- 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 327
- 2019An Efficient Graph Convolutional Network Technique for the Travelling Salesman Problemcited by 265
- 2020Transfer Learning in Deep Reinforcement Learning: A Surveycited by 259
- 2020Reinforcement Learning for Combinatorial Optimization: A Surveycited by 235
- 2018Mean Field Multi-Agent Reinforcement Learningcited by 202
- 2016Sample Efficient Actor-Critic with Experience Replaycited by 185
- 2018Learning to Perform Local Rewriting for Combinatorial Optimizationcited by 183
- 2015Multiagent Cooperation and Competition with Deep Reinforcement Learningcited by 180
- 2018Meta-Reinforcement Learning of Structured Exploration Strategiescited by 128
- 2018Strong mixed-integer programming formulations for trained neural networkscited by 115
- 2020Multi-Decoder Attention Model with Embedding Glimpse for Solving Vehicle Routing Problemscited by 100
- 2021Efficient Active Search for Combinatorial Optimization Problemscited by 99
- 2020Deep Reinforcement Learning for Intelligent Transportation Systems: A Surveycited by 94
- 2020Reinforcement Learning with Combinatorial Actions: An Application to Vehicle Routingcited by 61
- 2019Efficient Ridesharing Order Dispatching with Mean Field Multi-Agent Reinforcement Learningcited by 57
- 2019Reinforcement Learning with Convex Constraintscited by 57
- 2019DeepPool: Distributed Model-free Algorithm for Ride-sharing using Deep Reinforcement Learningcited by 54
- 2015Increasing the Action Gap: New Operators for Reinforcement Learningcited by 49
- 2021A Deep Value-network Based Approach for Multi-Driver Order Dispatchingcited by 45
- 2019Neural Approximate Dynamic Programming for On-Demand Ride-Poolingcited by 33
- 2020Multi-Vehicle Routing Problems with Soft Time Windows: A Multi-Agent Reinforcement Learning Approachcited by 30
- 2019Deep Reinforcement Learning for Multi-Driver Vehicle Dispatching and Repositioning Problemcited by 29
- 2020Learning to Solve Vehicle Routing Problems with Time Windows through Joint Attentioncited by 29
- 2017Revised Note on Learning Algorithms for Quadratic Assignment with Graph Neural Networkscited by 28
- 2019Multi-Agent Reinforcement Learning for Order-dispatching via Order-Vehicle Distribution Matchingcited by 26
- 2020Deep Reinforcement Learning for Electric Vehicle Routing Problem with Time Windowscited by 25
- 2018MOVI: A Model-Free Approach to Dynamic Fleet Managementcited by 23
- 2019CoRide: Joint Order Dispatching and Fleet Management for Multi-Scale Ride-Hailing Platformscited by 22
- 2016Learning to Communicate to Solve Riddles with Deep Distributed Recurrent Q-Networkscited by 21
- 2021Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learningcited by 20
- 2021Value Function is All You Need: A Unified Learning Framework for Ride Hailing Platformscited by 16
- 2021Learning to Optimize Industry-Scale Dynamic Pickup and Delivery Problemscited by 15
- 2020Scalable Deep Reinforcement Learning for Ride-Hailingcited by 12
- 2020Reward Design for Driver Repositioning Using Multi-Agent Reinforcement Learningcited by 11
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 0; 2026: 2.
3 papers.