Emergent Charging Coordination in Electric Delivery Fleets
Not on the map. Why?
Abstract (arXiv)
In electric delivery fleets, mid-shift charging is non-trivial: each vehicle must decide when, where and how much to charge to finish on time with battery above a safety floor. The choices are coupled: queues build where too many vehicles pick the same station. Prior work resolves this coupling with central dispatching, precomputed schedules or reservations, machinery that charging infrastructure rarely supports. Instead, we use a family of learning agents under purely local control: every vehicle runs the same policy, deciding alone from its time budgets and broadcast station occupancies, leading to emergent coordination without central control or messaging. We validate this paradigm in simulation on real OpenStreetMap networks of twenty cities, each with a frozen scenario calibrated by an omniscient Oracle (99.5% of shifts completed on time), whereas a naive greedy rule (nearest station on low battery) completes just 73%. Agents trained with neuroevolution (NEAT) and policy gradients (PPO) on four cities and deployed zero-shot across all twenty, sixteen never seen in training, complete 96.8% and 98.6% of shifts, with the policy-gradient controllers proving more robust when demand or vehicle characteristics drift beyond the trained regime. In contrast, tuned threshold heuristics that read vehicle urgency alone fall short in contended cities (~80%). Through training, these learning agents rediscover partial charging and short opportunistic sessions, and route around busy stations, cutting per-session queue waits from about 45 minutes to under 2. In summary, this coordination paradigm balances local urgency against public occupancy, reaching near-Oracle performance at minimal implementation cost.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 65 references that are in the map. First posted on arXiv 7 Sep 2026.
Builds on
17 of 65 references.
References · 17
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2021The Surprising Effectiveness of PPO in Cooperative, Multi-Agent Gamescited by 942
- 2017Counterfactual Multi-Agent Policy Gradientscited by 751
- 2017Evolution Strategies as a Scalable Alternative to Reinforcement Learningcited by 574
- 2016Deep Reinforcement Learning from Self-Play in Imperfect-Information Gamescited by 158
- 2017Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learningcited by 150
- 2016OSMnx: New Methods for Acquiring, Constructing, Analyzing, and Visualizing Complex Street Networkscited by 110
- 2021Settling the Variance of Multi-Agent Policy Gradientscited by 45
- 2024Bridging Evolutionary Algorithms and Reinforcement Learning: A Comprehensive Survey on Hybrid Algorithmscited by 26
- 2024EV2Gym: A Flexible V2G Simulator for EV Smart Charging Research and Benchmarkingcited by 8
- 2021Learning to Operate an Electric Vehicle Charging Station Considering Vehicle-grid Integrationcited by 7
5 more
- 2016Dynamic Scheduling for Charging Electric Vehicles: A Priority Rulecited by 6
- 2023Toward Efficient Transportation Electrification of Heavy-Duty Trucks: Joint Scheduling of Truck Routing and Chargingcited by 2
- 2023Electric Vehicle Fleet and Charging Infrastructure Planningcited by 2
- 2023Dynamic Routing for the Electric Vehicle Shortest Path Problem with Charging Station Occupancy Informationcited by 1
- 2025TensorNEAT: A GPU-accelerated Library for NeuroEvolution of Augmenting Topologiescited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Optimizing Electric Vehicle Charging Station Placement Using Reinforcement Learning and Agent-Based Simulations
- 2026Smart charging of large fleets of Electric Vehicles: Independent Multi-Agent Reinforcement Learning approaches
- 2026OpenHail: An Event-Driven Gymnasium Environment for Electric Ride-Hailing Fleet Control
- 2026Few-Shot Learning for Dynamic Operations of Automated Electric Taxi Fleets under Evolving Charging Infrastructure: A Meta-Deep Reinforcement Learning Approach
- 2026HetGPS: Scalable Graph Multi-Agent Reinforcement Learning with Physics-Anchored Adaptive Safety for EV Charging
- 2025Reinforcement Learning for Hybrid Charging Stations Planning and Operation Considering Fixed and Mobile Chargers
- 2026A Distributionally Robust Reinforcement Learning Framework for Constrained Urban EV Dispatch
- 2024Centralized vs. Decentralized Multi-Agent Reinforcement Learning for Enhanced Control of Electric Vehicle Charging Networks