mlsanityData to 14 Oct 2026

Robust Dynamic Material Handling via Adaptive Constrained Evolutionary Reinforcement Learning

arXiv 2506.16795 ↗First posted 20 Jun 2025cs.NE cs.AIcited by 0

On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control

Abstract (arXiv)

Dynamic material handling (DMH) involves the assignment of dynamically arriving material transporting tasks to suitable vehicles in real time for minimising makespan and tardiness. In real-world scenarios, historical task records are usually available, which enables the training of a decision policy on multiple instances consisting of historical records. Recently, reinforcement learning has been applied to solve DMH. Due to the occurrence of dynamic events such as new tasks, adaptability is highly required. Solving DMH is challenging since constraints including task delay should be satisfied. A feedback is received only when all tasks are served, which leads to sparse reward. Besides, making the best use of limited computational resources and historical records for training a robust policy is crucial. The time allocated to different problem instances would highly impact the learning process. To tackle those challenges, this paper proposes a novel adaptive constrained evolutionary reinforcement learning (ACERL) approach, which maintains a population of actors for diverse exploration. ACERL accesses each actor for tackling sparse rewards and constraint violation to restrict the behaviour of the policy. Moreover, ACERL adaptively selects the most beneficial training instances for improving the policy. Extensive experiments on eight training and eight unseen test instances demonstrate the outstanding performance of ACERL compared with several state-of-the-art algorithms. Policies trained by ACERL can schedule the vehicles while fully satisfying the constraints. Additional experiments on 40 unseen noised instances show the robust performance of ACERL. Cross-validation further presents the overall effectiveness of ACREL. Besides, a rigorous ablation study highlights the coordination and benefits of each ingredient of ACERL.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 20 of its 64 references that are in the map. First posted on arXiv 20 Jun 2025.

Builds on

20 of 64 references.

References · 20

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  3. 2016OpenAI Gymcited by 1,736
  4. 2017Constrained Policy Optimizationcited by 983
  5. 2016Unifying Count-Based Exploration and Intrinsic Motivationcited by 639
  6. 2017Evolution Strategies as a Scalable Alternative to Reinforcement Learningcited by 574
  7. 2018Reward Constrained Policy Optimizationcited by 417
  8. 2020Emergent Complexity and Zero-shot Transfer via Unsupervised Environment Designcited by 275
  9. 2020Prioritized Level Replaycited by 198
  10. 2017Deep Neuroevolution: Genetic Algorithms Are a Competitive Alternative for Training Deep Neural Networks for Reinforcement Learningcited by 150
  11. 2021Tianshou: a Highly Modularized Deep Reinforcement Learning Librarycited by 143
  12. 2017Improving Exploration in Evolution Strategies for Deep Reinforcement Learning via a Population of Novelty-Seeking Agentscited by 107
8 more
  1. 2018Evolution-Guided Policy Gradient in Reinforcement Learningcited by 83
  2. 2019Bootstrapping Upper Confidence Boundcited by 36
  3. 2023Evolutionary Reinforcement Learning: A Surveycited by 29
  4. 2022Combining Evolution and Deep Reinforcement Learning for Policy Search: a Surveycited by 23
  5. 2020Evolutionary Reinforcement Learning via Cooperative Coevolutionary Negatively Correlated Searchcited by 8
  6. 2020Reinforcement Learning with Dual-Observation for General Video Game Playingcited by 4
  7. 2023Evolving Constrained Reinforcement Learning Policycited by 2
  8. 2023Constrained Reinforcement Learning for Dynamic Material Handlingcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Multi-agent Reinforcement Learning for Dynamic Dispatching in Material Handling Systems
  2. 2025Distributionally Robust Multi-Agent Reinforcement Learning for Dynamic Chute Mapping
  3. 2025Large Scale Robotic Material Handling: Learning, Planning, and Control
  4. 2026Size Doesn't Matter: Material-State Reinforcement Learning for Excavator Transferable Soil Manipulation
  5. 2024Optimizing Plastic Waste Collection in Water Bodies Using Heterogeneous Autonomous Surface Vehicles with Deep Reinforcement Learning
  6. 2025Evaluating Robustness of Deep Reinforcement Learning for Autonomous Surface Vehicle Control in Field Tests
  7. 2025Learning Tool-Aware Adaptive Compliant Control for Autonomous Regolith Excavation
  8. 2025Reinforcement Learning-based Dynamic Adaptation for Sampling-Based Motion Planning in Agile Autonomous Driving