mlsanityData to 14 Oct 2026

Reinforcement Learning in Operational Research: A Technical Review and Practical Roadmap

arXiv 2609.24750 ↗First posted 21 Sep 2026math.OC cs.LGcited by 0

On the map: Deep reinforcement learning methods → Deep RL algorithms and representations

Abstract (arXiv)

The growing demand for real-time, data-driven decision-making in complex and dynamic systems is placing increasing pressure on traditional Operational Research (OR) methodologies. Reinforcement learning (RL) has emerged as a complementary approach, offering strong learning and computational capabilities for sequential decision-making in dynamic and uncertain environments. Recent research shows an increasing interest in integrating RL with OR to address dynamic decision-making problems, enhance heuristic and exact methods for combinatorial optimization, and support the development of digital replicas of operational systems. The overarching goal across these efforts is to leverage the learning capabilities of RL to strengthen traditional OR algorithms, improving solution quality, computational efficiency, and robustness. Given the diversity of integration approaches and application settings, there is a clear need for a systematic and technically detailed review of how RL empowers OR methods. To address this gap, this paper presents a structured review of three key roles that RL plays in empowering OR: (i) solving sequential decision-making problems in dynamic environments, (ii) serving as an end-to-end solution method or as a component integrated within heuristic and exact OR methods for combinatorial optimization problems, and (iii) facilitating extended reality analysis through integration with digital twin systems. We critically synthesize recent advances across these roles, highlighting their advantages, implementation requirements, limitations, and challenges. Finally, based on these insights, we outline a roadmap for future research to further advance the methodological and practical integration of RL and OR.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Deep RL algorithms and representations, one of 15 directions in Deep reinforcement learning methods. Builds on 43 of its 101 references that are in the map. First posted on arXiv 21 Sep 2026.

Builds on

43 of 101 references.

References · 43

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  3. 2015Continuous control with deep reinforcement learningcited by 3,407
  4. 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
  5. 2015Trust Region Policy Optimizationcited by 2,580
  6. 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
  7. 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,258
  8. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,920
  9. 2015Deep Reinforcement Learning with Double Q-learningcited by 1,745
  10. 2015Pointer Networkscited by 895
  11. 2015Dueling Network Architectures for Deep Reinforcement Learningcited by 785
  12. 2019When to Trust Your Model: Model-Based Policy Optimizationcited by 773
31 more
  1. 2018Image Transformercited by 772
  2. 2018Attention, Learn to Solve Routing Problems!cited by 656
  3. 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
  4. 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
  5. 2020MOReL : Model-Based Offline Reinforcement Learningcited by 590
  6. 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
  7. 2017Deep Reinforcement Learning: An Overviewcited by 333
  8. 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 333
  9. 2019Reinforcement Learning in Healthcare: A Surveycited by 310
  10. 2018Sample-Efficient Reinforcement Learning with Stochastic Ensemble Value Expansioncited by 168
  11. 2018Model-Based Value Estimation for Efficient Model-Free Reinforcement Learningcited by 156
  12. 2018A Tour of Reinforcement Learning: The View from Continuous Controlcited by 151
  13. 2019Reinforcement Learning for Integer Programming: Learning to Cutcited by 111
  14. 2018Model-Based Reinforcement Learning via Meta-Policy Optimizationcited by 101
  15. 2019Deep Reinforcement Learning for Multi-objective Optimizationcited by 90
  16. 2024Is Value Learning Really the Main Bottleneck in Offline RL?cited by 89
  17. 2019Exploratory Combinatorial Optimization with Reinforcement Learningcited by 82
  18. 2019A review on Deep Reinforcement Learning for Fluid Mechanicscited by 66
  19. 2020Combining Reinforcement Learning and Constraint Programming for Combinatorial Optimizationcited by 63
  20. 2019Non-Stationary Markov Decision Processes, a Worst-Case Approach using Model-Based Reinforcement Learning, Extended versioncited by 36
  21. 2021Accelerating Quadratic Optimization with Reinforcement Learningcited by 30
  22. 2022Model-based Safe Deep Reinforcement Learning via a Constrained Proximal Policy Optimization Algorithmcited by 29
  23. 2019Deep Q-Learning for Same-Day Delivery with Vehicles and Dronescited by 15
  24. 2018Improving Optimization Bounds using Machine Learning: Decision Diagrams meet Deep Reinforcement Learningcited by 13
  25. 2021Learning to be Fair: A Consequentialist Approach to Equitable Decision-Makingcited by 11
  26. 2020Same-Day Delivery with Fairnesscited by 6
  27. 2021An actor-critic algorithm with policy gradients to solve the job shop scheduling problem using deep double recurrent agentscited by 6
  28. 2021Deep Policy Iteration with Integer Programming for Inventory Managementcited by 6
  29. 2023Optimizing Credit Limit Adjustments Under Adversarial Goals Using Reinforcement Learningcited by 6
  30. 2020SDP-based bounds for the Quadratic Cycle Cover Problem via cutting plane augmented Lagrangian methods and reinforcement learningcited by 1
  31. 2024Scalable Policies for the Dynamic Traveling Multi-Maintainer Problem with Alertscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Statistical and Algorithmic Foundations of Reinforcement Learning
  2. 2024A Comprehensive Survey of Reinforcement Learning: From Algorithms to Practical Challenges
  3. 2023Understanding Reinforcement Learning Algorithms: The Progress from Basic Q-learning to Proximal Policy Optimization
  4. 2024Introduction to Reinforcement Learning
  5. 2026Deep Reinforcement Learning: From First Principles to Reasoning Models ↗
  6. 2026Reinforcement Learning in the Real World: A Survey of Statistical Challenges and Future Directions
  7. 2024Towards Sample-Efficiency and Generalization of Transfer and Inverse Reinforcement Learning: A Comprehensive Literature Review
  8. 2026Mathematical methods of reinforcement learning