Dynamic resource matching in manufacturing using deep reinforcement learning
On the map: Deep reinforcement learning methods → RL for energy, networks and operations
Abstract (arXiv)
Matching plays an important role in the logical allocation of resources across a wide range of industries. The benefits of matching have been increasingly recognized in manufacturing industries. In particular, capacity sharing has received much attention recently. In this paper, we consider the problem of dynamically matching demand-capacity types of manufacturing resources. We formulate the multi-period, many-to-many manufacturing resource-matching problem as a sequential decision process. The formulated manufacturing resource-matching problem involves large state and action spaces, and it is not practical to accurately model the joint distribution of various types of demands. To address the curse of dimensionality and the difficulty of explicitly modeling the transition dynamics, we use a model-free deep reinforcement learning approach to find optimal matching policies. Moreover, to tackle the issue of infeasible actions and slow convergence due to initial biased estimates caused by the maximum operator in Q-learning, we introduce two penalties to the traditional Q-learning algorithm: a domain knowledge-based penalty based on a prior policy and an infeasibility penalty that conforms to the demand-supply constraints. We establish theoretical results on the convergence of our domain knowledge-informed Q-learning providing performance guarantee for small-size problems. For large-size problems, we further inject our modified approach into the deep deterministic policy gradient (DDPG) algorithm, which we refer to as domain knowledge-informed DDPG (DKDDPG). In our computational study, including small- and large-scale experiments, DKDDPG consistently outperformed traditional DDPG and other RL algorithms, yielding higher rewards and demonstrating greater efficiency in time and episodes.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for energy, networks and operations, one of 15 directions in Deep reinforcement learning methods. Builds on 16 of its 46 references that are in the map. First posted on arXiv 28 Mar 2026.
Builds on
16 of 46 references.
References · 16
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 623
- 2016Neural Combinatorial Optimization with Reinforcement Learningcited by 608
- 2017Learning Combinatorial Optimization Algorithms over Graphscited by 561
- 2018Is Q-learning Provably Efficient?cited by 487
- 2017Deep Reinforcement Learning: An Overviewcited by 333
- 2018Reinforcement Learning for Solving the Vehicle Routing Problemcited by 333
- 2015Deep Reinforcement Learning in Large Discrete Action Spacescited by 161
- 2015Taming the Noise in Reinforcement Learning via Soft Updatescited by 127
- 2019Exploratory Combinatorial Optimization with Reinforcement Learningcited by 82
- 2020Secretary and Online Matching Problems with Machine Learned Advicecited by 71
- 2020Reinforcement Learning with Combinatorial Actions: An Application to Vehicle Routingcited by 61
4 more
- 2019DeepPool: Distributed Model-free Algorithm for Ride-sharing using Deep Reinforcement Learningcited by 54
- 2020Application of Deep Q-Network in Portfolio Managementcited by 11
- 2018Dynamic Type Matchingcited by 8
- 2020Mechanism Design for Stable Matching with Contracts in a Dynamic Manufacturing-as-a-Service (MaaS) Marketplacecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Optimizing Job Shop Scheduling in the Furniture Industry: A Reinforcement Learning Approach Considering Machine Setup, Batch Variability, and Intralogistics
- 2025Learning to Optimize Capacity Planning in Semiconductor Manufacturing
- 2025A Negotiation-Based Multi-Agent Reinforcement Learning Approach for Dynamic Scheduling of Reconfigurable Manufacturing Systems
- 2026Event-Driven Reinforcement Learning Enables Long-Horizon Control in Semiconductor Fabrication
- 2026Hard Constraints, Smooth Gradients: Learning Feasible Inventory Policies via Differentiable Projection
- 2026Reinforcement Learning-Based Production Scheduling in an Industry-Based Coating Scenario Using the Digital Model Playground
- 2025Structure-Informed Deep Reinforcement Learning for Inventory Management
- 2025Deep RL Dual Sourcing Inventory Management with Supply and Capacity Risk Awareness