A Reinforcement Learning Environment For Job-Shop Scheduling
Not on the map. Why?
Abstract (arXiv)
Scheduling is a fundamental task occurring in various automated systems applications, e.g., optimal schedules for machines on a job shop allow for a reduction of production costs and waste. Nevertheless, finding such schedules is often intractable and cannot be achieved by Combinatorial Optimization Problem (COP) methods within a given time limit. Recent advances of Deep Reinforcement Learning (DRL) in learning complex behavior enable new COP application possibilities. This paper presents an efficient DRL environment for Job-Shop Scheduling -- an important problem in the field. Furthermore, we design a meaningful and compact state representation as well as a novel, simple dense reward function, closely related to the sparse make-span minimization criteria used by COP methods. We demonstrate that our approach significantly outperforms existing DRL methods on classic benchmark instances, coming close to state-of-the-art COP approaches.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). Builds on 7 of its 25 references that are in the map. First posted on arXiv 8 Apr 2021.
Builds on
7 of 25 references.
References · 7
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2015Trust Region Policy Optimizationcited by 2,503
- 2016Asynchronous Methods for Deep Reinforcement Learningcited by 2,218
- 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
- 2020A Closer Look at Invalid Action Masking in Policy Gradient Algorithmscited by 160
- 2020Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement Learningcited by 139
Built on by
Citing papers per year: 2022: 2; 2023: 6; 2024: 5; 2025: 4; 2026: 4.
21 papers.
Sort:
By area:
- 2022Deep Reinforcement Learning Guided Improvement Heuristic for Job Shop Schedulingcited by 20
- 2024Graph Neural Networks for Job Shop Scheduling Problems: A Surveycited by 15
- 2023An End-to-End Reinforcement Learning Approach for Job-Shop Scheduling Problems Based on Constraint Programmingcited by 11
- 2024Learning Topological Representations with Bidirectional Graph Attention Network for Solving Job Shop Scheduling Problemcited by 5
- 2022Decomposition Strategies and Multi-shot ASP Solving for Job-shop Schedulingcited by 3
- 2023Policy-Based Self-Competition for Planning Problemscited by 3
- 2023Solving the flexible job-shop scheduling problem through an enhanced deep reinforcement learning approachcited by 3
- 2024Attention-based Reinforcement Learning for Combinatorial Optimization: Application to Job Shop Scheduling Problemcited by 3
- 2026Scalable Production Scheduling: Linear Complexity via Unified Homogeneous Graphscited by 3
- 2025A Production Scheduling Framework for Reinforcement Learning Under Real-World Constraintscited by 2
- 2023Semiconductor Fab Scheduling with Self-Supervised and Reinforcement Learningcited by 1
- 2023A Reinforcement Learning Approach for Scheduling Problems With Improved Generalization Through Order Swappingcited by 1
9 more
- 2023Graph Neural Networks for the Offline Nanosatellite Task Scheduling Problemcited by 1
- 2024Decision Transformer for Enhancing Neural Local Search on the Job Shop Scheduling Problemcited by 1
- 2024Optimizing Job Shop Scheduling in the Furniture Industry: A Reinforcement Learning Approach Considering Machine Setup, Batch Variability, and Intralogisticscited by 1
- 2025Scalability of Reinforcement Learning Methods for Dispatching in Semiconductor Frontend Fabs: A Comparison of Open-Source Models with Real Industry Datasetscited by 1
- 2025Unraveling the Rainbow: can value-based methods schedule?cited by 0
- 2025Deep Learning for Unrelated-Machines Scheduling: Handling Variable Dimensionscited by 0
- 2026Mamba Meets Scheduling: Learning to Solve Flexible Job Shop Scheduling with Efficient Sequence Modelingcited by 0
- 2026HGT-Scheduler: Deep Reinforcement Learning for the Job Shop Scheduling Problem via Heterogeneous Graph Transformerscited by 0
- 2026Curriculum Learning with GNN-based Reinforcement Learning for Job Shop Schedulingcited by 0
- 2026Curriculum Learning with GNN-based Reinforcement Learning for Job Shop Scheduling23 Sep 2026
- 2026Scalable Production Scheduling: Linear Complexity via Unified Homogeneous Graphs26 Apr 2026
- 2026HGT-Scheduler: Deep Reinforcement Learning for the Job Shop Scheduling Problem via Heterogeneous Graph Transformers6 Mar 2026
- 2026Mamba Meets Scheduling: Learning to Solve Flexible Job Shop Scheduling with Efficient Sequence Modeling25 Feb 2026
- 2025Deep Learning for Unrelated-Machines Scheduling: Handling Variable Dimensions22 Dec 2025
- 2025A Production Scheduling Framework for Reinforcement Learning Under Real-World Constraints16 Jun 2025
- 2025Scalability of Reinforcement Learning Methods for Dispatching in Semiconductor Frontend Fabs: A Comparison of Open-Source Models with Real Industry Datasets16 May 2025
- 2025Unraveling the Rainbow: can value-based methods schedule?6 May 2025
- 2024Optimizing Job Shop Scheduling in the Furniture Industry: A Reinforcement Learning Approach Considering Machine Setup, Batch Variability, and Intralogistics18 Sep 2024
- 2024Decision Transformer for Enhancing Neural Local Search on the Job Shop Scheduling Problem4 Sep 2024
- 2024Graph Neural Networks for Job Shop Scheduling Problems: A Survey20 Jun 2024
- 2024Learning Topological Representations with Bidirectional Graph Attention Network for Solving Job Shop Scheduling Problem27 Feb 2024
9 more
- 2024Attention-based Reinforcement Learning for Combinatorial Optimization: Application to Job Shop Scheduling Problem29 Jan 2024
- 2023Solving the flexible job-shop scheduling problem through an enhanced deep reinforcement learning approach24 Oct 2023
- 2023An End-to-End Reinforcement Learning Approach for Job-Shop Scheduling Problems Based on Constraint Programming9 Jun 2023
- 2023Policy-Based Self-Competition for Planning Problems7 Jun 2023
- 2023Graph Neural Networks for the Offline Nanosatellite Task Scheduling Problem24 Mar 2023
- 2023A Reinforcement Learning Approach for Scheduling Problems With Improved Generalization Through Order Swapping27 Feb 2023
- 2023Semiconductor Fab Scheduling with Self-Supervised and Reinforcement Learning14 Feb 2023
- 2022Deep Reinforcement Learning Guided Improvement Heuristic for Job Shop Scheduling20 Nov 2022
- 2022Decomposition Strategies and Multi-shot ASP Solving for Job-shop Scheduling16 May 2022
- 2022Deep Reinforcement Learning Guided Improvement Heuristic for Job Shop Schedulingcited by 20
- 2024Graph Neural Networks for Job Shop Scheduling Problems: A Surveycited by 15
- 2023An End-to-End Reinforcement Learning Approach for Job-Shop Scheduling Problems Based on Constraint Programmingcited by 11
- 2024Learning Topological Representations with Bidirectional Graph Attention Network for Solving Job Shop Scheduling Problemcited by 5
- 2022Decomposition Strategies and Multi-shot ASP Solving for Job-shop Schedulingcited by 3
- 2023Policy-Based Self-Competition for Planning Problemscited by 3
- 2023Solving the flexible job-shop scheduling problem through an enhanced deep reinforcement learning approachcited by 3
- 2024Attention-based Reinforcement Learning for Combinatorial Optimization: Application to Job Shop Scheduling Problemcited by 3
- 2026Scalable Production Scheduling: Linear Complexity via Unified Homogeneous Graphscited by 3
- 2025A Production Scheduling Framework for Reinforcement Learning Under Real-World Constraintscited by 2
- 2023Semiconductor Fab Scheduling with Self-Supervised and Reinforcement Learningcited by 1
- 2023A Reinforcement Learning Approach for Scheduling Problems With Improved Generalization Through Order Swappingcited by 1
12 most cited of 19 All 19 (JSON)
- 2026Curriculum Learning with GNN-based Reinforcement Learning for Job Shop Scheduling23 Sep 2026
- 2026Scalable Production Scheduling: Linear Complexity via Unified Homogeneous Graphs26 Apr 2026
- 2026HGT-Scheduler: Deep Reinforcement Learning for the Job Shop Scheduling Problem via Heterogeneous Graph Transformers6 Mar 2026
- 2025Deep Learning for Unrelated-Machines Scheduling: Handling Variable Dimensions22 Dec 2025
- 2025A Production Scheduling Framework for Reinforcement Learning Under Real-World Constraints16 Jun 2025
- 2025Scalability of Reinforcement Learning Methods for Dispatching in Semiconductor Frontend Fabs: A Comparison of Open-Source Models with Real Industry Datasets16 May 2025
- 2025Unraveling the Rainbow: can value-based methods schedule?6 May 2025
- 2024Optimizing Job Shop Scheduling in the Furniture Industry: A Reinforcement Learning Approach Considering Machine Setup, Batch Variability, and Intralogistics18 Sep 2024
- 2024Graph Neural Networks for Job Shop Scheduling Problems: A Survey20 Jun 2024
- 2024Learning Topological Representations with Bidirectional Graph Attention Network for Solving Job Shop Scheduling Problem27 Feb 2024
- 2024Attention-based Reinforcement Learning for Combinatorial Optimization: Application to Job Shop Scheduling Problem29 Jan 2024
- 2023Solving the flexible job-shop scheduling problem through an enhanced deep reinforcement learning approach24 Oct 2023
12 newest of 19 All 19 (JSON)