mlsanityData to 14 Oct 2026

Time-Lag-Aware Deep Reinforcement Learning for Flexible Job-Shop Scheduling in PPVC Module Factories

arXiv 2607.11725 ↗First posted 13 Jul 2026cs.LG cs.AI math.OCcited by 0

On the map: Deep reinforcement learning methods → RL for energy, networks and operations

Abstract (arXiv)

Prefabricated prefinished volumetric construction moves most building work into module factories, whose production floor operates as a flexible job shop. A major complication is decisive: long post-operation time-lags caused by concrete curing, watertightness ponding tests, and paint drying, during which a module is blocked while its workstation stays free. On benchmark instances grounded in an official national prefabrication guidebook, these lags inflate even the optimal reference makespan by about 67% on average, and ignoring them at decision time, then repairing to feasibility, is worse than every dispatching rule. We adapt a state-of-the-art dual-attention deep reinforcement learning solver through three minimally invasive, individually ablatable extensions: lag-aware dynamics with an admissible reward bound, two anticipatory lag feature channels, and liveness-masked operation- and station-type embeddings. With every extension disabled the implementation reproduces the original solver exactly, so all gains are attributable to the adaptations. We release a public, guidebook-grounded benchmark generator. On held-out instances the learned policy is the strongest solver-free scheduler: it reaches within about 4% of a constraint-programming reference and beats every dispatching rule and a genetic-algorithm metaheuristic, with its advantage widening under capacity contention, and a single size-mixed policy carries this lead across the trained range of factory sizes. It needs no solver, model, or license in the loop and re-plans within seconds of a disruption; where an exact solver can be deployed, that solver remains the quality ceiling, a boundary we map explicitly.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for energy, networks and operations, one of 15 directions in Deep reinforcement learning methods. Builds on 5 of its 31 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

5 of 31 references.

References · 5

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2020Learning to Dispatch for Job Shop Scheduling via Deep Reinforcement Learningcited by 140
  4. 2023Flexible Job Shop Scheduling via Dual Attention Network Based Reinforcement Learningcited by 20
  5. 2024Graph Neural Networks for Job Shop Scheduling Problems: A Surveycited by 15

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning Flexible Job Shop Scheduling under Limited Buffers and Material Kitting Constraints
  2. 2026RESCHED: Rethinking Flexible Job Shop Scheduling from a Transformer-based Architecture with Simplified States
  3. 2024Beyond Training: Optimizing Reinforcement Learning Based Job Shop Scheduling Through Adaptive Action Sampling
  4. 2026A Sliding-Window-Based Reinforcement Learning for Dynamic Assembly Flow Shop Scheduling with Multi-Product Delivery
  5. 2024Optimizing Job Shop Scheduling in the Furniture Industry: A Reinforcement Learning Approach Considering Machine Setup, Batch Variability, and Intralogistics
  6. 2025A Production Scheduling Framework for Reinforcement Learning Under Real-World Constraints
  7. 2026Scheduling That Speaks: An Interpretable Programmatic Reinforcement Learning Framework
  8. 2026Variational Approach for Job Shop Scheduling