OpComm: A Reinforcement Learning Framework for Adaptive Buffer Control in Warehouse Volume Forecasting
On the map: Deep reinforcement learning methods → RL for energy, networks and operations
Abstract (arXiv)
Accurate forecasting of package volumes at delivery stations is critical for last-mile logistics, where errors lead to inefficient resource allocation, higher costs, and delivery delays. We propose OpComm, a forecasting and decision-support framework that combines supervised learning with reinforcement learning-based buffer control and a generative AI-driven communication module. A LightGBM regression model generates station-level demand forecasts, which serve as context for a Proximal Policy Optimization (PPO) agent that selects buffer levels from a discrete action set. The reward function penalizes under-buffering more heavily than over-buffering, reflecting real-world trade-offs between unmet demand risks and resource inefficiency. Station outcomes are fed back through a Monte Carlo update mechanism, enabling continual policy adaptation. To enhance interpretability, a generative AI layer produces executive-level summaries and scenario analyses grounded in SHAP-based feature attributions. Across 400+ stations, OpComm reduced Weighted Absolute Percentage Error (WAPE) by 21.65% compared to manual forecasts, while lowering under-buffering incidents and improving transparency for decision-makers. This work shows how contextual reinforcement learning, coupled with predictive modeling, can address operational forecasting challenges and bridge statistical rigor with practical decision-making in high-stakes logistics environments.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for energy, networks and operations, one of 15 directions in Deep reinforcement learning methods. Builds on 2 of its 4 references that are in the map. First posted on arXiv 17 Dec 2025.
Builds on
2 of 4 references.
References · 2
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Learning to Staff: Offline Reinforcement Learning and Fine-Tuned LLMs for Warehouse Staffing Optimization
- 2026Designing a double deep reinforcement learning selection tool for resilient demand prediction
- 2024Deep Reinforcement Learning for Dynamic Order Picking in Warehouse Operations
- 2026Multi-Agent Reinforcement Learning from Delayed Marketplace Feedback for Objective-Weight Adaptation in Three-Sided Dispatch
- 2025ORPR: An OR-Guided Pretrain-then-Reinforce Learning Model for Inventory Management
- 2025Outbound Modeling for Inventory Management
- 2026AI Agents for Inventory Control: Human-LLM-OR Complementarity
- 2025Reinforcement Learning for Autonomous Warehouse Orchestration in SAP Logistics Execution: Redefining Supply Chain Agility