mlsanityData to 14 Oct 2026

gym-invmgmt: An Open Benchmarking Framework for Inventory Management Methods

arXiv 2605.11355 ↗First posted 12 May 2026cs.LG cs.CEcited by 1

Not on the map. Why?

Abstract (arXiv)

Inventory-policy comparisons are often difficult to interpret because performance depends on the evaluation contract as much as on the policy itself. Differences in topology, demand regime, information access, feasibility constraints, shortage treatment, and Key Performance Indicator (KPI) definitions can change method rankings. We present gym-invmgmt, a Gymnasium-compatible extension of the OR-Gym inventory-management lineage for auditable cross-paradigm evaluation. The benchmark evaluates optimization, heuristic, and learned controllers under a shared CoreEnv transition, reward, action-bound, and KPI contract, while varying stress conditions through a 22-scenario core grid plus four supplemental MARL-mode rows. Within these released scenarios, informed stochastic programming provides the strongest non-oracle reference, reflecting the value of scenario hedging under forecast access, but at substantially higher online computational cost. Among learned controllers, the Proximal Policy Optimization Transformer variant (PPO-Transformer) achieves the strongest learned-policy quality at fast inference, while Residual Reinforcement Learning (Residual RL) provides competitive hybrid performance. The graph neural network variant (PPO-GNN) is highly competitive on the default divergent topology but less robust on the serial topology. Imitation learning performs well in stationary regimes but degrades under demand shift, and the bounded Large Language Model (LLM) policy-parameter baseline is best interpreted as a diagnostic controller rather than an autonomous inventory optimizer. Overall, the benchmark identifies scenario-conditioned leaders while showing that performance depends jointly on information access, demand shift, topology, and policy representation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 17 of its 52 references that are in the map. First posted on arXiv 12 May 2026.

Builds on

17 of 52 references.

References · 17

  1. 2017Attention Is All You Needcited by 60,361
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2017Graph Attention Networkscited by 8,923
  5. 2024Qwen2.5 Technical Reportcited by 4,942
  6. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  7. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  8. 2015Pointer Networkscited by 895
  9. 2019Stabilizing Transformers for Reinforcement Learningcited by 270
  10. 2018Residual Policy Learningcited by 164
  11. 2023Jumanji: a Diverse Suite of Scalable Reinforcement Learning Environments in JAXcited by 58
  12. 2020OR-Gym: A Reinforcement Learning Library for Operations Research Problemscited by 51
5 more
  1. 2022Deep Inventory Managementcited by 23
  2. 2019ORL: Reinforcement Learning Benchmarks for Online Stochastic Optimization Problemscited by 21
  3. 2023A Versatile Multi-Agent Reinforcement Learning Benchmark for Inventory Managementcited by 10
  4. 2024Leveraging Graph Neural Networks and Multi-Agent Reinforcement Learning for Inventory Control in Supply Chainscited by 10
  5. 2023MARLIM: Multi-Agent Reinforcement Learning for Inventory Managementcited by 6

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025Structure-Informed Deep Reinforcement Learning for Inventory Management
  2. 2024Zero-shot Generalization in Inventory Management: Train, then Estimate and Decide
  3. 2025Classical and Deep Reinforcement Learning Inventory Control Policies for Pharmaceutical Supply Chains with Perishability and Non-Stationarity
  4. 2024Neural Coordination and Capacity Control for Inventory Management
  5. 2025ORPR: An OR-Guided Pretrain-then-Reinforce Learning Model for Inventory Management
  6. 2026InvEvolve: Evolving White-Box Inventory Policies via Large Language Models with Performance Guarantees
  7. 2025Data-driven inventory management for new products: An adjusted Dyna-Q approach with transfer learning
  8. 2024VC Theory for Inventory Policies