mlsanityData to 7 Oct 2026

Sim2Act: Robust Simulation-to-Decision Learning via Adversarial Calibration and Group-Relative Perturbation

arXiv 2603.09053 ↗First posted 10 Mar 2026cs.LG cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Simulation-to-decision learning enables safe policy training in digital environments without risking real-world deployment, and has become essential in mission-critical domains such as supply chains and industrial systems. However, simulators learned from noisy or biased real-world data often exhibit prediction errors in decision-critical regions, leading to unstable action ranking and unreliable policies. Existing approaches either focus on improving average simulation fidelity or adopt conservative regularization, which may cause policy collapse by discarding high-risk high-reward actions. We propose Sim2Act, a robust simulation-to-decision framework that addresses both simulator and policy robustness. First, we introduce an adversarial calibration mechanism that re-weights simulation errors in decision-critical state-action pairs to align surrogate fidelity with downstream decision impact. Second, we develop a group-relative perturbation strategy that stabilizes policy learning under simulator uncertainty without enforcing overly pessimistic constraints. Extensive experiments on multiple supply chain benchmarks demonstrate improved simulation robustness and more stable decision performance under structured and unstructured perturbations.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 32 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

13 of 32 references.

References · 13

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
  3. 2017Non-Autoregressive Neural Machine Translationcited by 457
  4. 2017Robust Adversarial Reinforcement Learningcited by 439
  5. 2020Robust Deep Reinforcement Learning against Adversarial Perturbations on State Observationscited by 235
  6. 2016EPOpt: Learning Robust Neural Network Policies Using Model Ensemblescited by 136
  7. 2025GRPO-LEAD: A Difficulty-Aware Reinforcement Learning Approach for Concise Mathematical Reasoning in Language Modelscited by 81
  8. 2021Calibrating Predictions to Decisions: A Novel Approach to Multi-Class Calibrationcited by 79
  9. 2019Shaping Belief States with Generative Environment Models for RLcited by 65
  10. 2020Distributional Robustness and Regularization in Reinforcement Learningcited by 39
  11. 2024Robust Deep Reinforcement Learning with Adaptive Adversarial Perturbations in Action Spacecited by 9
  12. 2022Sensitivity Analysis in the Generalization of Experimental Resultscited by 5
1 more
  1. 2022A Model-based Multi-agent Framework to Enable an Agile Response to Supply Chain Disruptionscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.