Leakage-Safe and Scheduler-Aware Machine Learning for Grid Job Runtime Prediction
Not on the map. Why?
Abstract (arXiv)
Accurate job runtime prediction can improve scheduling-aware resource management in grid and distributed computing environments, but prediction models must be evaluated under realistic deployment constraints. This paper revisits CPU burst time prediction on the GWA-T-4 AuverGrid workload trace and reformulates it as leakage-safe pre-execution job runtime prediction. We define the target as job-level runtime, use only submission-time attributes, exclude post-execution variables, and evaluate models under temporal and cold-start settings rather than relying only on random cross-validation. We compare standard regressors, chronological historical baselines, categorical encoding strategies, and CatBoost with native categorical handling. We further add temporal hyperparameter tuning, runtime predictability analysis, feature ablation, error analysis by job length, and a minimal scheduling simulation. After temporal-validation tuning, CatBoost achieves the strongest deployment-oriented result with R^2=0.239, MAE=27,019, RMSE=46,587, and LogMAE=2.646 on the held-out temporal test set. A single-server simulation over all 69,523 held-out temporal test jobs shows that prediction-informed SJF reduces average waiting time by 50.92% relative to FCFS. The results show that random-split evaluation overestimates performance, categorical-native boosting improves temporal generalization, and long-job underestimation remains a scheduler-relevant challenge.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 4 of its 16 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
4 of 16 references.
References · 4
- 2024A Reinforcement Learning Based Backfilling Strategy for HPC Batch Jobscited by 3
- 2025HPC Digital Twins for Evaluating Scheduling Policies, Incentive Structures and their Impact on Power and Coolingcited by 3
- 2025A Real-Time Digital Twin for Adaptive Schedulingcited by 1
- 2026Duration-Informed Workload Schedulercited by 1
Built on by
Not cited yet.