LASER: Language Model Regression for Semi-Structured Workflow Resource and Runtime Estimation
Not on the map. Why?
Abstract (arXiv)
Accurate prediction of resource consumption and runtime for cloud workflow jobs is critical for scheduling efficiency, yet remains challenging due to the semi-structured nature of job configurations -- comprising shell commands, tool-specific parameters, dependency graphs, and hierarchical metadata. Traditional ML approaches require brittle feature engineering to flatten this rich information into fixed-size vectors, losing critical semantic context. We present LASER, a framework that fine-tunes LLMs on serialized workflow job configurations for multi-target resource and runtime regression. To address the challenges of numerical regression via generation, we introduce scientific notation output encoding for targets spanning multiple orders of magnitude, and constrained decoding with prefix filling to enforce output validity while reducing inference latency by over 30%. We further show that full-attention fine-tuning improves accuracy over sliding-window LLMs on long job contexts. Validated on large-scale chip design workloads, and GHARuntime, a new public benchmark derived from 580,000+ GitHub Actions runs across 27,000+ repositories, LASER outperforms human experts and SOTA tabular ML baselines, with clear model- and data-scaling behavior, establishing a new paradigm for LLM-based regression on semi-structured workflow data.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 28 references that are in the map. First posted on arXiv 8 Dec 2025.
Builds on
12 of 28 references.
References · 12
- 2025Qwen3 Technical Reportcited by 8,820
- 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
- 2025Gemma 3 Technical Reportcited by 1,824
- 2024From Words to Numbers: Your Large Language Model Is Secretly A Capable Regressor When Given In-Context Examplescited by 57
- 2024OmniPred: Language Models as Universal Regressorscited by 34
- 2025Performance Prediction for Large Systems via Text-to-Text Regressioncited by 14
- 2025Decoding-based Regressioncited by 12
- 2025Regression Language Models for Codecited by 11
- 2021WfCommons: A Framework for Enabling Scientific Workflow Research and Developmentcited by 8
- 2024Sizey: Memory-Efficient Execution of Scientific Workflow Taskscited by 2
- 2023Lotaru: Locally Predicting Workflow Task Runtimes for Resource Management on Heterogeneous Infrastructurescited by 1
- 2024Ponder: Online Prediction of Task Memory Requirements for Scientific Workflowscited by 1
Built on by
Not cited yet.