mlsanityData to 14 Oct 2026

Optimal Resource Allocation for ML Model Training and Deployment under Concept Drift

arXiv 2512.12816 ↗First posted 14 Dec 2025cs.LG cs.NIcited by 0

Not on the map. Why?

Abstract (arXiv)

We study how to allocate resources for training and deployment of machine learning (ML) models under concept drift and limited budgets. We consider a setting in which a model provider distributes trained models to multiple clients whose devices support local inference but lack the ability to retrain those models, placing the burden of performance maintenance on the provider. We introduce a model-agnostic framework that captures the interaction between resource allocation, concept drift dynamics, and deployment timing. We show that optimal training policies depend critically on the aging properties of concept durations. Under sudden concept changes, we derive optimal training policies subject to budget constraints when concept durations follow distributions with Decreasing Mean Residual Life (DMRL), and show that intuitive heuristics are provably suboptimal under Increasing Mean Residual Life (IMRL). We further study model deployment under communication constraints, prove that the associated optimization problem is quasi-convex under mild conditions, and propose a randomized scheduling strategy that achieves near-optimal client-side performance. These results offer theoretical and algorithmic foundations for cost-efficient ML model management under concept drift, with implications for continual learning, distributed inference, and adaptive ML systems.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 45 references that are in the map. First posted on arXiv 14 Dec 2025.

Builds on

18 of 45 references.

References · 18

  1. 2020Scaling Laws for Neural Language Modelscited by 6,586
  2. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  3. 2020Learning under Concept Drift: A Reviewcited by 477
  4. 2018RoboTurk: A Crowdsourcing Platform for Robotic Skill Learning through Imitationcited by 204
  5. 2022Machine Learning Operations (MLOps): Overview, Definition, and Architecturecited by 128
  6. 2024The rising costs of training frontier AI modelscited by 95
  7. 2020Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep Learningcited by 72
  8. 2021The Shape of Learning Curves: a Reviewcited by 70
  9. 2019Budgeted Training: Rethinking Deep Neural Network Training Under Resource Constraintscited by 37
  10. 2022Online Continual Learning on a Contaminated Data Stream with Blurry Task Boundariescited by 31
  11. 2015A Class of Prediction-Correction Methods for Time-Varying Convex Optimizationcited by 16
  12. 2025When to retrain a machine learning modelcited by 8
6 more
  1. 2023Cost-Effective Retraining of Machine Learning Modelscited by 7
  2. 2025Context-Aware Adaptive Sampling for Intelligent Data Acquisition Systems Using DQNcited by 6
  3. 2020Switching Scheme: A Novel Approach for Handling Incremental Concept Drift in Real-World Data Setscited by 4
  4. 2022GADGET: Online Resource Optimization for Scheduling Ring-All-Reduce Learning Jobscited by 4
  5. 2024Cost-Aware Dynamic Cloud Workflow Scheduling using Self-Attention and Evolutionary Reinforcement Learningcited by 4
  6. 2025Navigating MLOps: Insights into Maturity, Lifecycle, Tools, and Careerscited by 3

Built on by

Not cited yet.