mlsanityData to 7 Oct 2026

Synergy: Resource Sensitive DNN Scheduling in Multi-Tenant Clusters

arXiv 2110.06073 ↗First posted 12 Oct 2021cs.DC cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Training Deep Neural Networks (DNNs) is a widely popular workload in both enterprises and cloud data centers. Existing schedulers for DNN training consider GPU as the dominant resource, and allocate other resources such as CPU and memory proportional to the number of GPUs requested by the job. Unfortunately, these schedulers do not consider the impact of a job's sensitivity to allocation of CPU, memory, and storage resources. In this work, we propose Synergy, a resource-sensitive scheduler for shared GPU clusters. Synergy infers the sensitivity of DNNs to different resources using optimistic profiling; some jobs might benefit from more than the GPU-proportional allocation and some jobs might not be affected by less than GPU-proportional allocation. Synergy performs such multi-resource workload-aware assignments across a set of jobs scheduled on shared multi-tenant clusters using a new near-optimal online algorithm. Our experiments show that workload-aware CPU and memory allocations can improve average JCT up to 3.4x when compared to traditional GPU-proportional scheduling.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 60 references that are in the map. First posted on arXiv 12 Oct 2021.

Builds on

18 of 60 references.

References · 18

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  3. 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
  4. 2016Pointer Sentinel Mixture Modelscited by 2,992
  5. 2019RandAugment: Practical automated data augmentation with a reduced search spacecited by 2,261
  6. 2019Transformer-XL: Attentive Language Models Beyond a Fixed-Length Contextcited by 1,830
  7. 2016Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translationcited by 1,471
  8. 2017ShuffleNet: An Extremely Efficient Convolutional Neural Network for Mobile Devicescited by 1,194
  9. 2016CVXPY: A Python-Embedded Modeling Language for Convex Optimizationcited by 633
  10. 2014Deep Speech: Scaling up end-to-end speech recognitioncited by 354
  11. 2016FMA: A Dataset For Music Analysiscited by 205
  12. 2019Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloadscited by 79
6 more
  1. 2016Very Deep Convolutional Neural Networks for Raw Waveformscited by 68
  2. 2020Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep Learningcited by 68
  3. 2020Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloadscited by 56
  4. 2019Themis: Fair and Efficient GPU Cluster Schedulingcited by 43
  5. 2021tf.data: A Machine Learning Data Processing Frameworkcited by 40
  6. 2020Analyzing and Mitigating Data Stalls in DNN Trainingcited by 35

Built on by

Not cited yet.