mlsanityData to 14 Oct 2026

Tesserae: Scalable Placement Policies for Deep Learning Workloads

arXiv 2508.04953 ↗First posted 7 Aug 2025cs.DC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Training deep learning (DL) models has become a dominant workload in data-centers and improving resource utilization is a key goal of DL cluster schedulers. In order to do this, schedulers typically incorporate placement policies that govern where jobs are placed on the cluster. Existing placement policies are either designed as ad-hoc heuristics or incorporated as constraints within a complex optimization problem and thus either suffer from suboptimal performance or poor scalability. Our key insight is that many placement constraints can be formulated as graph matching problems and based on that we design novel placement policies for minimizing job migration overheads and job packing. We integrate these policies into Tesserae and describe how our design leads to a scalable and effective GPU cluster scheduler. Our experimental results show that Tesserae improves average JCT by up to 1.62x and the Makespan by up to 1.15x compared with the existing schedulers.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 78 references that are in the map. First posted on arXiv 7 Aug 2025.

Builds on

40 of 78 references.

References · 40

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  4. 2020Language Models are Few-Shot Learnerscited by 32,419
  5. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  6. 2024The Llama 3 Herd of Modelscited by 14,715
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  8. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  9. 2016PointNet: Deep Learning on Point Sets for 3D Classification and Segmentationcited by 5,248
  10. 2018GLUE: A Multi-Task Benchmark and Analysis Platform for Natural Language Understandingcited by 4,899
  11. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,148
  12. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
28 more
  1. 2023Qwen Technical Reportcited by 3,344
  2. 2015ShapeNet: An Information-Rich 3D Model Repositorycited by 2,897
  3. 2024Qwen2 Technical Reportcited by 2,120
  4. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
  5. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,998
  6. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,868
  7. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
  8. 2022Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Taskscited by 868
  9. 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 632
  10. 2019Deep Learning Recommendation Model for Personalization and Recommendation Systemscited by 327
  11. 2018Horovod: fast and easy distributed deep learning in TensorFlowcited by 279
  12. 2018Beyond Data and Model Parallelism for Deep Neural Networkscited by 179
  13. 2018Mesh-TensorFlow: Deep Learning for Supercomputerscited by 169
  14. 2020Memory-Efficient Pipeline-Parallel DNN Trainingcited by 134
  15. 2018Solving Linear Programs in the Current Matrix Multiplication Timecited by 100
  16. 2019Analysis of Large-Scale Multi-Tenant GPU Clusters for DNN Training Workloadscited by 79
  17. 2020Pollux: Co-adaptive Cluster Scheduling for Goodput-Optimized Deep Learningcited by 72
  18. 2020Heterogeneity-Aware Cluster Scheduling Policies for Deep Learning Workloadscited by 56
  19. 2024Characterization of Large Language Model Development in the Datacentercited by 46
  20. 2018Supporting Very Large Models using Automatic Dataflow Graph Partitioningcited by 43
  21. 2019Themis: Fair and Efficient GPU Cluster Schedulingcited by 43
  22. 2022Aryl: An Elastic Cluster Scheduler for Deep Learningcited by 27
  23. 2022LlamaTune: Sample-Efficient DBMS Configuration Tuningcited by 14
  24. 2021Solving Large-Scale Granular Resource Allocation Problems Efficiently with POPcited by 13
  25. 2022Shockwave: Fair and Efficient Cluster Scheduling for Dynamic Adaptation in Machine Learningcited by 12
  26. 2022BagPipe: Accelerating Deep Recommendation Model Trainingcited by 10
  27. 2023MuxFlow: Efficient and Safe GPU Sharing in Large-Scale Production Deep Learning Clusterscited by 7
  28. 2023Blox: A Modular Toolkit for Deep Learning Schedulerscited by 2

Built on by

Not cited yet.