mlsanityData to 14 Oct 2026

What Artificial Intelligence can do for High-Performance Computing systems?

arXiv 2602.00014 ↗First posted 3 Jan 2026cs.DC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

High-performance computing (HPC) centers consume substantial power, incurring environmental and operational costs. This review assesses how artificial intelligence (AI), including machine learning (ML) and optimization, improves the efficiency of operational HPC systems. Approximately 1,800 publications from 2019 to 2025 were manually screened using predefined inclusion/exclusion criteria; 74 "AI for HPC" papers were retained and grouped into six application areas: performance estimation, performance optimization, scheduling, surrogate modeling, fault detection, and language-model-based automation. Scheduling is the most active area, spanning research-oriented reinforcement-learning schedulers to production-friendly hybrids that combine ML with heuristics. Supervised performance estimation is foundational for both scheduling and optimization. Graph neural networks and time-series models strengthen anomaly detection by capturing spatio-temporal dependencies in production telemetry. Domain-specialized language models for HPC can outperform general-purpose LLMs on targeted coding and automation tasks. Together, these findings highlight integration opportunities such as LLM-based operating-system concepts and underscore the need for advances in MLOps, standardization of AI components, and benchmarking methodology.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 37 of its 127 references that are in the map. First posted on arXiv 3 Jan 2026.

Builds on

37 of 127 references.

References · 37

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2016XGBoost: A Scalable Tree Boosting Systemcited by 5,166
  7. 2019PIQA: Reasoning about Physical Commonsense in Natural Languagecited by 2,883
  8. 2020Informer: Beyond Efficient Transformer for Long Sequence Time-Series Forecastingcited by 2,169
  9. 2021Dynamic Neural Networks: A Surveycited by 408
  10. 2023SpecInfer: Accelerating Generative Large Language Model Serving with Tree-based Speculative Inference and Verificationcited by 365
  11. 2023OpenAGI: When LLM Meets Domain Expertscited by 197
  12. 2020A Closer Look at Invalid Action Masking in Policy Gradient Algorithmscited by 171
25 more
  1. 2021Challenges in Detoxifying Language Modelscited by 169
  2. 2022A Physics-informed Diffusion Model for High-fidelity Flow Field Reconstructioncited by 152
  3. 2021Colossal-AI: A Unified Deep Learning System For Large-Scale Parallel Trainingcited by 96
  4. 2023Let the LLMs Talk: Simulating Human-to-Human Conversational QA via Zero-Shot LLM-to-LLM Interactionscited by 70
  5. 2024ExeGPT: Constraint-Aware Resource Scheduling for LLM Inferencecited by 45
  6. 2021Torch.fx: Practical Program Capture and Transformation for Deep Learning in Pythoncited by 40
  7. 2023User Inference Attacks on Large Language Modelscited by 36
  8. 2021Characterization and Prediction of Deep Learning Workloads in Large-Scale GPU Datacenterscited by 31
  9. 2023HPC-GPT: Integrating Large Language Model for High-Performance Computingcited by 22
  10. 2022Alpa: Automating Inter- and Intra-Operator Parallelism for Distributed Deep Learningcited by 20
  11. 2023LLM4VV: Developing LLM-Driven Testsuite for Compiler Validationcited by 15
  12. 2022MoEC: Mixture of Expert Clusterscited by 14
  13. 2021Deep Reinforcement Agent for Scheduling in HPCcited by 10
  14. 2021Colmena: Scalable Machine-Learning-Based Steering of Ensemble Simulations for High Performance Computingcited by 10
  15. 2019Enabling Machine Learning-Ready HPC Ensembles with Merlincited by 7
  16. 2021Online Evolutionary Batch Size Orchestration for Scheduling Deep Learning Workloads in GPU Clusterscited by 7
  17. 2022RUAD: unsupervised anomaly detection in HPC systemscited by 4
  18. 2021DRAS-CQSim: A Reinforcement Learning based Framework for HPC Cluster Schedulingcited by 3
  19. 2023Predicting the Performance of a Computing System with Deep Networkscited by 3
  20. 2023CDMPP: A Device-Model Agnostic Framework for Latency Prediction of Tensor Programscited by 3
  21. 2025SLICES, a scientific instrument for the networking communitycited by 2
  22. 2021Hybrid Workload Scheduling on HPC Systemscited by 1
  23. 2022A Deep Neural Networks ensemble workflow from hyperparameter search to inference leveraging GPU clusterscited by 1
  24. 2023Space Efficient Sequence Alignment for SRAM-Based Computing: X-Drop on the Graphcore IPUcited by 1
  25. 2024Automating the Training and Deployment of Models in MLOps by Integrating Systems with Machine Learningcited by 1

Built on by

Not cited yet.