mlsanityData to 7 Oct 2026

AI Factories: It's time to rethink the Cloud-HPC divide

arXiv 2509.12849 ↗First posted 16 Sep 2025cs.DC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The strategic importance of artificial intelligence is driving a global push toward Sovereign AI initiatives. Nationwide governments are increasingly developing dedicated infrastructures, called AI Factories (AIF), to achieve technological autonomy and secure the resources necessary to sustain robust local digital ecosystems. In Europe, the EuroHPC Joint Undertaking is investing hundreds of millions of euros into several AI Factories, built atop existing high-performance computing (HPC) supercomputers. However, while HPC systems excel in raw performance, they are not inherently designed for usability, accessibility, or serving as public-facing platforms for AI services such as inference or agentic applications. In contrast, AI practitioners are accustomed to cloud-native technologies like Kubernetes and object storage, tools that are often difficult to integrate within traditional HPC environments. This article advocates for a dual-stack approach within supercomputers: integrating both HPC and cloud-native technologies. Our goal is to bridge the divide between HPC and cloud computing by combining high performance and hardware acceleration with ease of use and service-oriented front-ends. This convergence allows each paradigm to amplify the other. To this end, we will study the cloud challenges of HPC (Serverless HPC) and the HPC challenges of cloud technologies (High-performance Cloud).

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 15 of its 71 references that are in the map. First posted on arXiv 16 Sep 2025.

Builds on

15 of 71 references.

References · 15

  1. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,767
  2. 2023DiLoCo: Distributed Low-Communication Training of Language Modelscited by 115
  3. 2022Parallel and Distributed Graph Neural Networks: An In-Depth Concurrency Analysiscited by 29
  4. 2021Production Machine Learning Pipelines: Empirical Analysis and Optimization Opportunitiescited by 21
  5. 2017Occupy the Cloud: Distributed Computing for the 99%cited by 17
  6. 2018Helix: Holistic Optimization for Accelerating Iterative Machine Learningcited by 11
  7. 2020AIOps for a Cloud Object Storage Servicecited by 5
  8. 2019FfDL : A Flexible Multi-tenant Deep Learning Platformcited by 4
  9. 2024XaaS: Acceleration as a Service to Enable Productive High-Performance Cloud Computingcited by 3
  10. 2024Software Resource Disaggregation for HPC with Serverless Computingcited by 3
  11. 2024The infrastructure powering IBM's Gen AI model developmentcited by 3
  12. 2021rFaaS: Enabling High Performance Serverless with RDMA and Leasescited by 2
3 more
  1. 2022Using Unused: Non-Invasive Dynamic FaaS Infrastructure with HPC-Whiskcited by 2
  2. 2020The role of interactive super-computing in using HPC for urgent decision makingcited by 1
  3. 2024ColonyOS -- A Meta-Operating System for Distributed Computing Across Heterogeneous Platformcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024Transforming the Hybrid Cloud for Emerging AI Workloads
  2. 2025Quantifying Energy and Cost Benefits of Hybrid Edge Cloud: Analysis of Traditional and Agentic Workloads
  3. 2025Governed By Agents: A Survey On The Role Of Agentic AI In Future Computing Environments
  4. 2025Cloud Infrastructure Management in the Age of AI Agents
  5. 2025Murakkab: Resource-Efficient Agentic Workflow Orchestration in Cloud Platforms
  6. 2024Building AI Agents for Autonomous Clouds: Challenges and Design Principles
  7. 2026Infrastructure for the Agentic Web: Gap Analysis and Architecture from the Agentverse Platform
  8. 2026ASCEND: Personal AI Agents for Autonomous Scientific Computing Across HPC Clusters and GPU Workstations