mlsanityData to 14 Oct 2026

Leveraging AI for Productive and Trustworthy HPC Software: Challenges and Research Directions

arXiv 2505.08135 ↗First posted 13 May 2025cs.SE cs.AI cs.DCcited by 2

Not on the map. Why?

Abstract (arXiv)

We discuss the challenges and propose research directions for using AI to revolutionize the development of high-performance computing (HPC) software. AI technologies, in particular large language models, have transformed every aspect of software development. For its part, HPC software is recognized as a highly specialized scientific field of its own. We discuss the challenges associated with leveraging state-of-the-art AI technologies to develop such a unique and niche class of software and outline our research directions in the two US Department of Energy--funded projects for advancing HPC Software via AI: Ellora and Durban.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 22 of its 42 references that are in the map. First posted on arXiv 13 May 2025.

Builds on

22 of 42 references.

References · 22

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  4. 2024DeepSeek-Coder: When the Large Language Model Meets Programming -- The Rise of Code Intelligencecited by 1,181
  5. 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 333
  6. 2022Automatic Generation of Programming Exercises and Code Explanations using Large Language Modelscited by 126
  7. 2023A Large-Scale Survey on the Usability of AI Programming Assistants: Successes and Challengescited by 75
  8. 2024A Survey on LLM-based Code Generation for Low-Resource and Domain-Specific Programming Languagescited by 66
  9. 2024Can Large Language Models Write Parallel Code?cited by 36
  10. 2023Comparing Llama-2 and GPT-3 LLMs for HPC kernels generationcited by 30
  11. 2023Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generationcited by 22
  12. 2024The Landscape and Challenges of HPC Research and LLMscited by 22
10 more
  1. 2023AI-assisted Code Authoring at Scale: Fine-tuning, deploying, and mixed methods evaluationcited by 21
  2. 2024Performance-Aligned LLMs for Generating Fast Codecited by 21
  3. 2024CodeRosetta: Pushing the Boundaries of Unsupervised Code Translation for Parallel Programmingcited by 19
  4. 2023LLM4VV: Developing LLM-Driven Testsuite for Compiler Validationcited by 15
  5. 2024Multi-line AI-assisted Code Authoringcited by 13
  6. 2022Reinventing High Performance Computing: Challenges and Opportunitiescited by 6
  7. 2023Scalable Delivery of Scalable Libraries and Tools: How ECP Delivered a Software Ecosystem for Exascale and Beyondcited by 3
  8. 2022The State of Fortrancited by 2
  9. 2023A cast of thousands: How the IDEAS Productivity project has advanced software productivity and sustainabilitycited by 2
  10. 2025Towards Semantics Lifting for Scientific Computing: A Case Study on FFTcited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

  1. 2026AstraAI: LLMs, Retrieval, and AST-Guided Assistance for HPC Codebasescited by 0
  2. 2026Learning Reasoning World Models for Parallel Codecited by 0