mlsanityData to 7 Oct 2026

SuperCode: Sustainability PER AI-driven CO-DEsign

arXiv 2412.08490 ↗First posted 11 Dec 2024astro-ph.IM cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Currently, data-intensive scientific applications require vast amounts of compute resources to deliver world-leading science. The climate emergency has made it clear that unlimited use of resources (e.g., energy) for scientific discovery is no longer acceptable. Future computing hardware promises to be much more energy efficient, but without better optimized software this cannot reach its full potential. In this vision paper, we propose a generic AI-driven co-design methodology, using specialized Large Language Models (like ChatGPT), to effectively generate efficient code for emerging computing hardware. We describe how we will validate our methodology with two radio astronomy applications, with sustainability as the key performance indicator. This paper is a modified version of our accepted SuperCode project proposal. We present it here in this form to introduce the vision behind this project and to disseminate the work in the spirit of Open Science and transparency. An additional aim is to collect feedback, invite potential collaboration partners and use-cases to join the project.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 13 of its 71 references that are in the map. First posted on arXiv 11 Dec 2024.

Builds on

13 of 71 references.

References · 13

  1. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  2. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  3. 2021Program Synthesis with Large Language Modelscited by 3,509
  4. 2022Emergent Abilities of Large Language Modelscited by 2,483
  5. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,906
  6. 2023Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Modelscited by 695
  7. 2023ChipNeMo: Domain-Adapted LLMs for Chip Designcited by 168
  8. 2021FedPara: Low-Rank Hadamard Product for Communication-Efficient Federated Learningcited by 140
  9. 2023ExpertPrompting: Instructing Large Language Models to be Distinguished Expertscited by 140
  10. 2022KronA: Parameter Efficient Tuning with Kronecker Adaptercited by 130
  11. 2023One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuningcited by 84
  12. 2023Cost-Effective Hyperparameter Optimization for Large Language Model Generation Inferencecited by 40
1 more
  1. 2023Evaluation of OpenAI Codex for HPC Parallel Programming Models Kernel Generationcited by 22

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.