A System Level Performance Evaluation for Superconducting Digital Systems
Not on the map. Why?
Abstract (arXiv)
Superconducting Digital (SCD) technology offers significant potential for enhancing the performance of next generation large scale compute workloads. By leveraging advanced lithography and a 300 mm platform, SCD devices can reduce energy consumption and boost computational power. This paper presents a cross-layer modeling approach to evaluate the system-level performance benefits of SCD architectures for Large Language Model (LLM) training and inference. Our findings, based on experimental data and Pulse Conserving Logic (PCL) design principles, demonstrate substantial performance gain in both training and inference. We are, thus, able to convincingly show that the SCD technology can address memory and interconnect limitations of present day solutions for next-generation compute systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 8 of its 34 references that are in the map. First posted on arXiv 13 Nov 2024.
Builds on
8 of 34 references.
References · 8
- 2017Attention Is All You Needcited by 59,932
- 2020Scaling Laws for Neural Language Modelscited by 6,411
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,611
- 2021Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LMcited by 621
- 2022The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrinkcited by 183
- 2023From Words to Watts: Benchmarking the Energy Costs of Large Language Model Inferencecited by 168
- 2024AI and Memory Wallcited by 89
- 2024Performance Modeling and Workload Analysis of Distributed Large Language Model Training and Inferencecited by 9
Built on by
Not cited yet.