mlsanityData to 7 Oct 2026

From English to ASIC: Hardware Implementation with Large Language Model

arXiv 2403.07039 ↗First posted 11 Mar 2024cs.AR cs.AI cs.CLcited by 3

Not on the map. Why?

Abstract (arXiv)

In the realm of ASIC engineering, the landscape has been significantly reshaped by the rapid development of LLM, paralleled by an increase in the complexity of modern digital circuits. This complexity has escalated the requirements for HDL coding, necessitating a higher degree of precision and sophistication. However, challenges have been faced due to the less-than-optimal performance of modern language models in generating hardware description code, a situation further exacerbated by the scarcity of the corresponding high-quality code datasets. These challenges have highlighted the gap between the potential of LLMs to revolutionize digital circuit design and their current capabilities in accurately interpreting and implementing hardware specifications. To address these challenges, a strategy focusing on the fine-tuning of the leading-edge nature language model and the reshuffling of the HDL code dataset has been developed. The fine-tuning aims to enhance models' proficiency in generating precise and efficient ASIC design, while the dataset reshuffling is intended to broaden the scope and improve the quality of training material. The model demonstrated significant improvements compared to the base model, with approximately 10% to 20% increase in accuracy across a wide range of temperature for the pass@1 metric. This approach is expected to facilitate a simplified and more efficient LLM-assisted framework for complex circuit design, leveraging their capabilities to meet the sophisticated demands of HDL coding and thus streamlining the ASIC development process.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 10 of its 16 references that are in the map. First posted on arXiv 11 Mar 2024.

Builds on

10 of 16 references.

References · 10

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  3. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  4. 2020Longformer: The Long-Document Transformercited by 3,362
  5. 2023Mistral 7Bcited by 3,065
  6. 2019Generating Long Sequences with Sparse Transformerscited by 1,523
  7. 2023GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpointscited by 1,311
  8. 2014How transferable are features in deep neural networks?cited by 1,216
  9. 2021ZeRO-Offload: Democratizing Billion-Scale Model Trainingcited by 339
  10. 2023VerilogEval: Evaluating Large Language Models for Verilog Code Generationcited by 246

Built on by

Cited by year

Citing papers per year: 2024: 1; 2025: 2.

3 papers.