mlsanityData to 14 Oct 2026

A Machine Learning Approach Towards SKILL Code Autocompletion

arXiv 2312.01921 ↗First posted 4 Dec 2023cs.SE cs.CL cs.PLcited by 0

Not on the map. Why?

Abstract (arXiv)

As Moore's Law continues to increase the complexity of electronic systems, Electronic Design Automation (EDA) must advance to meet global demand. An important example of an EDA technology is SKILL, a scripting language used to customize and extend EDA software. Recently, code generation models using the transformer architecture have achieved impressive results in academic settings and have even been used in commercial developer tools to improve developer productivity. To the best of our knowledge, this study is the first to apply transformers to SKILL code autocompletion towards improving the productivity of hardware design engineers. In this study, a novel, data-efficient methodology for generating SKILL code is proposed and experimentally validated. More specifically, we propose a novel methodology for (i) creating a high-quality SKILL dataset with both unlabeled and labeled data, (ii) a training strategy where T5 models pre-trained on general programming language code are fine-tuned on our custom SKILL dataset using unsupervised and supervised learning, and (iii) evaluating synthesized SKILL code. We show that models trained using the proposed methodology outperform baselines in terms of human-judgment score and BLEU score. A major challenge faced was the extremely small amount of available SKILL code data that can be used to train a transformer model to generate SKILL code. Despite our validated improvements, the extremely small dataset available to us was still not enough to train a model that can reliably autocomplete SKILL code. We discuss this and other limitations as well as future work that could address these limitations.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 26 of its 62 references that are in the map. First posted on arXiv 4 Dec 2023.

Builds on

26 of 62 references.

References · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  4. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  5. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  6. 2015Neural Machine Translation of Rare Words with Subword Unitscited by 2,918
  7. 2018SentencePiece: A simple and language independent subword tokenizer and detokenizer for Neural Text Processingcited by 1,989
  8. 2018A Call for Clarity in Reporting BLEU Scorescited by 1,799
  9. 2022Competition-Level Code Generation with AlphaCodecited by 1,462
  10. 2018Hierarchical Neural Story Generationcited by 1,193
  11. 2021CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generationcited by 906
  12. 2018Adafactor: Adaptive Learning Rates with Sublinear Memory Costcited by 905
14 more
  1. 2022CodeGen: An Open Large Language Model for Code with Multi-Turn Program Synthesiscited by 885
  2. 2019CodeSearchNet Challenge: Evaluating the State of Semantic Code Searchcited by 654
  3. 2020CodeBLEU: a Method for Automatic Evaluation of Code Synthesiscited by 479
  4. 2022Benchmarking Large Language Models for Automated Verilog RTL Code Generationcited by 115
  5. 2021Machine Learning for Electronic Design Automation: A Surveycited by 72
  6. 2017A parallel corpus of Python functions and documentation strings for automated code documentation and code generationcited by 57
  7. 2020DAVE: Deriving Automatically Verilog from Englishcited by 48
  8. 2019Recommendations for Datasets for Source Code Summarizationcited by 46
  9. 2020On Learning Meaningful Assert Statements for Unit Test Casescited by 42
  10. 2016Deep API Learningcited by 41
  11. 2018StaQC: A Systematically Mined Question-Code Dataset from Stack Overflowcited by 30
  12. 2021CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computingcited by 28
  13. 2020Latent Programmer: Discrete Latent Codes for Program Synthesiscited by 18
  14. 2018Public Git Archive: a Big Code dataset for allcited by 6

Built on by

Not cited yet.