Assessing Large Language Models in Generating RTL Design Specifications
Not on the map. Why?
Abstract (arXiv)
As IC design grows more complex, automating comprehension and documentation of RTL code has become increasingly important. Engineers currently should manually interpret existing RTL code and write specifications, a slow and error-prone process. Although LLMs have been studied for generating RTL from specifications, automated specification generation remains underexplored, largely due to the lack of reliable evaluation methods. To address this gap, we investigate how prompting strategies affect RTL-to-specification quality and introduce metrics for faithfully evaluating generated specs. We also benchmark open-source and commercial LLMs, providing a foundation for more automated and efficient specification workflows in IC design.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 12 of its 30 references that are in the map. First posted on arXiv 17 Nov 2025.
Builds on
12 of 30 references.
References · 12
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2024A Systematic Survey of Prompt Engineering in Large Language Models: Techniques and Applicationscited by 428
- 2023VerilogEval: Evaluating Large Language Models for Verilog Code Generationcited by 246
- 2021On the Evaluation of Neural Code Summarizationcited by 47
- 2024Revisiting VerilogEval: A Year of Improvements in Large-Language Models for Hardware Code Generationcited by 45
- 2024MAGE: A Multi-Agent Engine for Automated RTL Code Generationcited by 31
- 2025DeepRTL: Bridging Verilog Understanding and Generation with a Unified Representation Modelcited by 23
- 2023Evaluating Code Summarization Techniques: A New Metric and an Empirical Characterizationcited by 21
- 2022Semantic Similarity Metrics for Evaluating Source Code Summarizationcited by 14
- 2025DeepRTL2: A Versatile Model for RTL-Related Taskscited by 10
- 2025Automated and Context-Aware Code Documentation Leveraging Advanced LLMscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.