mlsanityData to 14 Oct 2026

RTLSeek: Boosting the LLM-Based RTL Generation with Multi-Stage Diversity-Oriented Reinforcement Learning

arXiv 2603.27630 ↗First posted 29 Mar 2026cs.AR cs.LGcited by 4

Not on the map. Why?

Abstract (arXiv)

Register Transfer Level (RTL) design translates high-level specifications into hardware using HDLs such as Verilog. Although LLM-based RTL generation is promising, the scarcity of functionally verifiable high-quality data limits both accuracy and diversity. Existing post-training typically produces a single HDL implementation per specification, lacking awareness of RTL variations needed for different design goals. We propose RTLSeek, a post-training paradigm that applies rule-based Diversity-Oriented Reinforcement Learning to improve RTL correctness and diversity. Our Diversity-Centric Multi-Objective Reward Scheduling integrates expert knowledge with EDA feedback, and a three-stage framework maximizes the utility of limited data. Experiments on the RTLLM benchmark show that RTLSeek surpasses prior methods, with ablation results confirming that encouraging broader design-space exploration improves RTL quality and achieves the principle of "the more generated, the better results." Implementation framework, including the dataset, source code, and model weights, is shown at https://anonymous.4open.science/r/DAC2026ID71-ACB4/.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 11 of its 22 references that are in the map. First posted on arXiv 29 Mar 2026.

Builds on

11 of 22 references.

References · 11

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  5. 2025Demystifying Long Chain-of-Thought Reasoning in LLMscited by 326
  6. 2023VerilogEval: Evaluating Large Language Models for Verilog Code Generationcited by 252
  7. 2025Qwen2.5-1M Technical Reportcited by 164
  8. 2022Benchmarking Large Language Models for Automated Verilog RTL Code Generationcited by 115
  9. 2024Towards LLM-Powered Verilog RTL Assistant: Self-Verification and Self-Correctioncited by 39
  10. 2025DeepRTL: Bridging Verilog Understanding and Generation with a Unified Representation Modelcited by 23
  11. 2025ChipSeek: Optimizing Verilog Generation via EDA-Integrated Reinforcement Learningcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Alpha-RTL: Test-Time Training for RTL Hardware Optimization
  2. 2026GRPO with State Mutations: Improving LLM-Based Hardware Test Plan Generation
  3. 2025EARL: Entropy-Aware RL Alignment of LLMs for Reliable RTL Code Generation
  4. 2026ACE-RTL: When Agentic Context Evolution Meets RTL-Specialized LLMs
  5. 2026LLMs as Adaptive Meta-Solvers: Strategy-Diverse RL for Industrial-Scale Optimization
  6. 2025VeriReason: Reinforcement Learning with Testbench Feedback for Reasoning-Enhanced Verilog Generation
  7. 2025Diversity-Aware Policy Optimization for Large Language Model Reasoning
  8. 2026StepPRM-RTL: Stepwise Process-Reward Guided LLM Fine-Tuning for Enhanced RTL Synthesis