RefEvo: Agentic Design with Co-Evolutionary Verification for Agile Reference Model Generation
On the map: LLM agents and tool use → Software engineering coding agents
Abstract (arXiv)
As the complexity of System-on-Chip (SoC) designs grows, the shift-left paradigm necessitates the rapid development of high-fidelity reference models (typically written in SystemC) for early architecture exploration and verification. While Large Language Models (LLMs) show promise in code generation, their application to hardware modeling faces unique challenges: (1) Rigid, static workflows fail to adapt to varying design complexity, causing inefficiency; (2) Context window overflow in multi-turn interactions leads to catastrophic forgetting of critical specifications; and (3) the Coupled Validation Failure problem--where generated Testbenches (TBs) incorrectly validate flawed models due to correlated hallucinations--severely undermines reliability. To address these limitations, we introduce RefEvo, a dynamic multi-agent framework designed for agile and reliable reference modeling. RefEvo features three key innovations: (1) A Dynamic Design Planner that autonomously decomposes design specifications and constructs tailored execution workflows based on semantic complexity; (2) A Co-Evolutionary Verification Mechanism, which employs a Dialectical Arbiter to simultaneously rectify the model and verification logic against the specification (Spec) oracle, effectively mitigating false positives; and (3) A Spec Anchoring Strategy for lossless context compression. Evaluated on a diverse benchmark of 20 hardware modules, RefEvo achieves a 95% pass rate, outperforming static baselines by a large margin. Furthermore, our context optimization reduces token consumption by an average of 71.04%, achieving absolute savings of over 70,000 tokens per session for complex designs while maintaining 100% specification recall.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 36 references that are in the map. First posted on arXiv 27 Apr 2026.
Builds on
20 of 36 references.
Closest ancestors · 3
Same direction, newest first
- 2025AgentMesh: A Cooperative Multi-Agent Generative AI Framework for Software Development Automation26 Jul
- 2025Divergent Thoughts toward One Goal: LLM-based Multi-Agent Collaboration System for Electronic Design Automation15 Feb
- 2025Guided Code Generation with LLMs: A Multi-Agent Framework for Complex Code Tasks11 Jan
Other references · 17
- 2023ChipNeMo: Domain-Adapted LLMs for Chip Designcited by 168
- 2023Keep the Conversation Going: Fixing 162 out of 337 bugs for 0.42 each using ChatGPTcited by 125
- 2023Self-planning Code Generation with Large Language Modelscited by 121
- 2022Benchmarking Large Language Models for Automated Verilog RTL Code Generationcited by 112
- 2023The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuningcited by 106
- 2024TDAG: A Multi-Agent Framework based on Dynamic Task Decomposition and Agent Generationcited by 50
- 2023Large Language Model-Aware In-Context Learning for Code Generationcited by 42
- 2024Advancing Agentic Systems: Dynamic Task Decomposition, Tool Integration and Evaluation using Novel Metrics and Datasetcited by 24
- 2024UVLLM: An Automated Universal RTL Verification Framework using LLMscited by 17
- 2025FIXME: Towards End-to-End Benchmarking of LLM-Aided Design Verificationcited by 9
- 2024A Comprehensive Survey of AI-Driven Advancements and Techniques in Automated Program Repair and Code Generationcited by 7
- 2025iDSE: Navigating Design Space Exploration in High-Level Synthesis Using LLMscited by 6
5 more
- 2025ChatModel: Automating Reference Model Design and Verification with LLMscited by 6
- 2025ReChisel: Effective Automatic Chisel Code Generation by LLM with Reflectioncited by 5
- 2026ChatSVA: Bridging SVA Generation for Hardware Verification via Task-Specific LLMscited by 5
- 2025ChipMind: Retrieval-Augmented Reasoning for Long-Context Circuit Design Specificationscited by 3
- 2024Towards Practical and Useful Automated Program Repair for Debuggingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Agentic Hardware Design as Repository-Level Code Evolution
- 2026Coco: An Agentic Copilot for the Hardware--Software Co-Design Lifecycle
- 2025DUET: Agentic Design Understanding via Experimentation and Testing
- 2026Back to the Future: Rethinking EDA Infrastructure for Agentic Systems in Chip Design Verification
- 2026ACE-RTL: When Agentic Context Evolution Meets RTL-Specialized LLMs
- 2026Is Agentic AI Ready for Real-World Hardware Engineering? A Deep Dive with Phoenix-bench
- 2025ASIC-Agent: An Autonomous Multi-Agent System for ASIC Design with Benchmark Evaluation
- 2026Benchmarking AI Agents for Hardware Design Automation via MCP Tool Calling