mlsanityData to 7 Oct 2026

ORFS-agent: Tool-Using Agents for Chip Design Optimization

arXiv 2506.08332 ↗First posted 10 Jun 2025cs.AIcited by 13

On the map: LLM agents and tool use → Software engineering coding agents

Abstract (arXiv)

Machine learning has been widely used to optimize complex engineering workflows across numerous domains. In integrated circuit design, modern flows (e.g., register-transfer level to physical layout) involve extensive configuration via thousands of parameters, and small changes can have large downstream impacts on design performance, power, and area. Recent advances in Large Language Models (LLMs) offer new opportunities for learning and reasoning within such high-dimensional optimization tasks. In this work, we introduce ORFS-agent, an LLM-based iterative optimization agent that automates parameter tuning in an open-source hardware design flow. ORFS-agent adaptively explores parameter configurations, demonstrating improvements over standard Bayesian optimization approaches in terms of resource efficiency and final design metrics. Across six benchmarks on ASAP7 and SKY130HD, thinking-model backends (Sonnet 4.6 [69] and Kimi K2.5 [28]) improve the geometric-mean normalized wirelength, effective clock period, and co-optimization objectives by up to 1.0%, 1.3%, and 2.7% over OR-AutoTuner while using 40% fewer iterations; the open-weight Kimi K2.5 remains within 0.24% of Sonnet 4.6, enabling private deployment. Relative to the earlier Sonnet 3.5 backend, these thinking models improve the same objectives by up to 7.5%, 3.1%, and 4.0%. Optional retrieval tools accelerate early convergence but do not improve final endpoints. By following natural language objectives to trade off certain metrics for others, ORFS-agent demonstrates a flexible and interpretable framework for multi-objective and constrained optimization. Crucially, ORFS-agent is modular and model-agnostic, and can be plugged into any frontier LLM without any further fine-tuning. We also report checkpoint-aligned trajectories and reasoning summaries that document the agent's decision process.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Placed in Software engineering coding agents, one of 16 directions in LLM agents and tool use. Builds on 37 of its 88 references that are in the map. First posted on arXiv 10 Jun 2025.

Builds on

37 of 88 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025JARVIS: A Multi-Agent Code Assistant for High-Quality EDA Script Generation20 May
  2. 2025Divergent Thoughts toward One Goal: LLM-based Multi-Agent Collaboration System for Electronic Design Automation15 Feb
  3. 2023ChatEDA: A Large Language Model Powered Autonomous Agent for EDA20 Aug

Other references · 34

  1. 2020Language Models are Few-Shot Learnerscited by 32,199
  2. 2022Training language models to follow instructions with human feedbackcited by 15,712
  3. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  4. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  5. 2021Evaluating Large Language Models Trained on Codecited by 8,053
  6. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  7. 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
  8. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  9. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,880
  10. 2018DARTS: Differentiable Architecture Searchcited by 1,782
  11. 2023Gorilla: Large Language Model Connected with Massive APIscited by 1,302
  12. 2024The AI Scientist: Towards Fully Automated Open-Ended Scientific Discoverycited by 1,002
22 more
  1. 2023Large Language Models as Optimizerscited by 830
  2. 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 803
  3. 2018Machine Learning for Combinatorial Optimization: a Methodological Tour d'Horizoncited by 612
  4. 2018BOHB: Robust and Efficient Hyperparameter Optimization at Scalecited by 466
  5. 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 379
  6. 2020Reinforcement Learning for Combinatorial Optimization: A Surveycited by 235
  7. 2023OpenAGI: When LLM Meets Domain Expertscited by 196
  8. 2023ChipNeMo: Domain-Adapted LLMs for Chip Designcited by 168
  9. 2020The Hardware Lotterycited by 160
  10. 2023OpenAgents: An Open Platform for Language Agents in the Wildcited by 136
  11. 2024Large Language Models to Enhance Bayesian Optimizationcited by 127
  12. 2017Multi-fidelity Bayesian Optimisation with Continuous Approximationscited by 120
  13. 2021A Neural Network Solves, Explains, and Generates University Math Problems by Program Synthesis and Few-Shot Learning at Human Levelcited by 96
  14. 2024Large Language Model Agent for Hyper-Parameter Optimizationcited by 62
  15. 2024Autonomous LLM-driven research from data to human-verifiable research paperscited by 50
  16. 2024ADO-LLM: Analog Design Bayesian Optimization with In-Context Learning of Large Language Modelscited by 44
  17. 2023LLM4EDA: Emerging Progress in Large Language Models for Electronic Design Automationcited by 40
  18. 2024Customized Retrieval Augmented Generation and Benchmarking for EDA Tool Documentation QAcited by 28
  19. 2024Ask-EDA: A Design Assistant Empowered by LLM, Hybrid RAG and Abbreviation De-hallucinationcited by 14
  20. 2023An Updated Assessment of Reinforcement Learning for Macro Placementcited by 11
  21. 2024Retrieval-Guided Reinforcement Learning for Boolean Circuit Minimizationcited by 10
  22. 2024ORAssistant: A Custom RAG-based Conversational Assistant for OpenROADcited by 4

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 3; 2026: 10.

13 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025HeaRT: A Hierarchical Circuit Reasoning Tree-Based Agentic Framework for AMS Design Optimization
  2. 2026Retrieve, Schedule, Reflect: LLM Agents for Chip QoR Optimization
  3. 2025Automated Design Optimization via Strategic Search with Large Language Models
  4. 2025EEsizer: LLM-Based AI Agent for Sizing of Analog and Mixed Signal Circuit
  5. 2026AutoSizer: Automatic Sizing of Analog and Mixed-Signal Circuits via Large Language Model (LLM) Agents
  6. 2026CODMAS: A Dialectic Multi-Agent Collaborative Framework for Structured RTL Optimization
  7. 2026RFChipAgent: Multi-Agentic AI Flow for Analog/RF Chip Design
  8. 2025Can Reasoning Models Reason about Hardware? An Agentic HLS Perspective