Natural Synthesis: Outperforming Reactive Synthesis Tools with Large Reasoning Models
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
Reactive synthesis, the problem of automatically constructing a hardware circuit from a logical specification, is a long-standing challenge in formal verification. It is elusive for two reasons: It is algorithmically hard, and writing formal specifications by hand is notoriously difficult. In this paper, we tackle both sides of the problem. For the algorithmic side, we present a neuro-symbolic approach to reactive synthesis that couples large reasoning models with model checkers to iteratively repair a synthesized Verilog implementation via sound symbolic feedback. Our approach solves more benchmarks than the best dedicated tools in the annual synthesis competition and extends to constructing parameterized systems, a problem known to be undecidable. On the specification side, we introduce an autoformalization step that shifts the specification task from temporal logic to natural language by introducing a hand-authored dataset of natural-language specifications for evaluation. We demonstrate performance comparable to that of starting from formal specifications, establishing natural synthesis as a viable end-to-end workflow.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 25 of its 55 references that are in the map. First posted on arXiv 14 May 2026.
Builds on
25 of 55 references.
References · 25
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 291
- 2022Autoformalization with Large Language Modelscited by 263
- 2023VeriGen: A Large Language Model for Verilog Code Generationcited by 200
- 2023nl2spec: Interactively Translating Unstructured Natural Language to Temporal Logics with Large Language Modelscited by 60
- 2023NL2TL: Transforming Natural Languages to Temporal Logics using Large Language Modelscited by 59
- 2023Grounding Complex Natural Language Commands for Temporal Tasks in Unseen Environmentscited by 53
- 2025QiMeng-CodeV-R1: Reasoning-Enhanced Verilog Generationcited by 35
- 2024Autoformalizing Euclidean Geometrycited by 27
- 2022From Spot 2.0 to Spot 2.10: What's New?cited by 22
- 2025ProofBridge: Auto-Formalization of Natural Language Proofs in Lean via Joint Embeddingscited by 18
- 2021Neural Circuit Synthesis from Specification Patternscited by 17
- 2025DeepGate4: Efficient and Effective Representation Learning for Circuit Design at Scalecited by 12
13 more
- 2024Retrieval-Guided Reinforcement Learning for Boolean Circuit Minimizationcited by 10
- 2021Fuzzing Hardware Like Softwarecited by 9
- 2023Iterative Circuit Repair Against Formal Specificationscited by 9
- 2025VerifyThisBench: Generating Code, Specifications, and Proofs All at Oncecited by 9
- 2018BoSy: An Experimentation Framework for Bounded Synthesiscited by 8
- 2022The Reactive Synthesis Competition (SYNTCOMP): 2018-2021cited by 8
- 2024Guiding LLM Temporal Logic Generation with Explicit Separation of Data and Controlcited by 8
- 2025Grammar-Forced Translation of Natural Language to Temporal Logic using LLMscited by 8
- 2024Neural Model Checkingcited by 6
- 2025SemML: Enhancing Automata-Theoretic LTL Synthesis with Machine Learningcited by 6
- 2024NeuroSynt: A Neuro-symbolic Portfolio Solver for Reactive Synthesiscited by 3
- 2014Parameterized Synthesiscited by 2
- 2023The Temporal Logic Synthesis Format TLSF v1.2cited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Pushing the Boundaries of Natural Reasoning: Interleaved Bonus from Formal-Logic Verification
- 2025Current Practices for Building LLM-Powered Reasoning Tools Are Ad Hoc -- and We Can Do Better
- 2026Neuro-Symbolic Software Verification: Hyper-charging Local Language Models with Symbolic Reasoning at Scale
- 2026Neuro-Formal Verification: Agentic Language-Agnostic Formal Program Reasoning
- 2026ReaComp: Compiling LLM Reasoning into Symbolic Solvers for Efficient Program Synthesis
- 2026NeuroNL2LTL: A Neurosymbolic Framework for Natural Language Translation of Linear Temporal Logic
- 2025VeriMind: Agentic LLM for Automated Verilog Generation with a Novel Evaluation Metric
- 2026Neuro-Symbolic Proof Generation for Scaling Systems Software Verification