FVDebug: An LLM-Driven Debugging Assistant for Automated Root Cause Analysis of Formal Verification Failures
Not on the map. Why?
Abstract (arXiv)
Debugging formal verification (FV) failures represents one of the most time-consuming bottlenecks in modern hardware design workflows. When properties fail, engineers must manually trace through complex counter-examples spanning multiple cycles, analyze waveforms, and cross-reference design specifications to identify root causes - a process that can consume hours or days per bug. Existing solutions are largely limited to manual waveform viewers or simple automated tools that cannot reason about the complex interplay between design intent and implementation logic. We present FVDebug, an intelligent system that automates root-cause analysis by combining multiple data sources - waveforms, RTL code, design specifications - to transform failure traces into actionable insights. Our approach features a novel pipeline: (1) Causal Graph Synthesis that structures failure traces into directed acyclic graphs, (2) Graph Scanner using batched Large Language Model (LLM) analysis with for-and-against prompting to identify suspicious nodes, and (3) Insight Rover leveraging agentic narrative exploration to generate high-level causal explanations. FVDebug further provides concrete RTL fixes through its Fix Generator. Evaluated on open benchmarks, FVDebug attains high hypothesis quality and strong Pass@k fix rates. We further report results on two proprietary, production-scale FV counterexamples. These results demonstrate FVDebug's applicability from academic benchmarks to industrial designs.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 18 of its 33 references that are in the map. First posted on arXiv 16 Sep 2025.
Builds on
18 of 33 references.
References · 18
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2023Teaching Large Language Models to Self-Debugcited by 988
- 2023LEVER: Learning to Verify Language-to-Code Generation with Executioncited by 239
- 2024MEIC: Re-thinking RTL Debug Automation using LLMscited by 25
- 2024LLM4SecHW: Leveraging Domain Specific Large Language Model for Hardware Debuggingcited by 18
- 2021AutoSVA: Democratizing Formal Verification of RTL Module Interactionscited by 12
- 2025VeriDebug: A Unified LLM for Verilog Debugging via Contrastive Embedding and Guided Correctioncited by 12
6 more
- 2025Saarthi: The First AI Formal Verification Engineercited by 8
- 2025Insights from Rights and Wrongs: A Large Language Model for Solving Assertion Failures in RTL Designcited by 6
- 2025SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Modelscited by 6
- 2025HLSDebugger: Identification and Correction of Logic Bugs in HLS Code with LLM Solutionscited by 5
- 2024Generative AI Augmented Induction-based Formal Verificationcited by 4
- 2025VCDiag: Classifying Erroneous Waveforms for Failure Triage Accelerationcited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 4.
5 papers.
- 2026QiMeng-CodeV-SVA: Training Specialized LLMs for Hardware Assertion Generation via RTL-Grounded Bidirectional Data Synthesiscited by 2
- 2025Learning to Debug: LLM-Organized Knowledge Trees for Solving RTL Assertion Failurescited by 1
- 2026WaveformQA: Benchmarking LLM Temporal Reasoning on Digital Waveformscited by 0
- 2026Can Agents Design Better Chips with a Higher Level Abstraction?cited by 0
- 2026A Survey on LLM-Integrated Hardware Design Verificationcited by 0
- 2026A Survey on LLM-Integrated Hardware Design Verification6 Oct 2026
- 2026Can Agents Design Better Chips with a Higher Level Abstraction?17 Sep 2026
- 2026WaveformQA: Benchmarking LLM Temporal Reasoning on Digital Waveforms22 Jul 2026
- 2026QiMeng-CodeV-SVA: Training Specialized LLMs for Hardware Assertion Generation via RTL-Grounded Bidirectional Data Synthesis15 Mar 2026
- 2025Learning to Debug: LLM-Organized Knowledge Trees for Solving RTL Assertion Failures21 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026LAUDE: LLM-Assisted Unit Test Generation and Debugging of Hardware DEsigns
- 2025Towards LLM-based Root Cause Analysis of Hardware Design Failures
- 2026VeriPilot: An LLM-Powered Verilog Debugging Framework
- 2026Open-Source LLM-Driven Formal Verification: A Multi-Agent Pipeline for RTL Repair
- 2025AssertCoder: LLM-Based Assertion Generation via Multimodal Specification Extraction
- 2025BugGen: A Self-Correcting Multi-Agent LLM Pipeline for Realistic RTL Bug Synthesis
- 2026Debug Like a Human: Scaling LLM-based Fault Localization to Processor Design via Block-Level Instruction-Oriented Slicing
- 2026DebugHarness: Emulating Human Dynamic Debugging for Autonomous Program Repair