mlsanityData to 14 Oct 2026

Cycle-Consistent Neural Explanation of Formal Verification Certificates

arXiv 2606.24414 ↗First posted 23 Jun 2026cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

Formal verification produces machine-checkable certificates that attest to the satisfaction or violation of temporal properties, yet these certificates remain opaque to non-specialist stakeholders. We propose a cycle-consistent neural architecture that generates faithful natural language explanations of verification certificates. A forward network NN1 maps certificates to explanations, and an inverse network NN2 reconstructs certificates from explanations; a symbolic verifier closes the loop, providing a differentiable faithfulness proxy. A pointer-generator mechanism ensures lexical grounding by copying state names directly from the certificate. We evaluate on 420 test certificates spanning six verification methods (bounded proof, k-induction, inductive invariant, lasso, reachability, witness pair) in both YES and NO verdict variants, drawn from a financial compliance domain with 207 named states. Our trained architecture, combined with a hybrid inference-time routing strategy, achieves 90.0% cycle-verified soundness, surpassing a multi- LLM few-shot baseline (76.1% for the best of 16 LLM combinations across four frontier models) by 13.9 percentage points. The neural model wins on 10 of 12 verdict/kind categories, with three categories reaching 100% soundness. The architecture offers 860x faster inference (185 ms vs. 160 s per certificate for the full multi-LLM baseline), offline operation, deterministic outputs, and zero per-inference cost. These results demonstrate that trained specialization outperforms general-purpose LLM prompting for structured certificate explanation, while eliminating the deployment constraints of cloud-based inference.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 82 references that are in the map. First posted on arXiv 23 Jun 2026.

Builds on

40 of 82 references.

References · 40

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  3. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  6. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  7. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  8. 2017Get To The Point: Summarization with Pointer-Generator Networkscited by 1,292
  9. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 991
  10. 2015Improving Neural Machine Translation Models with Monolingual Datacited by 788
  11. 2019Evaluating the Factual Consistency of Abstractive Text Summarizationcited by 584
  12. 2017Safe Reinforcement Learning via Shieldingcited by 449
28 more
  1. 2020Asking and Answering Questions to Evaluate the Factual Consistency of Summariescited by 378
  2. 2020FEQA: A Question Answering Evaluation Framework for Faithfulness Assessment in Abstractive Summarizationcited by 293
  3. 2017Unsupervised Machine Translation Using Monolingual Corpora Onlycited by 273
  4. 2020ToTTo: A Controlled Table-To-Text Generation Datasetcited by 268
  5. 2022Autoformalization with Large Language Modelscited by 263
  6. 2017Beam Search Strategies for Neural Machine Translationcited by 232
  7. 2022Synchromesh: Reliable code generation from pre-trained language modelscited by 156
  8. 2025ShieldAgent: Shielding Agents via Verifiable Safety Policy Reasoningcited by 151
  9. 2017Data Augmentation for Low-Resource Neural Machine Translationcited by 139
  10. 2018Style Transfer Through Back-Translationcited by 124
  11. 2020Logical Natural Language Generation from Open-Domain Tablescited by 90
  12. 2021Improving Coherence and Consistency in Neural Sequence Models with Dual-System, Neuro-Symbolic Reasoningcited by 85
  13. 2016Pointing the Unknown Wordscited by 43
  14. 2015Shield Synthesis: Runtime Enforcement for Reactive Systemscited by 42
  15. 2023Formally Explaining Neural Networks within Reactive Systemscited by 24
  16. 2024Verification-Guided Shielding for Deep Reinforcement Learningcited by 13
  17. 2023CBMC: The C Bounded Model Checkercited by 12
  18. 2024Shield Synthesis for LTL Modulo Theoriescited by 12
  19. 2023Boolean Abstractions for Realizability Modulo Theories (Extended version)cited by 9
  20. 2017Validity-Guided Synthesis of Reactive Systems from Assume-Guarantee Contractscited by 6
  21. 2024Neural Model Checkingcited by 6
  22. 2021GenSys: A Scalable Fixed-point Engine for Maximal Controller Synthesis over Infinite State Spacescited by 4
  23. 2023Full LTL Synthesis over Infinite-state Arenascited by 3
  24. 2024On Learning Action Costs from Input Planscited by 3
  25. 2013IC3 Modulo Theories via Implicit Predicate Abstractioncited by 2
  26. 2025Issy: A Comprehensive Tool for Specification and Synthesis of Infinite-State Reactive Systemscited by 2
  27. 2026Shields to Guarantee Probabilistic Safety in MDPscited by 2
  28. 2025Explanations for Unrealizability of Infinite-State Safety Shieldscited by 1

Built on by

Not cited yet.