VeriTrans: Fine-Tuned LLM-Assisted NL-to-PL Translation via a Deterministic Neuro-Symbolic Pipeline
Not on the map. Why?
Abstract (arXiv)
VeriTrans is a reliability-first ML system that compiles natural-language requirements into solver-ready logic with validator-gated reliability. The pipeline integrates an instruction-tuned NL!→!PL translator, round-trip reconstruction (PL!→!NL) used as a high-precision acceptance gate, and canonical PL!→!CNF compilation, all executed via fixed API configuration (temperature=0; fine-tuning runs use seed=42) and per-item artifact logging (prompts, outputs, hashes) to support auditability and replay-driven debugging. On SatBench (2,100 specifications), VeriTrans achieves 94.46% SAT/UNSAT correctness and 87.73% median round-trip similarity. Compact fine-tuning on 100--150 curated examples improves fidelity by about 1--1.5,pp without increasing latency (mean 25.8,s/spec on our 201-spec runtime subset). A thresholded acceptance policy on the round-trip score exposes a reliability--coverage knob: at τ=75, roughly 68% of items are retained with ~94% correctness on the accepted set. Validator overhead contributes <15% of end-to-end runtime, and all prompts/responses and timing metadata are logged to enable replay-driven debugging and regression testing. By separating learned translation from symbolic verification and enforcing deterministic, validator-gated acceptance, VeriTrans turns NL!→!logic front-ends into auditable, reproducible components for reliability-critical workflows.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 15 of its 29 references that are in the map. First posted on arXiv 11 Apr 2026.
Builds on
15 of 29 references.
References · 15
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2023Logic-LM: Empowering Large Language Models with Symbolic Solvers for Faithful Logical Reasoningcited by 379
- 2022FOLIO: Natural Language Reasoning with First-Order Logiccited by 233
- 2023SatLM: Satisfiability-Aided Language Models Using Declarative Promptingcited by 100
- 2024Faithful Logical Reasoning via Symbolic Chain-of-Thoughtcited by 99
- 2023Harnessing the Power of Large Language Models for Natural Language to First-Order Logic Translationcited by 59
- 2024Large Language Models Can Solve Real-World Planning Rigorously with Formal Verification Toolscited by 47
- 2025SATBench: Benchmarking LLMs' Logical Reasoning via Automated Puzzle Generation from SAT Formulascited by 30
- 2025Learning to Reason via Mixture-of-Thought for Logical Reasoningcited by 20
- 2024A Closer Look at Logical Reasoning with LLMs: The Choice of Tool Matterscited by 8
- 2025Verifiable Natural Language to Linear Temporal Logic Translation: A Benchmark Dataset and Evaluation Suitecited by 4
3 more
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026Provably Secure Agent Guardrailcited by 0
- 2026Provably Secure Agent Guardrail28 May 2026