Reasoning without Gold Standards: A Proxy-Judge Theory of Autoformalization
Not on the map. Why?
Abstract (arXiv)
Complex reasoning tasks increasingly require systems to produce outputs whose correctness cannot be judged by exact match against a single reference. Autoformalization (AF) is a representative example; it asks a model to translate informal mathematical or logical reasoning into a formally checkable object, yet expert-validated formalizations do not scale beyond toy cases and a single informal argument can admit many valid formal renderings. Progress therefore depends on whether partial, structured proxies can substitute for exact references. We introduce a reference-free proxy-judge framework for AF that replaces gold-standard matching with a vector of per-axis property checks. The framework organizes the proxy along three structural scopes that cover global properties of the elicited object, per-module properties internal to its sub-components, and cross-domain properties that re-align it to the informal source, and aggregates each axis into a verdict vector. The vector drives a reflective refinement loop in which a violated coordinate routes the controller to a matching repair target, so each iteration changes only what is judged wrong. Under bounded judge noise, the expected intrinsic gap contracts geometrically to a noise-dependent plateau. Across seven formalization backbones on miniF2F, ProofNet, e-SNLI, and ProntoQA, refinement consistently lifts Pass Rate over the single-shot ICL baseline, and the per-axis proxy outperforms a matched scalar proxy on benchmarks where the baseline has room to improve. Structured proxy judgments therefore provide both a practical refinement signal and a theoretical handle on convergence when exact references are unavailable.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 8 Jun 2026.
Builds on
20 of 28 references.
References · 20
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2016Optimization Methods for Large-Scale Machine Learningcited by 1,140
- 2022Solving math word problems with process- and outcome-based feedbackcited by 871
- 2018e-SNLI: Natural Language Inference with Natural Language Explanationscited by 468
- 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
- 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
- 2020Generative Language Modeling for Automated Theorem Provingcited by 379
8 more
- 2022Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thoughtcited by 334
- 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
- 2022Autoformalization with Large Language Modelscited by 252
- 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
- 2021Do Natural Language Explanations Represent Valid Logical Arguments? Verifying Entailment in Explainable NLI Gold Standardscited by 12
- 2025Faithful and Robust LLM-Driven Theorem Proving for NLI Explanationscited by 8
- 2025Beyond Gold Standards: Epistemic Ensemble of LLM Judges for Formal Mathematical Reasoningcited by 6
- 2025The 4/δ Bound: Designing Predictable LLM-Verifier Systems for Formal Method Guaranteecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SHADOWBENCH: Toward Reliable Automatic Evaluation of Semantic Alignment in Autoformalization
- 2026VeryTrace: Verifying Reasoning Traces through Compilable Formalism and Structured Verification
- 2025ReflCtrl: Controlling LLM Reflection Efficiently via Representation Engineering
- 2025ReForm: Reflective Autoformalization with Prospective Bounded Sequence Optimization
- 2026A2RBench: An Automatic Paradigm for Formally Verifiable Abstract Reasoning Benchmark Generation
- 2026Think Through a Bottleneck: Hourglass Reasoning for Rigorous Induction
- 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalization
- 2026REIN: Bridging the Gap between Reasoning and Reliability via Reflection and Abstention Alignment