mlsanityData to 7 Oct 2026

Reasoning without Gold Standards: A Proxy-Judge Theory of Autoformalization

arXiv 2606.09449 ↗First posted 8 Jun 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Complex reasoning tasks increasingly require systems to produce outputs whose correctness cannot be judged by exact match against a single reference. Autoformalization (AF) is a representative example; it asks a model to translate informal mathematical or logical reasoning into a formally checkable object, yet expert-validated formalizations do not scale beyond toy cases and a single informal argument can admit many valid formal renderings. Progress therefore depends on whether partial, structured proxies can substitute for exact references. We introduce a reference-free proxy-judge framework for AF that replaces gold-standard matching with a vector of per-axis property checks. The framework organizes the proxy along three structural scopes that cover global properties of the elicited object, per-module properties internal to its sub-components, and cross-domain properties that re-align it to the informal source, and aggregates each axis into a verdict vector. The vector drives a reflective refinement loop in which a violated coordinate routes the controller to a matching repair target, so each iteration changes only what is judged wrong. Under bounded judge noise, the expected intrinsic gap contracts geometrically to a noise-dependent plateau. Across seven formalization backbones on miniF2F, ProofNet, e-SNLI, and ProntoQA, refinement consistently lifts Pass Rate over the single-shot ICL baseline, and the per-axis proxy outperforms a matched scalar proxy on benchmarks where the baseline has room to improve. Structured proxy judgments therefore provide both a practical refinement signal and a theoretical handle on convergence when exact references are unavailable.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 20 of its 28 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

20 of 28 references.

References · 20

  1. 2022Training language models to follow instructions with human feedbackcited by 15,712
  2. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2023Let's Verify Step by Stepcited by 3,598
  5. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  6. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
  7. 2016Optimization Methods for Large-Scale Machine Learningcited by 1,140
  8. 2022Solving math word problems with process- and outcome-based feedbackcited by 871
  9. 2018e-SNLI: Natural Language Inference with Natural Language Explanationscited by 468
  10. 2023LeanDojo: Theorem Proving with Retrieval-Augmented Language Modelscited by 414
  11. 2021MiniF2F: a cross-system benchmark for formal Olympiad-level mathematicscited by 380
  12. 2020Generative Language Modeling for Automated Theorem Provingcited by 379
8 more
  1. 2022Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thoughtcited by 334
  2. 2022Draft, Sketch, and Prove: Guiding Formal Theorem Provers with Informal Proofscited by 278
  3. 2022Autoformalization with Large Language Modelscited by 252
  4. 2023ProofNet: Autoformalizing and Formally Proving Undergraduate-Level Mathematicscited by 180
  5. 2021Do Natural Language Explanations Represent Valid Logical Arguments? Verifying Entailment in Explainable NLI Gold Standardscited by 12
  6. 2025Faithful and Robust LLM-Driven Theorem Proving for NLI Explanationscited by 8
  7. 2025Beyond Gold Standards: Epistemic Ensemble of LLM Judges for Formal Mathematical Reasoningcited by 6
  8. 2025The 4/δ Bound: Designing Predictable LLM-Verifier Systems for Formal Method Guaranteecited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SHADOWBENCH: Toward Reliable Automatic Evaluation of Semantic Alignment in Autoformalization
  2. 2026VeryTrace: Verifying Reasoning Traces through Compilable Formalism and Structured Verification
  3. 2025ReflCtrl: Controlling LLM Reflection Efficiently via Representation Engineering
  4. 2025ReForm: Reflective Autoformalization with Prospective Bounded Sequence Optimization
  5. 2026A2RBench: An Automatic Paradigm for Formally Verifiable Abstract Reasoning Benchmark Generation
  6. 2026Think Through a Bottleneck: Hourglass Reasoning for Rigorous Induction
  7. 2026Efficient Test-Time Optimization for Multi-Agent Proof Autoformalization
  8. 2026REIN: Bridging the Gap between Reasoning and Reliability via Reflection and Abstention Alignment