Asking LLMs to Verify First is Almost Free Lunch
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
To enhance the reasoning capabilities of Large Language Models (LLMs) without high costs of training, nor extensive test-time sampling, we introduce Verification-First (VF), a strategy that prompts models to verify a provided candidate answer, even a trivial or random one, before generating a solution. This approach triggers a "reverse reasoning" process complementary to standard forward Chain-of-Thought (CoT), which restricts the logical search space of the answer by pruning the LLM's output distribution. We further generalize VF prompting to Iter-VF, a sequential test-time scaling (TTS) method that iteratively cycles the verification-generation process using the model's previous answer. Extensive experiments across various benchmarks and various LLMs confirm that VF prompting with random answer consistently outperforms standard CoT with minimal computational overhead, and Iter-VF outperforms existing TTS strategies. VF is also effective on SOTA thinking models. For example, by using the simple VF prompting, we obtain a new SOTA 94.9% accuracy on GPQA-Diamond with Gemini-3-Pro-Preview where VF reduces its errors by ~30% relatively.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 11 of its 20 references that are in the map. First posted on arXiv 21 Nov 2025.
Builds on
11 of 20 references.
Closest ancestors · 5
Same direction, newest first
- 2025Test-Time Scaling in Reasoning Models Is Not Effective for Knowledge-Intensive Tasks Yet8 Sep
- 2025Scaling Test-Time Compute Without Verification or RL is Suboptimal17 Feb
- 2025s1: Simple test-time scaling31 Jan
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters6 Aug
- 2023Large Language Models Cannot Self-Correct Reasoning Yet3 Oct
Other references · 6
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,371
- 2023Let's Verify Step by Stepcited by 3,789
- 2021Program Synthesis with Large Language Modelscited by 3,637
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
- 2025No Need for Explanations: LLMs can implicitly learn from mistakes in-contextcited by 13
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2022Large Language Models are Better Reasoners with Self-Verification
- 2024General Purpose Verification for Chain of Thought Prompting
- 2025Prompting Test-Time Scaling Is A Strong LLM Reasoning Data Augmentation
- 2025Incentivizing LLMs to Self-Verify Their Answers
- 2025Sample Smart, Not Hard: Correctness-First Decoding for Better Reasoning in LLMs
- 2024Improving LLM Reasoning through Scaling Inference Computation with Collaborative Verification
- 2025SATQuest: A Verifier for Logical Reasoning Evaluation and Reinforcement Fine-Tuning of LLMs
- 2025Reasoning on a Budget: A Survey of Adaptive and Controllable Test-Time Compute in LLMs