ReSolve: Reusing Candidate Reasoning through Selective Generative Moderation
Not on the map. Why?
Abstract (arXiv)
Sampling multiple solutions spends computation on intermediate deductions and unfinished arguments as well as final answers. We introduce ReSolve, a training-free inference procedure that reuses this candidate reasoning through selective generative moderation. An answer-distribution controller invokes a model to examine existing derivations when candidates disagree or lack a parseable answer, then incorporates the generated solution into a bounded loop. Under Hybrid scoring on 130 competition-mathematics problems evaluated with two independently sampled candidate pools, ReSolve obtains 100 and 99 correct answers, compared with 91 and 92 for voting over the same four candidates, with no correct-to-incorrect changes relative to that vote in either pool. Eight-sample self-consistency obtains 94 and 96 correct answers while consuming substantially more tokens; ReSolve uses 46.3% and 47.2% fewer tokens in the two evaluations. A controlled ablation removes visible derivations while retaining answer keys, vote counts, and the per-state output-cap rule, reducing accuracy from 100 to 93 correct despite increasing computation. Selective and always-on Uniform moderation both solve 97 problems, while selectivity reduces moderation tokens by approximately 54% and total pipeline tokens by 6.2%. These results support candidate reasoning as reusable inference computation. They do not establish an accuracy advantage over additional sampling or a distinct benefit from specialized route instructions.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 18 references that are in the map. First posted on arXiv 1 Oct 2026.
Builds on
17 of 18 references.
References · 17
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2025Qwen3 Technical Reportcited by 8,820
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2023Let's Verify Step by Stepcited by 3,789
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,211
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,986
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,784
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 1,011
- 2023Graph of Thoughts: Solving Elaborate Problems with Large Language Modelscited by 886
- 2023LLM-Blender: Ensembling Large Language Models with Pairwise Ranking and Generative Fusioncited by 564
5 more
- 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 438
- 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 309
- 2023Universal Self-Consistency for Large Language Model Generationcited by 203
- 2023Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning and Coding with LLMscited by 115
- 2023Forward-Backward Reasoning in Large Language Models for Mathematical Verificationcited by 40
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Robust Reasoning via Dynamic Token Selection for Distribution-Aligned Self-Distillation
- 2026Self-Consistency via Marginal Sharpening
- 2025GenSelect: A Generative Approach to Best-of-N
- 2025Scaling Generative Verifiers For Natural Language Mathematical Proof Verification And Selection
- 2025Finding Answers in Thought Matters: Revisiting Evaluation on Large Language Models with Reasoning
- 2025Learning to Refine: Self-Refinement of Parallel Reasoning in LLMs
- 2026Beyond Answer Voting: Fine-Grained Correction of LLM Reasoning through Graph Alignment across Sampled Traces
- 2026VecCISC: Improving Confidence-Informed Self-Consistency with Reasoning Trace Clustering and Candidate Answer Selection