mlsanityData to 14 Oct 2026

When Verifiers Vote Backwards under Verdict Substitution: Signed Pivotal Value in Correlated Self-Consistency

arXiv 2609.26144 ↗First posted 8 Aug 2026cs.AIcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Replacing one ballot can change a majority decision only on queries decided by a single vote; this structural fact requires no independence assumption. We study the sign of that change using a labeled, verdict-style intervention: one correctness signal replaces one correctness-indicator ballot in k=7 self-consistency panels. This diagnostic intervention is not identical to deployed answer-identity plurality. A primary MATH-500 experiment (n=570) gives a different-model verifier a +24.2pp pivotal gain, whereas a role-reversed configuration gives -11.2pp; an exploratory code stress test (14 pivotal rows across 9 tasks) gives -24.5pp. An exact signed-gain decomposition accounts for all observed signs through the verifier's state-specific accuracy and the composition of the two one-vote tally states, rather than global accuracy or model provenance. Same-source signals lose accuracy on the pivotal stratum (65→44% in the primary configuration), while error correlations provide a descriptive error-association diagnostic. Controlled degradation and a k∈3,5,7 subset sensitivity analysis probe the stability of the observed pattern around this accounting. Under the evaluated ties-incorrect answer-identity plurality analysis, the structural zero and strong-verifier benefit persist, but the role-reversed harm attenuates to -0.9pp and is not significant. The results therefore establish harmful verdict substitution, not universally harmful deployed plurality, and motivate a testable but unverified hypothesis for negative process-reward-model weights.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 0 of its 12 references that are in the map. First posted on arXiv 8 Aug 2026.

Builds on

0 of 12 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Reliable Chain-of-Thought via Prefix Consistency
  2. 2024Mirror-Consistency: Harnessing Inconsistency in Majority Voting
  3. 2026From Discovery to Decision: Finite-Budget Recoverability in LLM Voting
  4. 2026When Self-Consistency Backfires: Majority Vote Hurts the Majority of Hard Science Problems for Small LLMs
  5. 2026Wrong Votes, Right Gradients: Why Majority-Vote Rewards Track Verifiable RL
  6. 2026Diagnosing Correctness Probes under Self-Judgement Confounding
  7. 2026LLMs as a Jury: Cross-Model Consensus Can Outperform Process Reward Models for LLM Reasoning
  8. 2026VecCISC: Improving Confidence-Informed Self-Consistency with Reasoning Trace Clustering and Candidate Answer Selection