When Does Delegation Beat Majority? A Delegation-Based Aggregator for Multi-Sample LLM Inference
Not on the map. Why?
Abstract (arXiv)
Majority voting is the default unsupervised aggregator for multi-sample LLM inference, but it discards two signals: within-group answer entropy and between-group reasoning geometry. We aggregate by delegation instead (Propagational Proxy Voting, PPV): each group of samples keeps weight on its own answer in proportion to its entropy-based confidence (When) and routes the rest to peers by reasoning-embedding similarity (Whom); the stationary distribution of the resulting delegation matrix picks the consensus answer. This requires neither gold labels nor training. On MMLU-Pro with 128 samples per question, delegation beats majority by +1.5 pp overall and +2.24 pp on non-trivial questions (McNemar p ~ 1.0e-14, n = 8,099), overturning wrong majorities whose answer cluster is geometrically incoherent while the correct minority is tight. We then characterize exactly when delegation overturns majority: a two-option model gives a closed-form flip condition on each option's confidence and the weight it routes to the other, with a do-no-harm corollary for near-unanimous questions. The condition calls the realized winner on 96.5% of non-trivial questions, and its predicted mass gap tracks the realized gap at r = 0.97. We did not find any other unsupervised ensemble methods that close the oracle gap.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 38 of its 46 references that are in the map. First posted on arXiv 6 Jun 2026.
Builds on
38 of 46 references.
References · 38
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2023Let's Verify Step by Stepcited by 3,598
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,928
- 2022Language Models (Mostly) Know What They Knowcited by 1,783
- 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,758
- 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
- 2025s1: Simple test-time scalingcited by 1,311
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
26 more
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
- 2024Mixture-of-Agents Enhances Large Language Model Capabilitiescited by 420
- 2023Generating with Confidence: Uncertainty Quantification for Black-box Large Language Modelscited by 286
- 2024Debating with More Persuasive LLMs Leads to More Truthful Answerscited by 255
- 2024Semantic Entropy Probes: Robust and Cheap Hallucination Detection in LLMscited by 246
- 2023Universal Self-Consistency for Large Language Model Generationcited by 198
- 2024Kernel Language Entropy: Fine-grained Uncertainty Quantification for LLMs from Semantic Similaritiescited by 156
- 2023Let's Sample Step by Step: Adaptive-Consistency for Efficient Reasoning and Coding with LLMscited by 111
- 2024Reasoning Aware Self-Consistency: Leveraging Reasoning Paths for Efficient LLM Samplingcited by 63
- 2025Beyond Semantic Entropy: Boosting LLM Uncertainty Quantification with Pairwise Semantic Similaritycited by 26
- 2025Beyond Majority Voting: LLM Aggregation by Leveraging Higher-Order Informationcited by 25
- 2024Language Model Council: Democratically Benchmarking Foundation Models on Highly Subjective Taskscited by 17
- 2025Ranked Voting based Self-Consistency of Large Language Modelscited by 16
- 2025Certified Self-Consistency: Statistical Guarantees and Test-Time Training for Reliable Reasoning in LLMscited by 12
- 2025The Sequential Edge: Inverse-Entropy Voting Beats Parallel Self-Consistency at Matched Computecited by 11
- 2024Graph-based Confidence Calibration for Large Language Modelscited by 10
- 2018On Rational Delegations in Liquid Democracycited by 9
- 2026Know When You're Wrong: Aligning Confidence with Correctness for LLM Error Detectioncited by 8
- 2017Binary Voting with Delegable Proxy: An Analysis of Liquid Democracycited by 7
- 2026From Debate to Decision: Conformal Social Choice for Safe Multi-Agent Deliberationcited by 6
- 2021Liquid Democracy with Ranked Delegationscited by 5
- 2022Generalizing Liquid Democracy to multi-agent delegation: A Voting Weight Measure and Equilibrium Analysiscited by 2
- 2024Controlling Delegations in Liquid Democracycited by 2
- 2025A statistically consistent measure of semantic uncertainty using Language Modelscited by 1
- 2025The Cost Perspective of Liquid Democracy: Feasibility and Controlcited by 1
- 2025Propagational Proxy Votingcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.