Mutual Debiasing via Dual-Seed Comparison for Probabilistic Sampling in Large Language Models
On the map: LLM reasoning → Test-time compute and efficient thinking
Abstract (arXiv)
Although Large Language Models (LLMs) demonstrate remarkable capabilities in reasoning and decision-making, high-fidelity probabilistic sampling remains a persistent challenge. When generating random variables, LLMs consistently exhibit systematic biases that warp the target probability distributions. Current approaches often rely on a single, self-generated seed, which inherits model-specific biases. To overcome this vulnerability, we introduce Dual-Seed Comparison (DSC), a transparent, tool-free protocol that utilizes two independent LLM-generated seeds to neutralize bias. DSC compares the character-level ordinal values of the two seeds to construct a bit sequence, converts and normalizes this sequence into a pseudo-uniform variate, and then maps the variate to the target distribution through the inverse cumulative distribution function (CDF). Empirical results show that DSC substantially outperforms existing methods across 96% of evaluated settings. Beyond direct sampling, task-adapted variants based on the DSC comparison operator improve distributional control in MCQ generation and attribute-constrained text-to-image prompting.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 6 of its 25 references that are in the map. First posted on arXiv 10 Jul 2026.
Builds on
6 of 25 references.
References · 6
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,392
- 2023Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questionscited by 263
- 2024Heads, Tails, and AI Fails: LLMs, Randomness, and Human Judgmentscited by 26
- 2025Enough Coin Flips Can Make LLMs Act Bayesiancited by 22
- 2025Evaluating the Quality of Randomness and Entropy in Tasks Supported by Large Language Modelscited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024A Probabilistic Perspective on Unlearning and Alignment for Large Language Models
- 2024Teacher-Student Training for Debiasing: General Permutation Debiasing for Large Language Models
- 2026Probabilistic Calibration Is a Trainable Capability in Language Models
- 2025BiasFilter: An Inference-Time Debiasing Framework for Large Language Models
- 2025Estimating the Error of Large Language Models at Pairwise Text Comparison
- 2026Controlling Distributional Bias in Multi-Round LLM Generation via KL-Optimized Fine-Tuning
- 2025Reasoning Under Uncertainty: Exploring Probabilistic Reasoning Capabilities of LLMs
- 2025Fisher Random Walk: Automatic Debiasing Contextual Preference Inference for Large Language Model Evaluation