mlsanityData to 14 Oct 2026

Mutual Debiasing via Dual-Seed Comparison for Probabilistic Sampling in Large Language Models

arXiv 2608.26161 ↗First posted 10 Jul 2026cs.CL cs.AIcited by 0

On the map: LLM reasoning → Test-time compute and efficient thinking

Abstract (arXiv)

Although Large Language Models (LLMs) demonstrate remarkable capabilities in reasoning and decision-making, high-fidelity probabilistic sampling remains a persistent challenge. When generating random variables, LLMs consistently exhibit systematic biases that warp the target probability distributions. Current approaches often rely on a single, self-generated seed, which inherits model-specific biases. To overcome this vulnerability, we introduce Dual-Seed Comparison (DSC), a transparent, tool-free protocol that utilizes two independent LLM-generated seeds to neutralize bias. DSC compares the character-level ordinal values of the two seeds to construct a bit sequence, converts and normalizes this sequence into a pseudo-uniform variate, and then maps the variate to the target distribution through the inverse cumulative distribution function (CDF). Empirical results show that DSC substantially outperforms existing methods across 96% of evaluated settings. Beyond direct sampling, task-adapted variants based on the DSC comparison operator improve distributional control in MCQ generation and attribute-constrained text-to-image prompting.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Test-time compute and efficient thinking, one of 17 directions in LLM reasoning. Builds on 6 of its 25 references that are in the map. First posted on arXiv 10 Jul 2026.

Builds on

6 of 25 references.

References · 6

  1. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  2. 2022Solving Quantitative Reasoning Problems with Language Modelscited by 1,392
  3. 2023Large Language Models Sensitivity to The Order of Options in Multiple-Choice Questionscited by 263
  4. 2024Heads, Tails, and AI Fails: LLMs, Randomness, and Human Judgmentscited by 26
  5. 2025Enough Coin Flips Can Make LLMs Act Bayesiancited by 22
  6. 2025Evaluating the Quality of Randomness and Entropy in Tasks Supported by Large Language Modelscited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024A Probabilistic Perspective on Unlearning and Alignment for Large Language Models
  2. 2024Teacher-Student Training for Debiasing: General Permutation Debiasing for Large Language Models
  3. 2026Probabilistic Calibration Is a Trainable Capability in Language Models
  4. 2025BiasFilter: An Inference-Time Debiasing Framework for Large Language Models
  5. 2025Estimating the Error of Large Language Models at Pairwise Text Comparison
  6. 2026Controlling Distributional Bias in Multi-Round LLM Generation via KL-Optimized Fine-Tuning
  7. 2025Reasoning Under Uncertainty: Exploring Probabilistic Reasoning Capabilities of LLMs
  8. 2025Fisher Random Walk: Automatic Debiasing Contextual Preference Inference for Large Language Model Evaluation