CHOIR: Collaborative Harmonization fOr Inference Robustness
Not on the map. Why?
Abstract (arXiv)
Persona-assigned Large Language Models (LLMs) can adopt diverse roles, enabling personalized and context-aware reasoning. However, even minor demographic perturbations in personas, such as simple pronoun changes, can alter reasoning trajectories, leading to divergent sets of correct answers. Instead of treating these variations as biases to be mitigated, we explore their potential as a constructive resource to improve reasoning robustness. We propose CHOIR (Collaborative Harmonization fOr Inference Robustness), a test-time framework that harmonizes multiple persona-conditioned reasoning signals into a unified prediction. CHOIR orchestrates a collaborative decoding process among counterfactual personas, dynamically balancing agreement and divergence in their reasoning paths. Experiments on various reasoning benchmarks demonstrate that CHOIR consistently enhances performance across demographics, model architectures, scales, and tasks - without additional training. Improvements reach up to 26.4% for individual demographic groups and 19.2% on average across five demographics. It remains effective even when base personas are suboptimal. By reframing persona variation as a constructive signal, CHOIR provides a scalable and generalizable approach to more reliable LLM reasoning.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 25 references that are in the map. First posted on arXiv 26 Oct 2025.
Builds on
14 of 25 references.
References · 14
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,374
- 2018CommonsenseQA: A Question Answering Challenge Targeting Commonsense Knowledgecited by 1,822
- 2016Solving General Arithmetic Word Problemscited by 360
- 2023A Survey of Confidence Estimation and Calibration in Large Language Modelscited by 256
- 2023Better Zero-Shot Reasoning with Role-Play Promptingcited by 223
- 2024Two Tales of Persona in LLMs: A Survey of Role-Playing and Personalizationcited by 208
- 2023Bias Runs Deep: Implicit Reasoning Biases in Persona-Assigned LLMscited by 199
- 2022Successive Prompting for Decomposing Complex Questionscited by 94
- 2024Confidence Under the Hood: An Investigation into the Confidence-Probability Alignment in Large Language Modelscited by 34
- 2024Persona is a Double-edged Sword: Mitigating the Negative Impact of Role-playing Prompts in Zero-shot Reasoning Taskscited by 28
- 2025Unmasking Implicit Bias: Evaluating Persona-Prompted LLM Responses in Power-Disparate Social Scenarioscited by 26
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Multi-Persona Thinking for Bias Mitigation in Large Language Models
- 2024PERSONA: A Reproducible Testbed for Pluralistic Alignment
- 2025Persona-judge: Personalized Alignment of Large Language Models via Token-level Self-judgment
- 2025Dissecting Persona-Driven Reasoning in Language Models via Activation Patching
- 2026Persona Prompting as a Lens on LLM Social Reasoning
- 2023Aligning Large Language Models with Human Opinions through Persona Selection and Value--Belief--Norm Reasoning
- 2026Do LLMs Experience an Internal Polylogue? Investigating Reasoning through the Lens of Personas
- 2026Toward Robust Personalized Alignment for LLMs: Mitigating Persona Drift in Multi-Turn Dialogue