Self-Preference Is Weak or Absent in Verifiable Instruction-Following Revision: A Four-Model Test Under Genuine Authorship
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) increasingly review and revise text, including their own. A documented self-preference bias (models favoring their own generations when acting as judges) raises the question of whether models also resist valid corrections to their own writing. We test this in a setting where "valid" is decided not by another model but by a deterministic verifier: instruction-following revision on IFEval. A model writes a draft; the official IFEval checker confirms the draft violates a constraint and that a candidate edit fixes it; the model then accepts or rejects that edit either as the genuine in-context author or as a fresh model that sees the draft neutrally. Across four mid-tier model families and 85 author-versus-fresh comparisons, we find no detectable self-preference: authors reject verified-good fixes to their own drafts at essentially the same rate as fresh models judging the same drafts (gap -5.1 pp, 95% CI [-12.9, +2.7]). A self-skepticism hint from a smaller pilot did not replicate at scale. The one robust observation is qualitative: when authors do reject a verified-good fix, 97% of their stated reasons are flaw-catching rather than preference, that is, about the character of rejections, not an elevated rate. Effects smaller than ~13 pp cannot be excluded at this sample size.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 11 of its 11 references that are in the map. First posted on arXiv 18 Jun 2026.
Builds on
11 of 11 references.
References · 11
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Instruction-Following Evaluation for Large Language Modelscited by 1,228
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 1,017
- 2024LLM Evaluators Recognize and Favor Their Own Generationscited by 686
- 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 240
- 2024Pride and Prejudice: LLM Amplifies Self-Bias in Self-Refinementcited by 114
- 2025When Identity Skews Debate: Anonymization for Bias-Reduced Multi-Agent Reasoningcited by 21
- 2025Challenging the Evaluator: LLM Sycophancy Under User Rebuttalcited by 18
- 2025Feedback Friction: LLMs Struggle to Fully Incorporate External Feedbackcited by 11
- 2026Cross-Context Review: Improving LLM Output Quality by Separating Production and Review Sessionscited by 5
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Mitigating Self-Preference by Authorship Obfuscation
- 2025Do LLM Evaluators Prefer Themselves for a Reason?
- 2026When Does Intrinsic Self-Correction Help? A Task-Sensitive Analysis
- 2026How Robust Is Multimodal Claim Verification to LLM Rewriting?
- 2024Large Language Models have Intrinsic Self-Correction Ability
- 2024Confidence v.s. Critique: A Decomposition of Self-Correction Capability for LLMs
- 2026Language Models Are "Insecure" Reporters
- 2025Beyond Accuracy: The Role of Calibration in Self-Improving Large Language Models