mlsanityData to 13 Oct 2026

Correction and Corruption: A Two-Rate View of Error Flow in LLM Protocols

arXiv 2604.18245 ↗First posted 20 Apr 2026cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models operate in protocols containing multiple calls, yet added calls are usually evaluated only by their net effect. That summary cannot distinguish correcting unsuccessful outputs from corrupting initially successful ones. We develop a paired audit recording success before and after a specified operation on the same tasks under one binary rule. Correction and corruption rates exactly account for the net change: gains come from corrected failures and losses from corrupted successes. The break-even correction requirement rises sharply with baseline success, so the same behavior can improve a moderate-baseline population but harm a high-baseline one. Applied to published GPT-4 GSM8K results, the framework bounds within-sample correction and corruption counts from aggregate accuracies. We ask if calibration estimates predict unobserved outcomes, how rates change with information supplied to an operation, and whether successive measurements combine. Calibration estimates track accuracy on a disjoint sample from the same generator. Under reweighting of generator-defined groups, pooled estimates can fail while group-specific estimates reduce average prediction error. On GSM8K, observable features capture limited variation at these sample sizes, so the group-level application rule remains exploratory. Reordering a fixed four-candidate set changes both rates, with the accuracy effect depending on whether a correct alternative is available; on MBPP, adding a helper artifact raises corruptions among 357 initially passing programs from 28 to 100. Direct and composed transition estimates are close on average within samples; weighting initial-success rows by support substantially reduces held-out discrepancy. Correction and corruption are measurements of specified operations, not model constants, and can guide input choices, application decisions, and composition tests.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Builds on 24 of its 29 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

24 of 29 references.

References · 24

  1. 2023GPT-4 Technical Reportcited by 18,278
  2. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
  3. 2021Training Verifiers to Solve Math Word Problemscited by 9,916
  4. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,502
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,492
  6. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
  7. 2024GPT-4o System Cardcited by 4,536
  8. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,156
  9. 2023Let's Verify Step by Stepcited by 3,672
  10. 2021Program Synthesis with Large Language Modelscited by 3,573
  11. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,367
  12. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,181
12 more
  1. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,011
  2. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,758
  3. 2023Large Language Models are not Fair Evaluatorscited by 1,054
  4. 2022Red Teaming Language Models with Language Modelscited by 1,014
  5. 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 983
  6. 2017Selective Classification for Deep Neural Networkscited by 825
  7. 2023Faith and Fate: Limits of Transformers on Compositionalitycited by 498
  8. 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 233
  9. 2022Language Model Cascadescited by 105
  10. 2024Confidence v.s. Critique: A Decomposition of Self-Correction Capability for LLMscited by 28
  11. 2025Solving a Million-Step LLM Task with Zero Errorscited by 19
  12. 2025A Probabilistic Inference Scaling Theory for LLM Self-Correctioncited by 9

Built on by

Not cited yet.