More Rounds, More Noise: Why Multi-Turn Review Fails to Improve Cross-Context Verification
Not on the map. Why?
Abstract (arXiv)
Cross-Context Review (CCR) improves LLM verification by separating production and review into independent sessions. A natural extension is multi-turn review: letting the reviewer ask follow-up questions, receive author responses, and review again. We call this Dynamic Cross-Context Review (D-CCR). In a controlled experiment with 30 artifacts and 150 injected errors, we tested four D-CCR variants against the single-pass CCR baseline. Single-pass CCR (F1 = 0.376) significantly outperformed all multi-turn variants, including D-CCR-2b with question-and-answer exchange (F1 = 0.303, p < 0.001, d = -0.59). Multi-turn review increased recall (+0.08) but generated 62% more false positives (8.5 vs. 5.2), collapsing precision from 0.30 to 0.20. Two mechanisms drive this degradation: (1) false positive pressure -- reviewers in later rounds fabricate findings when the artifact's real errors have been exhausted, and (2) Review Target Drift -- reviewers provided with prior Q&A exchanges shift from reviewing the artifact to critiquing the conversation itself. Independent re-review without prior context (D-CCR-2c) performed worst (F1 = 0.263), confirming that mere repetition degrades rather than helps. The degradation stems from false positive pressure in additional rounds, not from information amount -- within multi-turn conditions, more information actually helps (D-CCR-2b > D-CCR-2a). The problem is not what the reviewer sees, but that reviewing again invites noise.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 11 of its 14 references that are in the map. First posted on arXiv 17 Mar 2026.
Builds on
11 of 14 references.
References · 11
- 2023Large Language Models Cannot Self-Correct Reasoning Yetcited by 965
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 751
- 2024When Can LLMs Actually Correct Their Own Mistakes? A Critical Survey of Self-Correction of LLMscited by 230
- 2023Should we be going MAD? A Look at Multi-Agent Debate Strategies for LLMscited by 103
- 2024Understanding the Dark Side of LLMs' Intrinsic Self-Correctioncited by 42
- 2024MAgICoRe: Multi-Agent, Iterative, Coarse-to-Fine Refinement for Reasoningcited by 40
- 2025Can LLM Agents Really Debate? A Controlled Study of Multi-Agent Debate in Logical Reasoningcited by 27
- 2024LLM-as-an-Interviewer: Beyond Static Testing Through Dynamic LLM Evaluationcited by 12
- 2025Temporal Consistency for LLM Reasoning Process Error Identificationcited by 10
- 2025SSR: Socratic Self-Refine for Large Language Model Reasoningcited by 6
- 2026Cross-Context Review: Improving LLM Output Quality by Separating Production and Review Sessionscited by 5
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026SlopCodeBench: Benchmarking How Coding Agents Degrade Over Long-Horizon Iterative Taskscited by 24
- 2026Cross-Context Verification: Hierarchical Detection of Benchmark Contamination through Session-Isolated Analysiscited by 2
- 2026When Does a Second Model Help? Cross-Model Review in LLM Verificationcited by 1
- 2026Refute-or-Promote: An Adversarial Stage-Gated Multi-Agent Review Methodology for High-Precision LLM-Assisted Defect Discoverycited by 0
- 2026When Does a Second Model Help? Cross-Model Review in LLM Verification1 Oct 2026
- 2026Refute-or-Promote: An Adversarial Stage-Gated Multi-Agent Review Methodology for High-Precision LLM-Assisted Defect Discovery21 Apr 2026
- 2026SlopCodeBench: Benchmarking How Coding Agents Degrade Over Long-Horizon Iterative Tasks25 Mar 2026
- 2026Cross-Context Verification: Hierarchical Detection of Benchmark Contamination through Session-Isolated Analysis23 Mar 2026