mlsanityData to 7 Oct 2026

Wrong but Useful: Trajectory Value Beyond Answer Correctness in Multi-Agent Messages

arXiv 2608.14375 ↗First posted 14 Aug 2026cs.AI cs.CL cs.LGcited by 1

Not on the map. Why?

Abstract (arXiv)

Multi-agent reasoning systems often use agreement, confidence, or automated scores to decide which messages should shape a final answer. Such filtering assumes that a message likely to be correct is also worth keeping. Yet a wrong answer can contain a useful decomposition, constraint, or scientific principle. We test this distinction with Diverse Hypothesis Deliberation (DHD), a controlled measurement protocol that caches five independently generated messages and replays the same downstream solver, called the integrator, with each message available or hidden. The replay comparison measures a message's trajectory value: whether making the message available helps or harms subsequent reasoning. Across five mathematics and science benchmarks and two openly available model families, gpt-oss-120b and gemma-4-31B-it, wrong-helpful messages appear in every benchmark-model combination. Among wrong-answer messages that change final correctness, more than four in ten changes are helpful in each model. Controlled repeats show that the number of repeatable message effects is unlikely to arise from replay variation alone (p=0.0002). A focused intervention on repeatable wrong-helpful messages finds that the complete message works best, while retaining its reasoning preserves more success than retaining only its answer; the source of the complete-message advantage remains open. Within the same problem, repeated trajectory-value evidence also identifies a better keep-or-remove choice than answer correctness alone. Answer correctness is therefore informative but does not determine trajectory value. DHD measures this missing property and produces reusable labels for learning when agents should listen.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 19 of its 29 references that are in the map. First posted on arXiv 14 Aug 2026.

Builds on

19 of 29 references.

References · 19

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  2. 2023Let's Verify Step by Stepcited by 3,598
  3. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,317
  4. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  5. 2023Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human Annotationscited by 895
  6. 2022Solving math word problems with process- and outcome-based feedbackcited by 871
  7. 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 424
  8. 2024ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree Searchcited by 338
  9. 2023MedAgents: Large Language Models as Collaborators for Zero-shot Medical Reasoningcited by 311
  10. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMscited by 297
  11. 2023A Dynamic LLM-Powered Agent Network for Task-Oriented Agent Collaborationcited by 281
  12. 2023Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaborationcited by 246
7 more
  1. 2024LAB-Bench: Measuring Capabilities of Language Models for Biology Researchcited by 138
  2. 2023Can Large Language Models Really Improve by Self-critiquing Their Own Plans?cited by 107
  3. 2024CriticBench: Benchmarking LLMs for Critique-Correct Reasoningcited by 88
  4. 2024Learning From Failure: Integrating Negative Examples when Fine-tuning Large Language Models as Agentscited by 49
  5. 2025MARS: toward more efficient multi-agent collaboration for LLM reasoningcited by 13
  6. 2026Benchmarks Saturate When The Model Gets Smarter Than The Judgecited by 10
  7. 2026Exact Is Easier: Credit Assignment for Cooperative LLM Agentscited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.