mlsanityData to 7 Oct 2026

Diverse Evidence, Better Forecasts: Multi-Agent Deliberation Under Information Asymmetry

arXiv 2607.01661 ↗First posted 2 Jul 2026cs.AIcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Multi-agent systems are increasingly used for forecasting future events, as deliberation among multiple LLMs is believed to improve reasoning and calibration. Yet existing approaches overlook a critical design choice: what information each agent receives. When all agents are given identical evidence, deliberation collapses into herding rather than genuine belief revision, leaving multi-agent systems little better than a single agent. We identify this as a fundamental gap and propose designed information asymmetry to close it: by partitioning evidence into shared public and disjoint private subsets, each agent holds exclusive knowledge that can only reach others through deliberation. We theoretically show that this decomposition reduces inter-agent error correlation, and instantiate it in InfoDelphi, a framework combining relevance-aware evidence routing, rationale-based iterative deliberation, and confidence-weighted aggregation. On PolyGym, a benchmark of 375 binary forecasting questions derived from real-world prediction markets, InfoDelphi outperforms the strongest single-agent and multi-agent baselines by 12--18% in Brier score and 4--8 percentage points in accuracy. More detailed experiments confirm that removing information asymmetry eliminates most deliberation gains, establishing diversity of input as the key enabler of effective multi-agent reasoning.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 22 of its 40 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

22 of 40 references.

Closest ancestors · 3

Same direction, newest first

  1. 2026The Reasoning Trap: An Information-Theoretic Bound on Closed-System Multi-Step LLM Reasoning3 May
  2. 2024Mixture-of-Agents Enhances Large Language Model Capabilities7 Jun
  3. 2023ReConcile: Round-Table Conference Improves Reasoning via Consensus among Diverse LLMs22 Sep

Other references · 19

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
  3. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  4. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
  5. 2024ForecastBench: A Dynamic Benchmark of AI Forecasting Capabilitiescited by 104
  6. 2024Approaching Human-Level Forecasting with Language Modelscited by 102
  7. 2023A Unified Theory of Diversity in Ensemble Learningcited by 71
  8. 2024Wisdom of the Silicon Crowd: LLM Ensemble Prediction Capabilities Rival Human Crowd Accuracycited by 66
  9. 2025FutureX: An Advanced Live Benchmark for LLM Agents in Future Predictioncited by 55
  10. 2023Language Models Can Improve Event Prediction by Few-Shot Abductive Reasoningcited by 44
  11. 2023Large Language Model Prediction Capabilities: Evidence from a Real-World Forecasting Tournamentcited by 24
  12. 2025Pitfalls in Evaluating Language Model Forecasterscited by 23
7 more
  1. 2024Are LLMs Prescient? A Continuous Evaluation using Daily News as the Oraclecited by 19
  2. 2025Scaling Open-Ended Reasoning to Predict the Futurecited by 19
  3. 2023AutoCast++: Enhancing World Event Prediction with Zero-shot Ranking-based Context Retrievalcited by 18
  4. 2025LLMs Can Teach Themselves to Better Predict the Futurecited by 13
  5. 2026PolyBench: Benchmarking LLM Forecasting and Trading Capabilities on Live Prediction Market Datacited by 11
  6. 2026Don't Always Pick the Highest-Performing Model: An Information Theoretic View of LLM Ensemble Selectioncited by 10
  7. 2026Prediction Arena: Benchmarking AI Models on Real-World Prediction Marketscited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Deliberative Illusion: Diagnosing Factual Attrition and Stance Homogenization in Multi-Agent LLM Deliberation
  2. 2026Breaking the Martingale Curse: Multi-Agent Debate via Asymmetric Cognitive Potential Energy
  3. 2025Systematic Failures in Collective Reasoning under Distributed Information in Multi-Agent LLMs
  4. 2026Design and Evaluation of Multi-Agent AI Oracle Systems for Prediction Market Resolution
  5. 2026Hidden Anchors in Multi-Agent LLM Deliberation
  6. 2026From Narrative to Auditable Forecasts: A Structured Scaffold for Agentic Forecasting
  7. 2025Can Competition Enhance the Proficiency of Agents Powered by Large Language Models in the Realm of News-driven Time Series Forecasting?
  8. 2026Agentic Forecasting using Sequential Bayesian Updating of Linguistic Beliefs