Agentic Time Machine as an Infrastructure for Future-Event Forecasting
On the map: LLM agents and tool use → Financial trading and forecasting agents
Abstract (arXiv)
Forecasting future events is a critical challenge for large language model (LLM) agents, spanning domains from elections and monetary policy to financial markets. However, evaluating progress on this task presents a fundamental trade-off between efficiency and environment fidelity. While live evaluation benchmarks suffer from an inherently slow feedback loop, existing retrospective replays typically restrict agents to static, pre-frozen databases that sacrifice the environmental realism of actual deployments. To tackle this issue, we introduce Agentic Time Machine (TM), an infrastructure that approximately reconstructs the web state at any chosen past time by filtering post-cutoff content. Leveraging this evaluation infrastructure, we further propose a planner-solver-aggregator multi-agent framework that breaks each question into diverse analytical angles, gathers evidence in parallel, and combines the results into a single forecast. Experiments show that offline scores under TM correlate strongly with live FutureX scores, validating that TM offers a fast and reliable sandbox for forecasting-agent evaluation. On FutureX-Past and Polymarket evaluated under TM, our framework achieves the highest score among strong closed-book, tool-augmented, and self-consistency baselines. On the official FutureX live leaderboard, our system achieves the best average rank over four consecutive weeks, including 1st place in May Week 1. As of June 17, it also ranks 1st on FutureX's official eight-week overall leaderboard.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use. Builds on 13 of its 20 references that are in the map. First posted on arXiv 19 Jun 2026.
Builds on
13 of 20 references.
Closest ancestors · 2
Same direction, newest first
- 2025FutureX: An Advanced Live Benchmark for LLM Agents in Future Prediction16 Aug
- 2025Bench to the Future: A Pastcasting Benchmark for Forecasting Agents11 Jun
Other references · 11
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
- 2024ForecastBench: A Dynamic Benchmark of AI Forecasting Capabilitiescited by 110
- 2024Approaching Human-Level Forecasting with Language Modelscited by 107
- 2025LLM-as-a-Prophet: Understanding Predictive Intelligence with Prophet Arenacited by 40
- 2025Scaling Open-Ended Reasoning to Predict the Futurecited by 21
- 2024Are LLMs Prescient? A Continuous Evaluation using Daily News as the Oraclecited by 19
- 2024Are Large Language Models (LLMs) Good Social Predictors?cited by 13
- 2025Inferring Events from Time Series using Language Modelscited by 10
- 2026FutureSim: Replaying World Events to Evaluate Adaptive Agentscited by 7
- 2026Foresight Arena: An On-Chain Benchmark for Evaluating AI Forecasting Agentscited by 4
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025TimeCopilot
- 2026TimeSage-MT: A Multi-Turn Benchmark for Evaluating Agentic Time Series Reasoning
- 2024MIRAI: Evaluating LLM Agents for Event Forecasting
- 2026TimeSeek: Temporal Reliability of Agentic Forecasters
- 2026Position: Beyond Model-Centric Prediction -- Agentic Time Series Forecasting
- 2026When Tomorrow Becomes Today: Self-Evolving Policies for Agentic Time-Series Forecasting
- 2026Nexus : An Agentic Framework for Time Series Forecasting
- 2026WorldReasoner: Evaluating Whether Language Model Agents Forecast Events with Valid Reasoning