Dr-CiK: A Benchmark testing Deep Research for Context-Aided Forecasting
Not on the map. Why?
Abstract (arXiv)
Time series forecasting in real-world settings often depends not only on historical observations, but also on external context that must be actively discovered from noisy, heterogeneous information sources. Yet existing context-aided forecasting benchmarks typically assume that the supporting context is already provided, leaving open whether agents can identify it on their own. Therefore, we introduce Dr-CiK, a benchmark for evaluating whether agents can retrieve forecasting-relevant supporting context from a document corpus, filter out distractors, distill the retrieved context into forecast-useful evidence, and generate forecasts supported by that evidence. Through context ablations and evaluations of state-of-the-art deep research and forecasting methods paired together, we show that high-quality context substantially improves forecasting performance in Dr-CiK. However, existing DR methods recover limited ground-truth supporting evidence, are frequently misled by distractors, and can cause forecasters to perform worse with retrieved context than without context. Our results motivate research on agents that search for the right context to predict the future.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 34 of its 68 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
34 of 68 references.
References · 34
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2024Chronos: Learning the Language of Time Seriescited by 759
- 2024Phi-4 Technical Reportcited by 711
- 2023A decoder-only foundation model for time-series forecastingcited by 692
- 2024Unified Training of Universal Time Series Forecasting Transformerscited by 614
- 2021Monash Time Series Forecasting Archivecited by 267
- 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agentscited by 248
- 2023TimeGPT-1cited by 158
- 2026Ministral 3cited by 114
- 2024ForecastBench: A Dynamic Benchmark of AI Forecasting Capabilitiescited by 110
- 2024Moirai-MoE: Empowering Time Series Foundation Models with Sparse Mixture of Expertscited by 95
22 more
- 2025This Time is Different: An Observability Perspective on Time Series Foundation Modelscited by 68
- 2025FutureX: An Advanced Live Benchmark for LLM Agents in Future Predictioncited by 59
- 2026DeepSearchQA: Bridging the Comprehensiveness Gap for Deep Research Agentscited by 50
- 2025LLM-as-a-Prophet: Understanding Predictive Intelligence with Prophet Arenacited by 40
- 2024Towards Time Series Reasoning with LLMscited by 37
- 2026It's TIME: Towards the Next Generation of Time Series Forecasting Benchmarkscited by 33
- 2025Deep Research Bench: Evaluating AI Web Research Agentscited by 32
- 2026Toto 2.0: Time Series Forecasting Enters the Scaling Eracited by 30
- 2024TS-Reasoner: Domain-Oriented Time Series Inference Agents for Reasoning and Automated Analysiscited by 29
- 2024Multi-Modal Forecaster: Jointly Predicting Time Series and Textual Datacited by 22
- 2025DRBench: A Realistic Benchmark for Enterprise Deep Researchcited by 22
- 2025Bench to the Future: A Pastcasting Benchmark for Forecasting Agentscited by 21
- 2025Scaling Open-Ended Reasoning to Predict the Futurecited by 21
- 2024Intervention-Aware Forecasting: Breaking Historical Limits from a System Perspectivecited by 17
- 2025Achieving Time Series Reasoning Requires Rethinking Model Design, Tasks Formulation, and Evaluationcited by 17
- 2026TemporalBench: A Benchmark for Evaluating LLM-Based Agents on Contextual and Event-Informed Time Series Taskscited by 17
- 2026DRACO: a Cross-Domain Benchmark for Deep Research Accuracy, Completeness, and Objectivitycited by 14
- 2024Implicit Reasoning in Deep Time Series Forecastingcited by 5
- 2024Remember This Event That Year? Assessing Temporal Information and Reasoning in Large Language Modelscited by 4
- 2026LEAF: A Living Benchmark for Event-Augmented Forecastingcited by 2
- 2024SysCaps: Language Interfaces for Simulation Surrogates of Complex Systemscited by 1
- 2025Beyond Na"ive Prompting: Strategies for Improved Context-aided Forecasting with LLMscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.