Distilling Temporal Search and Reasoning: Evolving LLMs for Future Prediction via Harness-Assisted Efficient Data Synthesis
On the map: LLM reasoning → Time series reasoning
also in 1 more
Abstract (arXiv)
Future event prediction carries broad social impact yet remains challenging. SOTA approaches augment LLMs with external agent frameworks whose predictive capability vanishes once the harness is removed. While recent Tool-Integrated Reasoning (TIR) internalizes deep search for multi-hop retrieval of facts, forecasting further demands temporal search and reasoning over historical trends and dynamic shifts. The key obstacle is data: historical queries induce temporal leakage that degrades forecasting into retrieval. Prior works either freeze information gathering with static observations, or rely on rejection sampling or unresolved fresh queries that discard vast amounts of data, degrading synthesis efficiency. We propose a time-truncation harness that enforces a temporal cut-off at every turn, enabling TIR-style sampling from historical events, reducing temporal leakage and reliance of rejection sampling or unsolved queries, increasing the sampling efficiency. We further build a large-scale corpus and a process-based metric and show that our harness naturally induces a broader temporal breadth of search and raises the proportion of high-quality data, further increasing the efficiency and reducing the reliance on complex rubrics. Distillation experiments show that students trained on harness-intervened data achieve the best performance, demonstrating harness-assisted model evolving that turns higher quality temporal search and reasoning data into a parametric advancement of the students.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Time series reasoning, one of 17 directions in LLM reasoning. Builds on 23 of its 40 references that are in the map. First posted on arXiv 28 Jul 2026.
Builds on
23 of 40 references.
References · 23
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 616
- 2026GLM-5: from Vibe Coding to Agentic Engineeringcited by 502
- 2026Kimi K2.5: Visual Agentic Intelligencecited by 449
- 2025BrowseComp-ZH: Benchmarking Web Browsing Ability of Large Language Models in Chinesecited by 139
- 2024ForecastBench: A Dynamic Benchmark of AI Forecasting Capabilitiescited by 104
- 2022Forecasting Future World Events with Neural Networkscited by 63
- 2025FutureX: An Advanced Live Benchmark for LLM Agents in Future Predictioncited by 55
- 2025DeepDive: Advancing Deep Search Agents with Knowledge Graphs and Multi-Turn RLcited by 53
- 2020ForecastQA: A Question Answering Challenge for Event Forecasting with Temporal Text Datacited by 43
11 more
- 2025LLM-as-a-Prophet: Understanding Predictive Intelligence with Prophet Arenacited by 36
- 2026LongCat-Flash-Thinking-2601 Technical Reportcited by 32
- 2026MiroThinker-1.7 & H1: Towards Heavy-Duty Research Agents via Verificationcited by 28
- 2025Flash-Searcher: Fast and Effective Web Agents via DAG-Based Parallel Executioncited by 27
- 2025Outcome-based Reinforcement Learning to Predict the Futurecited by 21
- 2026MiroFlow: Towards High-Performance and Robust Open-Source Agent Framework for General Deep Research Taskscited by 13
- 2026Future-as-Label: Scalable Supervision from Real-World Outcomescited by 11
- 2025PROPHET: An Inferable Future Forecasting Benchmark with Causal Intervened Likelihood Estimationcited by 8
- 2026FutureX-Pro: Extending Future Prediction to High-Value Vertical Domainscited by 8
- 2026FutureWorld: A Live Reinforcement Learning Environment for Predictive Agents with Real-World Outcome Rewardscited by 2
- 2026Harnessing Pre-Resolution Signals for Future Prediction Agentscited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SEER: Self-Evolving Event Reasoning and Retrieval for Time Series Forecasting
- 2026TemporalBench: A Benchmark for Evaluating LLM-Based Agents on Contextual and Event-Informed Time Series Tasks
- 2026Forecasting With LLMs: Improved Generalization Through Feature Steering
- 2026Agentic Time Machine as an Infrastructure for Future-Event Forecasting
- 2026Do Your Own Research: Learning to Forecast by Learning to Search
- 2024From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflection
- 2026CTRL: Control-Based Time Series Forecasting with LLM-Guided Residual Learning
- 2025Can Slow-thinking LLMs Reason Over Time? Empirical Studies in Time Series Forecasting