CHAIN: Calibrated LLM Forecasting via Causal-Temporal Hypergraph Inference
Not on the map. Why?
Abstract (arXiv)
Large language models have achieved significant progress in event forecasting, yet their probability outputs exhibit systematic calibration bias that varies heterogeneously across different domains and question types, undermining the trustworthiness of probabilistic outputs for decision-making under uncertainty. However, existing calibration methods typically correct probability outputs after prediction is complete, without modeling the structural sources of bias within the prediction process itself. To address this challenge, we decompose probabilistic prediction over causal-temporal hypergraphs into three stages, evidence weighting, evidence aggregation, and source fusion, and propose CHAIN, which designs stage-specific mechanisms to mitigate bias at each stage: (i) modulating the temporal decay function by causal topological distance, (ii) aggregating approximately independent causal chains via Noisy-OR after direction-aware deduplication, and (iii) driving adaptive fusion by causal coverage and directional balance. Experimental results on cross-domain forecasting benchmarks show CHAIN outperforms existing methods in expected calibration error, Brier score, and accuracy. Our project is available at https://github.com/QwenQKing/Chain.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 50 of its 72 references that are in the map. First posted on arXiv 29 Sep 2026.
Builds on
50 of 72 references.
References · 50
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2017On Calibration of Modern Neural Networkscited by 4,860
- 2024GPT-4o System Cardcited by 4,467
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,411
- 2023Just Ask for Calibration: Strategies for Eliciting Calibrated Confidence Scores from Language Models Fine-Tuned with Human Feedbackcited by 788
- 2019Measuring Calibration in Deep Learningcited by 443
- 2024Graph Retrieval-Augmented Generation: A Surveycited by 320
- 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 310
- 2024HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language Modelscited by 273
- 2023A Survey of Confidence Estimation and Calibration in Large Language Modelscited by 253
38 more
- 2024Approaching Human-Level Forecasting with Language Modelscited by 102
- 2024From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflectioncited by 93
- 2024Large language model validity via enhanced conformal prediction methodscited by 91
- 2022Stop Measuring Calibration When Humans Disagreecited by 70
- 2025HyperGraphRAG: Retrieval-Augmented Generation via Hypergraph-Structured Knowledge Representationcited by 68
- 2024Wisdom of the Silicon Crowd: LLM Ensemble Prediction Capabilities Rival Human Crowd Accuracycited by 66
- 2022Forecasting Future World Events with Neural Networkscited by 63
- 2024ConU: Conformal Uncertainty in Large Language Models with Correctness Coverage Guaranteescited by 62
- 2024Calibrating Language Models with Adaptive Temperature Scalingcited by 57
- 2025FutureX: An Advanced Live Benchmark for LLM Agents in Future Predictioncited by 55
- 2024Calibrating the Confidence of Large Language Models by Eliciting Fidelitycited by 47
- 2023Temporal Knowledge Graph Forecasting Without Knowledge Using In-Context Learningcited by 36
- 2023GenTKG: Generative Forecasting on Temporal Knowledge Graph with Large Language Modelscited by 30
- 2024Calibrating Reasoning in Language Models with Internal Consistencycited by 27
- 2024Consistency Checks for Language Model Forecasterscited by 27
- 2025Restoring Calibration for Aligned Large Language Models: A Calibration-Aware Fine-Tuning Approachcited by 25
- 2025GraphRAG-Bench: Challenging Domain-Specific Reasoning for Evaluating Graph Retrieval-Augmented Generationcited by 24
- 2025Pitfalls in Evaluating Language Model Forecasterscited by 23
- 2025Bench to the Future: A Pastcasting Benchmark for Forecasting Agentscited by 20
- 2025Scaling Open-Ended Reasoning to Predict the Futurecited by 19
- 2023AutoCast++: Enhancing World Event Prediction with Zero-shot Ranking-based Context Retrievalcited by 18
- 2025Trained on Tokens, Calibrated on Concepts: The Emergence of Semantic Calibration in LLMscited by 17
- 2023zrLLM: Zero-Shot Relational Learning on Temporal Knowledge Graphs with Large Language Modelscited by 13
- 2024QA-Calibration of Language Model Confidence Scorescited by 13
- 2024OpenEP: Open-Ended Future Event Predictioncited by 11
- 2026Future-as-Label: Scalable Supervision from Real-World Outcomescited by 11
- 2024A Unified Temporal Knowledge Graph Reasoning Model Towards Interpolation and Extrapolationcited by 9
- 2025FOReCAst: The Future Outcome Reasoning and Confidence Assessment Benchmarkcited by 8
- 2025PROPHET: An Inferable Future Forecasting Benchmark with Causal Intervened Likelihood Estimationcited by 8
- 2024Automatically Labeling Clinical Trial Outcomes: A Large-Scale Benchmark for Drug Developmentcited by 7
- 2025Evaluating LLMs on Real-World Forecasting Against Expert Forecasterscited by 6
- 2025Advancing Event Forecasting through Massive Training of Large Language Models: Challenges, Solutions, and Broader Impactscited by 6
- 2025OKG-LLM: Aligning Ocean Knowledge Graph with Observation Data via LLMs for Global Sea Surface Temperature Predictioncited by 4
- 2025Future Is Unevenly Distributed: Forecasting Ability of LLMs Depends on What We're Askingcited by 2
- 2026Following the TRAIL: Predicting and Explaining Tomorrow's Hits with a Fine-Tuned LLMcited by 2
- 2025Event-CausNet: Unlocking Causal Knowledge from Text with Large Language Models for Reliable Spatio-Temporal Forecastingcited by 1
- 2026When to Trust: A Causality-Aware Calibration Framework for Accurate Knowledge Graph Retrieval-Augmented Generationcited by 1
- 2026Double-Calibration: Towards Reliable LLMs via Calibrating Knowledge and Reasoning Confidencecited by 1
Built on by
Not cited yet.