TSVer: A Benchmark for Fact Verification Against Time-Series Evidence
Not on the map. Why?
Abstract (arXiv)
Reasoning over temporal and numerical data, such as time series, is a crucial aspect of fact-checking. While many systems have recently been developed to handle this form of evidence, their evaluation remains limited by existing datasets, which often lack structured evidence, provide insufficient justifications for verdicts, or rely on synthetic claims. In this paper, we introduce TSVer, a new benchmark dataset for fact verification focusing on temporal and numerical reasoning with time-series evidence. TSVer contains 304 real-world claims sourced from 41 fact-checking organizations and a curated database of 400 time series covering diverse domains. Each claim is annotated with time frames across all pertinent time series, along with a verdict and justifications reflecting how the evidence is used to reach the verdict. Using an LLM-assisted multi-step annotation process, we improve the quality of our annotations and achieve an inter-annotator agreement of kappa=0.77 on verdicts. We also develop a baseline for verifying claims against time-series evidence and show that even the state-of-the-art reasoning models like Gemini-2.5-Pro are challenged by time series, achieving a 63.57 accuracy score on verdicts and an Ev2R score of 47.36 on verdict justifications.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 34 of its 66 references that are in the map. First posted on arXiv 2 Nov 2025.
Builds on
34 of 66 references.
References · 34
- 2019The Curious Case of Neural Text Degenerationcited by 2,881
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,362
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,259
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,151
- 2023One Fits All:Power General Time Series Analysis by Pretrained LMcited by 615
- 2023SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilitiescited by 518
- 2023Large Language Models Are Zero-Shot Time Series Forecasterscited by 491
- 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
- 2021A Survey on Automated Fact-Checkingcited by 376
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 166
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
22 more
- 2020Explainable Automated Fact-Checking: A Surveycited by 83
- 2024Language Models Still Struggle to Zero-shot Reason about Time Seriescited by 81
- 2023SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tablescited by 51
- 2022PASTA: Table-Operations Aware Fact Verification via Sentence-Table Cloze Pre-trainingcited by 41
- 2024Evaluating Large Language Models on Time Series Feature Understanding: A Comprehensive Taxonomy and Benchmarkcited by 38
- 2023DeWave: Discrete EEG Waves Encoding for Brain Dynamics to Text Translationcited by 36
- 2023Exploring the Numerical Reasoning Capabilities of Language Models: A Comprehensive Analysis on Tabular Datacited by 33
- 2025Show Me the Work: Fact-Checkers' Requirements for Explainable Automated Fact-Checkingcited by 29
- 2022Varifocal Question Generation for Fact-checkingcited by 27
- 2023Check-COVID: Fact-Checking COVID-19 News Claims with Scientific Evidencecited by 25
- 2023Benchmarking the Generation of Fact Checking Explanationscited by 25
- 2023ChartCheck: Explainable Fact-Checking over Real-World Chart Imagescited by 25
- 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claimscited by 22
- 2024Generative Large Language Models in Automated Fact-Checking: A Surveycited by 19
- 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documentscited by 19
- 2023Automated Claim Matching with Large Language Models: Empowering Fact-Checkers in the Fight Against Misinformationcited by 18
- 2024Ev2R: Evaluating Evidence Retrieval in Automated Fact-Checkingcited by 18
- 2020Time-Aware Evidence Ranking for Fact-Checkingcited by 12
- 2023Implicit Temporal Reasoning for Evidence-Based Fact-Checkingcited by 7
- 2025Evaluating open-source Large Language Models for automated fact-checkingcited by 6
- 2024ChronoFact: Timeline-based Temporal Fact Verificationcited by 4
- 2021Discrete Acoustic Space for an Efficient Sampling in Neural Text-To-Speechcited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026TSQueryBench: LLM-as-a-Judge for Time Series Explanations
- 2024Evidence-Based Temporal Fact Verification ↗
- 2025TimeOmni-1: Incentivizing Complex Reasoning with Time Series in Large Language Models
- 2024TS-Reasoner: Domain-Oriented Time Series Inference Agents for Reasoning and Automated Analysis
- 2026TimeSeriesExamAgent: Creating Time Series Reasoning Benchmarks at Scale
- 2025TS-Agent: Understanding and Reasoning Over Raw Time Series via Iterative Insight Gathering
- 2026From Recognition to Understanding: Unlocking Cognitive Time Series Reasoning with LLMs
- 2024A Picture is Worth A Thousand Numbers: Enabling LLMs Reason about Time Series via Visualization