TrendFact: A Benchmark Towards Hotspot Perception in Automatic Fact-Checking
On the map: LLM reasoning → Reasoning benchmarks and evaluation
Abstract (arXiv)
With the surge of online misinformation, Large Language Models (LLMs) and Reasoning Large Language Models (RLMs) serving as Automatic Fact-Checking (AFC) systems have emerged as a prominent paradigm for reliable, explainable verification. However, our empirical study reveals that this paradigm faces a critical risk asymmetry challenge when deployed in the real world under resource-constrained environments. While Hotspot Perception Ability (HPA), the capacity to dynamically allocate reasoning resources based on social impact, is essential to mitigate this risk, existing benchmarks lack the social metadata and evaluation framework to meet this urgent evaluation needs, thereby hindering the advancement of these AFC systems. To bridge this gap, we introduce TrendFact, the first benchmark capable of evaluating HPA and three fact-checking tasks. It consists of 7,643 curated samples sourced from trending platforms and professional datasets, with an evidence library containing 366,634 entries. To enable HPA assessment, we propose two novel metrics: the Explanation Consistency Score (ECS) to evaluate the reliability of verification reasoning, and the Hotspot Claim Perception Index (HCPI) to quantify the overall HPA of AFC systems. Extensive experiments demonstrate that existing AFC systems exhibit limited performance on TrendFact. Furthermore, our proposed FactISR framework effectively enhances HPA and computational efficiency for RLMs-served AFC systems.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 16 of its 34 references that are in the map. First posted on arXiv 19 Oct 2024.
Builds on
16 of 34 references.
Closest ancestors · 1
Same direction, newest first
Other references · 15
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2023FrugalGPT: How to Use Large Language Models While Reducing Cost and Improving Performancecited by 853
- 2020HoVer: A Dataset for Many-Hop Fact Extraction And Claim Verificationcited by 201
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 167
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2020Generating Fact Checking Explanationscited by 132
- 2018DeClarE: Debunking Fake News and False Claims using Evidence-Aware Deep Learningcited by 100
- 2021X-FACT: A New Benchmark Dataset for Multilingual Fact Checkingcited by 91
- 2022Generating Literal and Implied Subquestions to Fact-check Complex Claimscited by 66
- 2023Reinforcement Learning-based Counter-Misinformation Response Generation: A Case Study of COVID-19 Vaccine Misinformationcited by 39
- 2023FACTIFY-5WQA: 5W Aspect-based Fact Verification through Question Answeringcited by 24
- 2024QuanTemp: A real-world open-domain benchmark for fact-checking numerical claimscited by 23
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026SearchJev: A Fast and Calibrated System-1 Model for Search Agentscited by 1
- 2026The Safeguard Worked. Is the LLM System Safer?cited by 0
- 2026SearchJev: A Fast and Calibrated System-1 Model for Search Agents4 Oct 2026
- 2026The Safeguard Worked. Is the LLM System Safer?1 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2025RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checking
- 2026Towards Comprehensive Stage-wise Benchmarking of Large Language Models in Fact-Checking
- 2025Towards Automated Fact-Checking of Real-World Claims: Exploring Task Formulation and Assessment with LLMs
- 2026LiveFact: A Dynamic, Time-Aware Benchmark for LLM-Driven Fake News Detection
- 2025FACT-AUDIT: An Adaptive Multi-Agent Framework for Dynamic Fact-Checking Evaluation of Large Language Models
- 2025Large Language Models Require Curated Context for Reliable Political Fact-Checking -- Even with Reasoning and Web Search
- 2024Multimodal Large Language Models to Support Real-World Fact-Checking
- 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Models