All That Glisters Is Not Gold: A Benchmark for Reference-Free Counterfactual Financial Misinformation Detection
Not on the map. Why?
Abstract (arXiv)
We introduce RFC Bench, a benchmark for evaluating large language models on financial misinformation under realistic news. RFC Bench operates at the paragraph level and captures the contextual complexity of financial news where meaning emerges from dispersed cues. The benchmark defines two complementary tasks: reference free misinformation detection and comparison based diagnosis using paired original perturbed inputs. Experiments reveal a consistent pattern: performance is substantially stronger when comparative context is available, while reference free settings expose significant weaknesses, including unstable predictions and elevated invalid outputs. These results indicate that current models struggle to maintain coherent belief states without external grounding. By highlighting this gap, RFC Bench provides a structured testbed for studying reference free reasoning and advancing more reliable financial misinformation detection in real world settings.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 33 of its 96 references that are in the map. First posted on arXiv 7 Jan 2026.
Builds on
33 of 96 references.
References · 33
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2023BloombergGPT: A Large Language Model for Financecited by 939
- 2019Defending Against Neural Fake Newscited by 559
- 2020Fact or Fiction: Verifying Scientific Claimscited by 554
- 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 385
- 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 363
- 2018FakeNewsNet: A Data Repository with News Content, Social Context and Spatialtemporal Information for Studying Fake News on Social Mediacited by 285
- 2018Delete, Retrieve, Generate: A Simple Approach to Sentiment and Style Transfercited by 191
- 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Designcited by 164
- 2020FinBERT: A Pretrained Language Model for Financial Communicationscited by 161
- 2021COVID-Fact: Fact Extraction and Verification of Real-World Claims on COVID-19 Pandemiccited by 100
21 more
- 2020CoAID: COVID-19 Healthcare Misinformation Datasetcited by 84
- 2019Transforming Delete, Retrieve, Generate Approach for Controlled Text Style Transfercited by 81
- 2021Tailor: Generating and Perturbing Text with Semantic Controlscited by 68
- 2024MMFakeBench: A Mixed-Source Multimodal Misinformation Detection Benchmark for LVLMscited by 61
- 2018A Retrospective Analysis of the Fake News Challenge Stance Detection Taskcited by 49
- 2023Check-COVID: Fact-Checking COVID-19 News Claims with Scientific Evidencecited by 25
- 2023Fin-Fact: A Benchmark Dataset for Multimodal Financial Fact Checking and Explanation Generationcited by 25
- 2024A Survey on Natural Language Counterfactual Generationcited by 21
- 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documentscited by 19
- 2024Large Language Models for Automated Literature Review: An Evaluation of Reference Generation, Abstract Writing, and Review Compositioncited by 17
- 2024Web Retrieval Agents for Evidence-Based Misinformation Detectioncited by 13
- 2024A Guide to Misinformation Detection Data and Evaluationcited by 10
- 2025VLDBench Evaluating Multimodal Disinformation with Regulatory Alignmentcited by 9
- 2023Investigating Online Financial Misinformation and Its Consequences: A Computational Perspectivecited by 8
- 2025Beyond Pointwise Scores: Decomposed Criteria-Based Evaluation of LLM Responsescited by 8
- 2025MMM-Fact: A Multimodal, Multi-Domain Fact-Checking Dataset with Multi-Level Retrieval Difficultycited by 5
- 2025Towards Unified Multimodal Misinformation Detection in Social Media: A Benchmark Dataset and Baselinecited by 4
- 2025Consistency Is the Key: Detecting Hallucinations in LLM Generated Text By Checking Inconsistencies About Key Factscited by 4
- 2023Domain-Expanded ASTE: Rethinking Generalization in Aspect Sentiment Triplet Extractioncited by 3
- 2025A New Dataset and Benchmark for Grounding Multimodal Misinformationcited by 2
- 2025FISCAL: Financial Synthetic Claim-document Augmented Learning for Efficient Fact-Checkingcited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Fact4ac at the Financial Misinformation Detection Challenge Task: Reference-Free Financial Misinformation Detection via Fine-Tuning and Few-Shot Prompting of Large Language Modelscited by 0
- 2026Frontier Financial Judgement: Can agents tell what might move a stock?cited by 0
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Modelscited by 0
- 2026One AI Signal, Many Human Judgments: A Bayesian Cascade Analysis of AI-based Credibility Indicators in Online Information Spreadcited by 0
- 2026One AI Signal, Many Human Judgments: A Bayesian Cascade Analysis of AI-based Credibility Indicators in Online Information Spread31 Aug 2026
- 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Models17 Aug 2026
- 2026Frontier Financial Judgement: Can agents tell what might move a stock?22 Jul 2026
- 2026Fact4ac at the Financial Misinformation Detection Challenge Task: Reference-Free Financial Misinformation Detection via Fine-Tuning and Few-Shot Prompting of Large Language Models16 Apr 2026