Latent Fact-Checking: Detecting Misinformation through Activation Engineering
Not on the map. Why?
Abstract (arXiv)
The proliferation of misinformation online has driven demand for scalable detection systems. While most existing approaches rely on surface-level linguistic features or external knowledge retrieval, we examine truthfulness as a geometric property of a language model's representation space. We introduce a misinformation detection framework grounded in activation engineering, which leverages the latent geometry of transformer models. Our approach elicits a misinformation direction in the residual stream by contrasting activations from paired truthful and false statements, following the difference-in-means principle of Contrastive Activation Addition (CAA). At inference time, the last-token activation of an unseen claim is projected onto this direction, and the projected representation is fed to an Multilayer Perceptron (MLP) for classification. The procedure requires no fine-tuning of the backbone model, no external evidence retrieval, and no task-specific supervision beyond the contrastive pairs used to estimate the direction. We evaluate the method across 11 models from the Gemma, Llama, and Qwen families, ranging from 270M to 12B parameters, on three fact-checking benchmarks: AVeriTeC, LIAR, and FACTors. The falsehood direction is recoverable across model scales and architectural families, and last-token projection matches or surpasses zero-shot and few-shot prompting baselines on LIAR and FACTors, with the largest gains observed for smaller models. Performance on AVeriTeC is more limited, which we attribute to its evidence-grounded labeling scheme. These findings provide evidence that truthfulness is a structured, linearly separable concept in the latent space of pretrained language models, and point toward interpretability-driven misinformation detection as a practical complement to retrieval-based pipelines. The code is available on https://github.com/Malta-Lab/LaFaCt.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 23 of its 27 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
23 of 27 references.
References · 23
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
- 2017Interpretability Beyond Feature Attribution: Quantitative Testing with Concept Activation Vectors (TCAV)cited by 1,319
- 2023Inference-Time Intervention: Eliciting Truthful Answers from a Language Modelcited by 1,302
- 2023Steering Llama 2 via Contrastive Activation Additioncited by 1,085
- 2024Refusal in Language Models Is Mediated by a Single Directioncited by 1,032
- 2022Toy Models of Superpositioncited by 971
- 2023The Linear Representation Hypothesis and the Geometry of Large Language Modelscited by 716
- 2023The Geometry of Truth: Emergent Linear Structure in Large Language Model Representations of True/False Datasetscited by 712
- 2023The Internal State of an LLM Knows When It's Lyingcited by 659
- 2020Fact or Fiction: Verifying Scientific Claimscited by 554
- 2017"Liar, Liar Pants on Fire": A New Benchmark Dataset for Fake News Detectioncited by 363
11 more
- 2022Extracting Latent Steering Vectors from Pretrained Language Modelscited by 225
- 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 167
- 2023AVeriTeC: A Dataset for Real-world Claim Verification with Evidence from the Webcited by 144
- 2024Personalized Steering of Large Language Models: Versatile Steering Vectors Through Bi-directional Preference Optimizationcited by 118
- 2024Style Vectors for Steering Generative Large Language Modelcited by 56
- 2025Controlling Large Language Models Through Concept Activation Vectorscited by 28
- 2024Multimodal Misinformation Detection by Learning from Synthetic Data with Multimodal LLMscited by 13
- 2023Analysis of Disinformation and Fake News Detection Using Fine-Tuned Large Language Modelcited by 10
- 2024AIC CTU system at AVeriTeC: Re-framing automated fact-checking as a simple RAG taskcited by 8
- 2025FACTors: A New Dataset for Studying the Fact-checking Ecosystemcited by 4
- 2024Zero-Shot Learning and Key Points Are All You Need for Automated Fact-Checkingcited by 3
Built on by
Not cited yet.