Ideological Bias in LLMs' Economic Causal Reasoning
On the map: LLM reasoning → Causal reasoning in LLMs
Abstract (arXiv)
Do large language models (LLMs) exhibit systematic ideological bias when reasoning about economic causal effects? As LLMs are increasingly used in policy analysis and economic reporting, where directionally correct causal judgments are essential, this question has direct practical stakes. We present a systematic evaluation by extending the EconCausal benchmark with ideology-contested cases - instances where intervention-oriented (pro-government) and market-oriented (pro-market) perspectives predict divergent causal signs. From 10,490 causal triplets (treatment-outcome pairs with empirically verified effect directions) derived from top-tier economics and finance journals, we identify 1,056 ideology-contested instances and evaluate 20 state-of-the-art LLMs on their ability to predict empirically supported causal directions. We find that ideology-contested items are consistently harder than non-contested ones, and that across 17 of 20 models, accuracy is systematically higher when the empirically verified causal sign aligns with intervention-oriented expectations than with market-oriented ones. Moreover, when models err, their incorrect predictions disproportionately lean intervention-oriented, and this directional skew is not eliminated by one-shot in-context prompting. These results highlight that LLMs are not only less accurate on ideologically contested economic questions, but systematically less reliable in one ideological direction than the other, underscoring the need for direction-aware evaluation in high-stakes economic and policy settings.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Causal reasoning in LLMs, one of 17 directions in LLM reasoning. Builds on 7 of its 31 references that are in the map. First posted on arXiv 23 Apr 2026.
Builds on
7 of 31 references.
Closest ancestors · 4
Same direction, newest first
- 2026Do LLMs Share Human-Like Biases? Causal Reasoning Under Prior Knowledge, Irrelevant Context, and Varying Compute Budgets3 Feb
- 2025EconCausal: A Context-Aware Economic Reasoning Benchmark for Large Language Models8 Oct
- 2024Causal Evaluation of Language Models1 May
- 2023Causal Reasoning and Large Language Models: Opening a New Frontier for Causality28 Apr
Other references · 3
- 2023The political ideology of conversational AI: Converging evidence on ChatGPT's pro-environmental, left-libertarian orientationcited by 189
- 2023Causal Parrots: Large Language Models May Talk Causality But Are Not Causalcited by 150
- 2025Large Means Left: Political Bias in Large Language Models Increases with Their Number of Parameterscited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Ice Cream Doesn't Cause Drowning: Benchmarking LLMs Against Statistical Pitfalls in Causal Inference
- 2025Are LLMs (Really) Ideological? An IRT-based Analysis and Alignment Tool for Perceived Socio-Economic Bias in LLMs
- 2024Gender Bias of LLM in Economics: An Existentialism Perspective
- 2024PoliTune: Analyzing the Impact of Data Selection and Fine-Tuning on Economic and Political Biases in Large Language Models
- 2026LLM-Ideoplasticity: Measuring Ideological Plasticity in the Political Behavior of LLMs as a Context-Conditioned Distribution
- 2024Causal Inference with Large Language Model: A Survey
- 2024EconNLI: Evaluating Large Language Models on Economics Reasoning
- 2025BiasCause: Evaluate Socially Biased Causal Reasoning of Large Language Models