How Large Language Models Systematically Misrepresent American Climate Opinions
Not on the map. Why?
Abstract (arXiv)
Federal agencies and researchers increasingly use large language models to analyze and simulate public opinion. When AI mediates between the public and policymakers, accuracy across intersecting identities becomes consequential; inaccurate group-level estimates may mislead outreach, consultation, and policy design. While research examines intersectionality in LLM outputs, few studies have compared these outputs against real human responses across intersecting identities. Climate policy is one such domain, and this is particularly urgent for climate change, where opinion is contested and diverse. We investigate how LLMs represent demographic and intersectional patterns in U.S. climate opinions. We prompted six LLMs with profiles of 978 respondents from a nationally representative U.S. climate opinion survey and compared AI-generated responses to actual human answers across 20 questions. We find that LLMs appear to compress the diversity of American climate opinions, predicting less-concerned groups as more concerned and vice versa. This compression is intersectional: LLMs appear to apply uniform gender assumptions that match reality for White and Hispanic Americans but may misrepresent Black Americans, where actual gender patterns differ. These patterns, which may be invisible to standard auditing approaches, could undermine equitable climate governance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 59 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
14 of 59 references.
References · 14
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
- 2023Bias and Fairness in Large Language Models: A Surveycited by 626
- 2024Lessons from the Trenches on Reproducible Evaluation of Language Modelscited by 172
- 2024Large language models that replace human participants can harmfully misportray and flatten identity groupscited by 137
- 2024BetterBench: Assessing AI Benchmarks, Uncovering Issues, and Establishing Best Practicescited by 112
- 2023Questioning the Survey Responses of Large Language Modelscited by 70
- 2024Wisdom of the Silicon Crowd: LLM Ensemble Prediction Capabilities Rival Human Crowd Accuracycited by 66
- 2024Gender, Race, and Intersectional Bias in Resume Screening via Language Model Retrievalcited by 49
- 2023A Survey on Intersectional Fairness in Machine Learning: Notions, Mitigation, and Challengescited by 41
- 2024Understanding Intrinsic Socioeconomic Biases in Large Language Modelscited by 9
Built on by
Not cited yet.