Large Language Models Can Be Used to Estimate the Latent Positions of Politicians
Not on the map. Why?
Abstract (arXiv)
Existing approaches to estimating politicians' latent positions along specific dimensions often fail when relevant data is limited. We leverage the embedded knowledge in generative large language models (LLMs) to address this challenge and measure lawmakers' positions along specific political or policy dimensions. We prompt an instruction/dialogue-tuned LLM to pairwise compare lawmakers and then scale the resulting graph using the Bradley-Terry model. We estimate novel measures of U.S. senators' positions on liberal-conservative ideology, gun control, and abortion. Our liberal-conservative scale, used to validate LLM-driven scaling, strongly correlates with existing measures and offsets interpretive gaps, suggesting LLMs synthesize relevant data from internet and digitized media rather than memorizing existing measures. Our gun control and abortion measures -- the first of their kind -- differ from the liberal-conservative scale in face-valid ways and predict interest group ratings and legislator votes better than ideology alone. Our findings suggest LLMs hold promise for solving complex social science measurement problems.
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). Builds on 6 of its 53 references that are in the map. First posted on arXiv 21 Mar 2023.
Builds on
6 of 53 references.
References · 6
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022Training language models to follow instructions with human feedbackcited by 15,971
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
- 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 752
Built on by
Citing papers per year: 2023: 6; 2024: 11; 2025: 8; 2026: 8.
33 papers.
Sort:
By area:
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
- 2024Random Silicon Sampling: Simulating Human Sub-Population Opinion Using a Large Language Model Based on Group-Level Demographic Informationcited by 49
- 2023Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Modelscited by 39
- 2025Linear Representations of Political Perspective Emerge in Large Language Modelscited by 32
- 2025The simulation of judgment in LLMscited by 22
- 2024The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Modelscited by 19
- 2023Positioning Political Texts with Large Language Models by Asking and Averagingcited by 13
- 2024Language Models can Subtly Deceive Without Lying: A Case Study on Strategic Phrasing in Legislationcited by 10
- 2024A Large-Scale Simulation on Large Language Models for Decision-Making in Political Sciencecited by 10
- 2024Latent State Estimation Helps UI Agents to Reasoncited by 9
- 2024LLMs left, right, and center: Assessing GPT's capabilities to label political bias from web domainscited by 9
- 2023How to use LLMs for Text Analysiscited by 5
21 more
- 2023Concept-Guided Chain-of-Thought Prompting for Pairwise Comparison Scoring of Texts with Large Language Modelscited by 5
- 2024LLMs May Not Be Human-Level Players, But They Can Be Testers: Measuring Game Difficulty with LLM Agentscited by 5
- 2025Synthesizing Public Opinions with LLMs: Role Creation, Impacts, and the Future to eDemorcacycited by 5
- 2024Adaptive Uncertainty Quantification for Generative AIcited by 4
- 2024LLM-POTUS Score: A Framework of Analyzing Presidential Debates with Large Language Modelscited by 2
- 2023Multiclass Classification of Policy Documents with Large Language Modelscited by 1
- 2024L(u)PIN: LLM-based Political Ideology Nowcastingcited by 1
- 2024Identifying the sources of ideological bias in GPT models through linguistic variation in outputcited by 1
- 2025Agent-Enhanced Large Language Models for Researching Political Institutionscited by 1
- 2025VisTopics: A Visual Semantic Unsupervised Approach to Topic Modeling of Video and Image Datacited by 1
- 2026Validating Political Position Predictions of Argumentscited by 1
- 2026Item-Mean Surrogates: Why Richer Persona Data Fail to Improve LLMs as Human Surrogatescited by 1
- 2025Efficient Portfolio Selection through Preference Aggregation with Quicksort and the Bradley--Terry Modelcited by 0
- 2025Persona-driven Simulation of Voting Behavior in the European Parliament with Large Language Modelscited by 0
- 2025Shachi: A Modular, Controllable Framework for LLM-Based Agent-Based Modeling of Emergent Collective Behaviorcited by 0
- 2026Agentic Framework for Political Biography Extractioncited by 0
- 2026Does Topic Sentiment Cause Perceived Ideology? Comparing Human and LLM Annotations in Political News Articlescited by 0
- 2026The Model as One Rater Among Several: Measuring Political Positions in Data-Sparse Regions with a Language-Model Panelcited by 0
- 2026Validating LLMs in social science: Epistemic threats and emerging normscited by 0
- 2026Multi-dimensional Bias in Modeling Multi-dimensional Preferences: Evaluating the Ability of Synthetic Agents to Replace Human Participants in Conjoint Experimentscited by 0
- 2026Making Political Text Scaling Comparable: Infrastructure and Hyperparameter Sensitivity for 17 Algorithmscited by 0
- 2026Making Political Text Scaling Comparable: Infrastructure and Hyperparameter Sensitivity for 17 Algorithms13 Sep 2026
- 2026Item-Mean Surrogates: Why Richer Persona Data Fail to Improve LLMs as Human Surrogates29 Aug 2026
- 2026Multi-dimensional Bias in Modeling Multi-dimensional Preferences: Evaluating the Ability of Synthetic Agents to Replace Human Participants in Conjoint Experiments13 Aug 2026
- 2026Validating LLMs in social science: Epistemic threats and emerging norms8 Jul 2026
- 2026The Model as One Rater Among Several: Measuring Political Positions in Data-Sparse Regions with a Language-Model Panel22 Jun 2026
- 2026Does Topic Sentiment Cause Perceived Ideology? Comparing Human and LLM Annotations in Political News Articles4 Jun 2026
- 2026Agentic Framework for Political Biography Extraction23 Feb 2026
- 2026Validating Political Position Predictions of Arguments20 Feb 2026
- 2025Shachi: A Modular, Controllable Framework for LLM-Based Agent-Based Modeling of Emergent Collective Behavior26 Sep 2025
- 2025Persona-driven Simulation of Voting Behavior in the European Parliament with Large Language Models13 Jun 2025
- 2025VisTopics: A Visual Semantic Unsupervised Approach to Topic Modeling of Video and Image Data20 May 2025
- 2025Efficient Portfolio Selection through Preference Aggregation with Quicksort and the Bradley--Terry Model6 Apr 2025
21 more
- 2025Synthesizing Public Opinions with LLMs: Role Creation, Impacts, and the Future to eDemorcacy31 Mar 2025
- 2025Agent-Enhanced Large Language Models for Researching Political Institutions14 Mar 2025
- 2025Linear Representations of Political Perspective Emerge in Large Language Models3 Mar 2025
- 2025The simulation of judgment in LLMs6 Feb 2025
- 2024A Large-Scale Simulation on Large Language Models for Decision-Making in Political Science19 Dec 2024
- 2024LLMs May Not Be Human-Level Players, But They Can Be Testers: Measuring Game Difficulty with LLM Agents1 Oct 2024
- 2024LLM-POTUS Score: A Framework of Analyzing Presidential Debates with Large Language Models12 Sep 2024
- 2024Identifying the sources of ideological bias in GPT models through linguistic variation in output9 Sep 2024
- 2024Adaptive Uncertainty Quantification for Generative AI16 Aug 2024
- 2024LLMs left, right, and center: Assessing GPT's capabilities to label political bias from web domains19 Jul 2024
- 2024The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Models16 Jun 2024
- 2024Latent State Estimation Helps UI Agents to Reason17 May 2024
- 2024L(u)PIN: LLM-based Political Ideology Nowcasting12 May 2024
- 2024Language Models can Subtly Deceive Without Lying: A Case Study on Strategic Phrasing in Legislation7 May 2024
- 2024Random Silicon Sampling: Simulating Human Sub-Population Opinion Using a Large Language Model Based on Group-Level Demographic Information28 Feb 2024
- 2023Positioning Political Texts with Large Language Models by Asking and Averaging28 Nov 2023
- 2023Concept-Guided Chain-of-Thought Prompting for Pairwise Comparison Scoring of Texts with Large Language Models18 Oct 2023
- 2023Multiclass Classification of Policy Documents with Large Language Models12 Oct 2023
- 2023How to use LLMs for Text Analysis24 Jul 2023
- 2023Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Models7 Jun 2023
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Tasks27 Mar 2023
- 2024LLMs May Not Be Human-Level Players, But They Can Be Testers: Measuring Game Difficulty with LLM Agentscited by 5
- 2025Agent-Enhanced Large Language Models for Researching Political Institutionscited by 1
- 2025Shachi: A Modular, Controllable Framework for LLM-Based Agent-Based Modeling of Emergent Collective Behaviorcited by 0
- 2026Agentic Framework for Political Biography Extractioncited by 0
- 2026Multi-dimensional Bias in Modeling Multi-dimensional Preferences: Evaluating the Ability of Synthetic Agents to Replace Human Participants in Conjoint Experimentscited by 0
- 2026Multi-dimensional Bias in Modeling Multi-dimensional Preferences: Evaluating the Ability of Synthetic Agents to Replace Human Participants in Conjoint Experiments13 Aug 2026
- 2026Agentic Framework for Political Biography Extraction23 Feb 2026
- 2025Shachi: A Modular, Controllable Framework for LLM-Based Agent-Based Modeling of Emergent Collective Behavior26 Sep 2025
- 2025Agent-Enhanced Large Language Models for Researching Political Institutions14 Mar 2025
- 2024LLMs May Not Be Human-Level Players, But They Can Be Testers: Measuring Game Difficulty with LLM Agents1 Oct 2024
- 2023ChatGPT Outperforms Crowd-Workers for Text-Annotation Taskscited by 870
- 2024Random Silicon Sampling: Simulating Human Sub-Population Opinion Using a Large Language Model Based on Group-Level Demographic Informationcited by 49
- 2023Using Imperfect Surrogates for Downstream Inference: Design-based Supervised Learning for Social Science Applications of Large Language Modelscited by 39
- 2025The simulation of judgment in LLMscited by 22
- 2024The Potential and Challenges of Evaluating Attitudes, Opinions, and Values in Large Language Modelscited by 19
- 2023Positioning Political Texts with Large Language Models by Asking and Averagingcited by 13
- 2024Language Models can Subtly Deceive Without Lying: A Case Study on Strategic Phrasing in Legislationcited by 10
- 2024A Large-Scale Simulation on Large Language Models for Decision-Making in Political Sciencecited by 10
- 2024LLMs left, right, and center: Assessing GPT's capabilities to label political bias from web domainscited by 9
- 2023How to use LLMs for Text Analysiscited by 5
- 2025Synthesizing Public Opinions with LLMs: Role Creation, Impacts, and the Future to eDemorcacycited by 5
- 2024Adaptive Uncertainty Quantification for Generative AIcited by 4
12 most cited of 25 All 25 (JSON)
- 2026Making Political Text Scaling Comparable: Infrastructure and Hyperparameter Sensitivity for 17 Algorithms13 Sep 2026
- 2026Item-Mean Surrogates: Why Richer Persona Data Fail to Improve LLMs as Human Surrogates29 Aug 2026
- 2026Validating LLMs in social science: Epistemic threats and emerging norms8 Jul 2026
- 2026The Model as One Rater Among Several: Measuring Political Positions in Data-Sparse Regions with a Language-Model Panel22 Jun 2026
- 2026Does Topic Sentiment Cause Perceived Ideology? Comparing Human and LLM Annotations in Political News Articles4 Jun 2026
- 2026Validating Political Position Predictions of Arguments20 Feb 2026
- 2025Persona-driven Simulation of Voting Behavior in the European Parliament with Large Language Models13 Jun 2025
- 2025VisTopics: A Visual Semantic Unsupervised Approach to Topic Modeling of Video and Image Data20 May 2025
- 2025Efficient Portfolio Selection through Preference Aggregation with Quicksort and the Bradley--Terry Model6 Apr 2025
- 2025Synthesizing Public Opinions with LLMs: Role Creation, Impacts, and the Future to eDemorcacy31 Mar 2025
- 2025The simulation of judgment in LLMs6 Feb 2025
- 2024A Large-Scale Simulation on Large Language Models for Decision-Making in Political Science19 Dec 2024
12 newest of 25 All 25 (JSON)