mlsanityData to 7 Oct 2026

LLMs Reproduce Human Purchase Intent via Semantic Similarity Elicitation of Likert Ratings

arXiv 2510.08338 ↗First posted 9 Oct 2025cs.AIcited by 9

Not on the map. Why?

Abstract (arXiv)

Consumer research costs companies billions annually yet suffers from panel biases and limited scale. Large language models (LLMs) offer an alternative by simulating synthetic consumers, but produce unrealistic response distributions when asked directly for numerical ratings. We present semantic similarity rating (SSR), a method that elicits textual responses from LLMs and maps these to Likert distributions using embedding similarity to reference statements. Testing on an extensive dataset comprising 57 personal care product surveys conducted by a leading corporation in that market (9,300 human responses), SSR achieves 90% of human test-retest reliability while maintaining realistic response distributions (KS similarity > 0.85). Additionally, these synthetic respondents provide rich qualitative feedback explaining their ratings. This framework enables scalable consumer research simulations while preserving traditional survey metrics and interpretability.

Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Builds on 4 of its 23 references that are in the map. First posted on arXiv 9 Oct 2025.

Builds on

4 of 23 references.

References · 4

  1. 2022Out of One, Many: Using Language Models to Simulate Human Samplescited by 737
  2. 2022Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studiescited by 506
  3. 2019Benchmarking Zero-shot Text Classification: Datasets, Evaluation and Entailment Approachcited by 299
  4. 2024Large Language Models Show Human-like Social Desirability Biases in Survey Responsescited by 27

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 9.

9 papers.