mlsanityData to 14 Oct 2026

Individualized Cognitive Simulation in Large Language Models: Evaluating Different Cognitive Representation Methods

arXiv 2510.20252 ↗First posted 23 Oct 2025cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Individualized cognitive simulation (ICS) aims to build computational models that approximate the thought processes of specific individuals. While large language models (LLMs) convincingly mimic surface-level human behavior such as role-play, their ability to simulate deeper individualized cognitive processes remains poorly understood. To address this gap, we introduce a novel task that evaluates different cognitive representation methods in ICS. We construct a dataset from recently published novels (later than the release date of the tested LLMs) and propose an 11-condition cognitive evaluation framework to benchmark seven off-the-shelf LLMs in the context of authorial style emulation. We hypothesize that effective cognitive representations can help LLMs generate storytelling that better mirrors the original author. Thus, we test different cognitive representations, e.g., linguistic features, concept mappings, and profile-based information. Results show that combining conceptual and linguistic features is particularly effective in ICS, outperforming static profile-based cues in overall evaluation. Importantly, LLMs are more effective at mimicking linguistic style than narrative structure, underscoring their limits in deeper cognitive simulation. These findings provide a foundation for developing AI systems that adapt to individual ways of thinking and expression, advancing more personalized and human-aligned creative technologies.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 20 of its 48 references that are in the map. First posted on arXiv 23 Oct 2025.

Builds on

20 of 48 references.

References · 20

  1. 2020Scaling Laws for Neural Language Modelscited by 6,586
  2. 2019The Curious Case of Neural Text Degenerationcited by 2,916
  3. 2022Emergent Abilities of Large Language Modelscited by 2,512
  4. 2023A Survey on Evaluation of Large Language Modelscited by 1,242
  5. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
  6. 2023Can Large Language Models Be an Alternative to Human Evaluations?cited by 734
  7. 2023Role-Play with Large Language Modelscited by 294
  8. 2019Automatic Detection of Generated Text is Easiest when Humans are Fooledcited by 261
  9. 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 248
  10. 2024Quantifying the Persona Effect in LLM Simulationscited by 169
  11. 2017Style Transfer in Text: Exploration and Evaluationcited by 146
  12. 2019Personalized Dialogue Generation with Diversified Traitscited by 74
8 more
  1. 2019Exploiting Persona Information for Diverse Generation of Conversational Responsescited by 58
  2. 2024AntiLeakBench: Preventing Data Contamination by Automatically Constructing Benchmarks with Updated Real-World Knowledgecited by 44
  3. 2024Can Large Language Models Identify Authorship?cited by 41
  4. 2025CoSER: A Comprehensive Literary Dataset and Framework for Training and Evaluating LLM Role-Playing and Persona Simulationcited by 26
  5. 2024Helpful assistant or fruitful facilitator? Investigating how personas affect language model behaviorcited by 21
  6. 2022COSPLAY: Concept Set Guided Personalized Dialogue Generation Across Both Party Personascited by 20
  7. 2024Learning Retrieval Augmentation for Personalized Dialogue Generationcited by 18
  8. 2025RAGs to Riches: RAG-like Few-shot Learning for Large Language Model Role-playingcited by 1

Built on by

Cited by year

Citing papers per year: 2025: 1.

1 paper.