mlsanityData to 14 Oct 2026

PILOT: Steering Synthetic Data Generation with Psychological & Linguistic Output Targeting

arXiv 2509.15447 ↗First posted 18 Sep 2025cs.CL cs.AIcited by 0

On the map: Synthetic data and self-improvement for LLMs → LLM synthetic data generation

Abstract (arXiv)

Generative AI applications commonly leverage user personas as a steering mechanism for synthetic data generation, but reliance on natural language representations forces models to make unintended inferences about which attributes to emphasize, limiting precise control over outputs. We introduce PILOT (Psychological and Linguistic Output Targeting), a two-phase framework for steering large language models with structured psycholinguistic profiles. In Phase 1, PILOT translates natural language persona descriptions into multidimensional profiles with normalized scores across linguistic and psychological dimensions. In Phase 2, these profiles guide generation along measurable axes of variation. We evaluate PILOT across three state-of-the-art LLMs (Mistral Large 2, Deepseek-R1, LLaMA 3.3 70B) using 25 synthetic personas under three conditions: Natural-language Persona Steering (NPS), Schema-Based Steering (SBS), and Hybrid Persona-Schema Steering (HPS). Results demonstrate that schema-based approaches significantly reduce artificial-sounding persona repetition while improving output coherence, with silhouette scores increasing from 0.098 to 0.237 and topic purity from 0.773 to 0.957. Our analysis reveals a fundamental trade-off: SBS produces more concise outputs with higher topical consistency, while NPS offers greater lexical diversity but reduced predictability. HPS achieves a balance between these extremes, maintaining output variety while preserving structural consistency. Expert linguistic evaluation confirms that PILOT maintains high response quality across all conditions, with no statistically significant differences between steering approaches.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in LLM synthetic data generation, one of 13 directions in Synthetic data and self-improvement for LLMs. Builds on 11 of its 27 references that are in the map. First posted on arXiv 18 Sep 2025.

Builds on

11 of 27 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personas28 Jun

Other references · 10

  1. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,915
  2. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  3. 2023PersonaLLM: Investigating the Ability of Large Language Models to Express Personality Traitscited by 234
  4. 2024Hello Again! LLM-powered Personalized Agent for Long-term Dialoguecited by 123
  5. 2019Learning to Speak and Act in a Fantasy Text Adventure Gamecited by 122
  6. 2024PersonaGym: Evaluating Persona Agents and LLMscited by 97
  7. 2020Politeness Transfer: A Tag and Generate Approachcited by 78
  8. 2024Evaluating Large Language Model Biases in Persona-Steered Generationcited by 78
  9. 2023AI Text-to-Behavior: A Study In Steerabilitycited by 11
  10. 2023On the Effectiveness of Creating Conversational Agent Personalities Through Promptingcited by 10

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025DeepPersona: A Generative Engine for Scaling Deep Synthetic Personas
  2. 2025Measuring Lexical Diversity of Synthetic Data Generated through Fine-Grained Persona Prompting
  3. 2026Extracting Persona Subspaces Through Iterative Nullspace Projection For Modulation
  4. 2024PERSONA: A Reproducible Testbed for Pluralistic Alignment
  5. 2025Whose Personae? Synthetic Persona Experiments in LLM Research and Pathways to Transparency
  6. 2023Faithful Persona-based Conversational Dataset Generation with Large Language Models
  7. 2025Persona-Based Synthetic Data Generation Using Multi-Stage Conditioning with Large Language Models for Emotion Recognition
  8. 2026Synthetic Interaction Data for Scalable Personalization in Large Language Models