mlsanityData to 14 Oct 2026

YNTP-100: A Benchmark for Your Next Token Prediction with 100 People

arXiv 2510.14398 ↗First posted 16 Oct 2025cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Large language models (LLMs) trained for general textitnext-token prediction often fail to generate responses that reflect how specific individuals communicate. Progress on personalized alignment is further limited by the difficulty of collecting real-world personal communication data due to privacy constraints. We propose Your Next Token Prediction (YNTP), a task that formulates personalized response generation as token-level prediction conditioned on user interaction history. We introduce YNTP-100, a benchmark built from multilingual multi-day human--agent conversations with 100 people, enabling systematic evaluation of user-specific response behavior. We evaluate external (parameter-preserving) and internal (parameter-updating) alignment methods using metrics of substance similarity and stylistic consistency. The dataset and results are publicly available at: https://github.com/AnonymousHub4Submissions/YNTP100.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 29 references that are in the map. First posted on arXiv 16 Oct 2025.

Builds on

18 of 29 references.

References · 18

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022Training language models to follow instructions with human feedbackcited by 15,971
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2023LaMP: When Large Language Models Meet Personalizationcited by 437
  6. 2023Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter Mergingcited by 280
  7. 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 201
  8. 2025Do LLMs Recognize Your Preferences? Evaluating Personalized Preference Following in LLMscited by 148
  9. 2024Personalized Language Modeling from Personalized Human Feedbackcited by 132
  10. 2024Optimization Methods for Personalizing Large Language Models through Retrieval Augmentationcited by 99
  11. 2024Aligner: Efficient Alignment by Learning to Correctcited by 98
  12. 2024PERSONA: A Reproducible Testbed for Pluralistic Alignmentcited by 73
6 more
  1. 2024Aligning LLMs with Individual Preferences via Interactioncited by 63
  2. 2024PAD: Personalized Alignment of LLMs at Decoding-Timecited by 60
  3. 2023Large Language Models for User Interest Journeyscited by 24
  4. 2025YoChameleon: Personalized Vision and Language Generationcited by 20
  5. 2024Step-Back Profiling: Distilling User History for Personalized Scientific Writingcited by 10
  6. 2024Beyond Retrieval: Generating Narratives in Conversational Recommender Systemscited by 8

Built on by

Not cited yet.