mlsanityData to 14 Oct 2026

ConvoDrift: A Multi-Turn Conversational Dataset for Modeling Stylistic Tone Evolution

arXiv 2610.02873 ↗First posted 2 Oct 2026cs.CL cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

The evolution of linguistic style in conversations is an underexplored issue in NLP. Most style-control datasets focus on sentences or assume a static style throughout, missing the dynamic shifts that occur as user preferences change during interactions. We introduce ConvoDrift, a dataset designed to model progressive stylistic conversational tone drift under fixed semantic intent. It is built on 15,727 shared multi-turn conversational structures for adaptation and persona-conditioned alignment methods. It consists of six prompt-response pairs per conversation, each with the annotation of style drift and style direction labels. These pairs cover a range of communication genres. We further derive a complementary pairwise dataset by pairing semantically equivalent but stylistically distinct responses and annotating persona-conditioned preferences using five distinct style communication personas, enabling the controlled study of personalisation and pluralistic alignment in language tone. In addition to dataset construction, we conduct a comprehensive evaluation involving human validation, LLM-as-judge assessment, and automatic lexical and semantic evaluations. Across seven Likert criteria annotated by three human annotators, the average Krippendorff's alpha is 0.88, and our lexical and semantic analyses show that drift events induce lexical changes while preserving semantic similarity.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 30 references that are in the map. First posted on arXiv 2 Oct 2026.

Builds on

21 of 30 references.

References · 21

  1. 2022Training language models to follow instructions with human feedbackcited by 15,971
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2019Fine-Tuning Language Models from Human Preferencescited by 2,150
  5. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
  6. 2017Toward Controlled Generation of Textcited by 272
  7. 2017Style Transfer from Non-Parallel Text by Cross-Alignmentcited by 248
  8. 2016A Persona-Based Neural Conversation Modelcited by 223
  9. 2018Dear Sir or Madam, May I introduce the GYAFC Dataset: Corpus, Benchmarks and Metrics for Formality Style Transfercited by 211
  10. 2024Personalizing Reinforcement Learning from Human Feedback with Variational Preference Learningcited by 155
  11. 2017Controlling Linguistic Style Aspects in Neural Language Generationcited by 149
  12. 2017Style Transfer in Text: Exploration and Evaluationcited by 146
9 more
  1. 2013A Computational Approach to Politeness with Application to Social Factorscited by 106
  2. 2024RLHF from Heterogeneous Feedback via Personalization and Preference Aggregationcited by 74
  3. 2018Polite Dialogue Generation Without Parallel Datacited by 59
  4. 2025PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistantscited by 48
  5. 2023Everyone Deserves A Reward: Learning Customized Human Preferencescited by 43
  6. 2017Personalization in Goal-Oriented Dialogcited by 29
  7. 2025Teaching Language Models to Evolve with Users: Dynamic Profile Modeling for Personalized Alignmentcited by 24
  8. 2020Contextual Text Style Transfercited by 17
  9. 2025PicPersona-TOD : A Dataset for Personalizing Utterance Style in Task-Oriented Dialogue with Image Personacited by 2

Built on by

Not cited yet.