mlsanityData to 14 Oct 2026

Stranger, Fan, or Peer? A Systematic Study on the Role of Interlocutor in Persona-Based Dialogue Generation

arXiv 2608.28467 ↗First posted 28 Aug 2026cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Persona-based dialogue systems are usually conditioned on speaker biography, but dialogues involve at least two participants, and who has access to whose biography can vary across training, inference, and evaluation. Prior work often neglected these aspects, obscuring mechanisms that only appear when biography visibility is toggled separately across training, inference, and evaluation, a three-stage factorisation that prior work has largely treated as a single factor. We study this factorisation on a dataset of dialogues paired with speaker's biographies, varying whether the target and interlocutor speakers see each other's biographies during training and inference, and using an LLM as a judge to perform author identification. We find that (i) training-time visibility, more than inference-time visibility, determines whether models express persona traits through dialogue or fall back on copying biographical text (a known problem/phenomenon in persona-based generation); (ii) models trained with interlocutor-biography visibility copy less target-biographical text than models trained without it, while changing visibility only at inference time has a less consistent effect; and (iii) under asymmetric disclosure, where only the interlocutor sees the target biography, target content leaks into interlocutor turns more often, and dialogues containing such traces are easier for the judge to identify, especially when interlocutor turns are visible. These results suggest that biography leakage into generated turns is an artefact of how interlocutor visibility is configured across training and inference, and separating the three stages is necessary.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 28 references that are in the map. First posted on arXiv 28 Aug 2026.

Builds on

18 of 28 references.

References · 18

  1. 2024The Llama 3 Herd of Modelscited by 14,715
  2. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
  3. 2020Extracting Training Data from Large Language Modelscited by 2,189
  4. 2024A Survey on LLM-as-a-Judgecited by 1,423
  5. 2022Ignore Previous Prompt: Attack Techniques For Language Modelscited by 832
  6. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
  7. 2024Scaling Synthetic Data Creation with 1,000,000,000 Personascited by 417
  8. 2024MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmarkcited by 372
  9. 2016A Persona-Based Neural Conversation Modelcited by 223
  10. 2024From Persona to Personalization: A Survey on Role-Playing Language Agentscited by 212
  11. 2019The Second Conversational Intelligence Challenge (ConvAI2)cited by 179
  12. 2024The Good, The Bad, and The Greedy: Evaluation of LLMs Should Not Ignore Non-Determinismcited by 116
6 more
  1. 2020You Impress Me: Dialogue Generation via Mutual Persona Perceptioncited by 85
  2. 2022Evaluating the Susceptibility of Pre-Trained Language Models via Handcrafted Adversarial Examplescited by 69
  3. 2022COSPLAY: Concept Set Guided Personalized Dialogue Generation Across Both Party Personascited by 20
  4. 2023PRODIGy: a PROfile-based DIalogue Generation datasetcited by 16
  5. 2021Partner Matters! An Empirical Study on Fusing Personas for Personalized Response Selection in Retrieval-Based Chatbotscited by 15
  6. 2025When Harry Meets Superman: The Role of The Interlocutor in Persona-Based Dialogue Generationcited by 4

Built on by

Not cited yet.