mlsanityData to 14 Oct 2026

PicPersona-TOD : A Dataset for Personalizing Utterance Style in Task-Oriented Dialogue with Image Persona

arXiv 2504.17390 ↗First posted 24 Apr 2025cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Task-Oriented Dialogue (TOD) systems are designed to fulfill user requests through natural language interactions, yet existing systems often produce generic, monotonic responses that lack individuality and fail to adapt to users' personal attributes. To address this, we introduce PicPersona-TOD, a novel dataset that incorporates user images as part of the persona, enabling personalized responses tailored to user-specific factors such as age or emotional context. This is facilitated by first impressions, dialogue policy-guided prompting, and the use of external knowledge to reduce hallucinations. Human evaluations confirm that our dataset enhances user experience, with personalized responses contributing to a more engaging interaction. Additionally, we introduce a new NLG model, Pictor, which not only personalizes responses, but also demonstrates robust performance across unseen domains https://github.com/JihyunLee1/PicPersona.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 48 of its 68 references that are in the map. First posted on arXiv 24 Apr 2025.

Builds on

48 of 68 references.

References · 48

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2024The Llama 3 Herd of Modelscited by 14,715
  4. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,599
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  6. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  7. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
  8. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  9. 2018Personalizing Dialogue Agents: I have a dog, do you have pets too?cited by 828
  10. 2018MultiWOZ -- A Large-Scale Multi-Domain Wizard-of-Oz Dataset for Task-Oriented Dialogue Modellingcited by 766
  11. 2018MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversationscited by 643
  12. 2020GoEmotions: A Dataset of Fine-Grained Emotionscited by 486
36 more
  1. 2019Towards Scalable Multi-domain Conversational Agents: The Schema-Guided Dialogue Datasetcited by 434
  2. 2020A Simple Language Model for Task-Oriented Dialoguecited by 332
  3. 2016A Network-based End-to-End Trainable Task-oriented Dialogue Systemcited by 252
  4. 2019Transferable Multi-Domain State Generator for Task-Oriented Dialogue Systemscited by 216
  5. 2020MultiWOZ 2.2 : A Dialogue Dataset with Additional Annotation Corrections and State Tracking Baselinescited by 204
  6. 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualizationcited by 168
  7. 2024TinyLLaVA: A Framework of Small-scale Large Multimodal Modelscited by 164
  8. 2021Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue Systemcited by 139
  9. 2017Key-Value Retrieval Networks for Task-Oriented Dialoguecited by 138
  10. 2020UBAR: Towards Fully End-to-End Task-Oriented Dialog Systems with GPT-2cited by 111
  11. 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
  12. 2020MinTL: Minimalist Transfer Learning for Task-Oriented Dialogue Systemscited by 103
  13. 2021Dialogue State Tracking with a Language Model using Schema-Driven Promptingcited by 94
  14. 2021Action-Based Conversations Dataset: A Corpus for Building More In-Depth Task-Oriented Dialogue Systemscited by 75
  15. 2019Personalized Dialogue Generation with Diversified Traitscited by 74
  16. 2020SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teachingcited by 71
  17. 2018Building a Conversational Agent Overnight with Dialogue Self-Playcited by 70
  18. 2016AVEC 2016 - Depression, Mood, and Emotion Recognition Workshop and Challengecited by 69
  19. 2021SIMMC 2.0: A Task-oriented Dialog Dataset for Immersive Multimodal Conversationscited by 56
  20. 2020Towards Persona-Based Empathetic Conversational Modelscited by 53
  21. 2020Adding Chit-Chat to Enhance Task-Oriented Dialoguescited by 48
  22. 2023Conversation Chronicles: Towards Diverse Temporal and Relational Dynamics in Multi-Session Conversationscited by 47
  23. 2020STAR: A Schema-Guided Dialog Dataset for Transfer Learningcited by 44
  24. 2023Dialogue Chain-of-Thought Distillation for Commonsense-aware Conversational Agentscited by 41
  25. 2017Personalization in Goal-Oriented Dialogcited by 29
  26. 2021Fusing task-oriented and open-domain dialogues in conversational agentscited by 28
  27. 2023MPCHAT: Towards Multimodal Persona-Grounded Conversationcited by 24
  28. 2022DialogCC: An Automated Pipeline for Creating High-Quality Multi-Modal Dialogue Datasetcited by 17
  29. 2024SynthDST: Synthetic Data is All You Need for Few-Shot Dialog State Trackingcited by 17
  30. 2024Pearl: A Review-driven Persona-Knowledge Grounded Conversational Recommendation Datasetcited by 16
  31. 2017Assigning personality/identity to a chatting machine for coherent conversation generationcited by 10
  32. 2021Database Search Results Disambiguation for Task-Oriented Dialog Systemscited by 10
  33. 2022KRLS: Improving End-to-End Response Generation in Task Oriented Dialog with Reinforced Keywords Learningcited by 9
  34. 2023EmoUS: Simulating User Emotions in Task-Oriented Dialoguescited by 9
  35. 2024Infusing Emotions into Task-oriented Dialogue Systems: Understanding, Management, and Generationcited by 5
  36. 2024Chitchat as Interference: Adding User Backstories to Task-Oriented Dialoguescited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

  1. 2025PanicToCalm: A Proactive Counseling Agent for Panic Attackscited by 1
  2. 2026ConvoDrift: A Multi-Turn Conversational Dataset for Modeling Stylistic Tone Evolutioncited by 0