mlsanityData to 14 Oct 2026

HumAIne-Chatbot: Real-Time Personalized Conversational AI via Reinforcement Learning

arXiv 2509.04303 ↗First posted 4 Sep 2025cs.HC cs.AIcited by 1

On the map: Deep reinforcement learning methods → RL training of language and agent models

Abstract (arXiv)

Current conversational AI systems often provide generic, one-size-fits-all interactions that overlook individual user characteristics and lack adaptive dialogue management. To address this gap, we introduce HumAIne-chatbot, an AI-driven conversational agent that personalizes responses through a novel user profiling framework. The system is pre-trained on a diverse set of GPT-generated virtual personas to establish a broad prior over user types. During live interactions, an online reinforcement learning agent refines per-user models by combining implicit signals (e.g. typing speed, sentiment, engagement duration) with explicit feedback (e.g., likes and dislikes). This profile dynamically informs the chatbot dialogue policy, enabling real-time adaptation of both content and style. To evaluate the system, we performed controlled experiments with 50 synthetic personas in multiple conversation domains. The results showed consistent improvements in user satisfaction, personalization accuracy, and task achievement when personalization features were enabled. Statistical analysis confirmed significant differences between personalized and nonpersonalized conditions, with large effect sizes across key metrics. These findings highlight the effectiveness of AI-driven user profiling and provide a strong foundation for future real-world validation.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in RL training of language and agent models, one of 15 directions in Deep reinforcement learning methods. Builds on 14 of its 34 references that are in the map. First posted on arXiv 4 Sep 2025.

Builds on

14 of 34 references.

References · 14

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2016Deep Reinforcement Learning for Dialogue Generationcited by 288
  4. 2024Virtual Personas for Language Models via an Anthology of Backstoriescited by 51
  5. 2015A Survey of Available Corpora for Building Data-Driven Dialogue Systemscited by 33
  6. 2024Can Large Language Models Beat Wall Street? Unveiling the Potential of AI in Stock Selectioncited by 29
  7. 2020Spot The Bot: A Robust and Efficient Framework for the Evaluation of Conversational Dialogue Systemscited by 26
  8. 2023Transforming Sentiment Analysis in the Financial Domain with ChatGPTcited by 25
  9. 2024XAI for All: Can Large Language Models Simplify Explainable AI?cited by 21
  10. 2017Evaluating Quality of Chatbots and Intelligent Conversational Agentscited by 16
  11. 2021Designing Effective Interview Chatbots: Automatic Chatbot Profiling and Design Suggestion Generation for Chatbot Debuggingcited by 12
  12. 2025VirtualXAI: A User-Centric Framework for Explainability Assessment Leveraging GPT-Generated Personascited by 5
2 more
  1. 2018Beyond Patient Monitoring: Conversational Agents Role in Telemedicine & Healthcare Support For Home-Living Elderly Individualscited by 3
  2. 2024FairyLandAI: Personalized Fairy Tales utilizing ChatGPT and DALLE-3cited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025PersonaMem-v2: Towards Personalized Intelligence via Learning Implicit User Personas and Agentic Memory
  2. 2025Enhancing Personalized Multi-Turn Dialogue with Curiosity Reward
  3. 2025PersonaLens: A Benchmark for Personalization Evaluation in Conversational AI Assistants
  4. 2025Humanlike Multi-user Agent (HUMA): Designing a Deceptively Human AI Facilitator for Group Chats
  5. 2025The Era of Real-World Human Interaction: RL from User Conversations
  6. 2025REALTALK: A 21-Day Real-World Dataset for Long-Term Conversation
  7. 2025SynthesizeMe! Inducing Persona-Guided Prompts for Personalized Reward Models in LLMs
  8. 2026OP-Bench: Benchmarking Over-Personalization for Memory-Augmented Personalized Conversational Agents