EthicMind: A Risk-Aware Framework for Ethical-Emotional Alignment in Multi-Turn Dialogue
Not on the map. Why?
Abstract (arXiv)
Intelligent dialogue systems are increasingly deployed in emotionally and ethically sensitive settings, where failures in either emotional attunement or ethical judgment can cause significant harm. Existing dialogue models typically address empathy and ethical safety in isolation, and often fail to adapt their behavior as ethical risk and user emotion evolve across multi-turn interactions. We formulate ethical-emotional alignment in dialogue as an explicit turn-level decision problem, and propose textscEthicMind, a risk-aware framework that implements this formulation in multi-turn dialogue at inference time. At each turn, textscEthicMind jointly analyzes ethical risk signals and user emotion, plans a high-level response strategy, and generates context-sensitive replies that balance ethical guidance with emotional engagement, without requiring additional model training. To evaluate alignment behavior under ethically complex interactions, we introduce a risk-stratified, multi-turn evaluation protocol with a context-aware user simulation procedure. Experimental results show that textscEthicMind achieves more consistent ethical guidance and emotional engagement than competitive baselines, particularly in high-risk and morally ambiguous scenarios.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 36 references that are in the map. First posted on arXiv 10 Apr 2026.
Builds on
22 of 36 references.
References · 22
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2020RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Modelscited by 1,235
- 2022Red Teaming Language Models with Language Modelscited by 983
- 2022ToxiGen: A Large-Scale Machine-Generated Dataset for Adversarial and Implicit Hate Speech Detectioncited by 419
- 2021Towards Emotional Support Dialog Systemscited by 294
- 2019Build it Break it Fix it for Dialogue Safety: Robustness from Adversarial Human Attackcited by 176
- 2020Recipes for Safety in Open-domain Chatbotscited by 168
- 2017Emotional Chatting Machine: Emotional Conversation Generation with Internal and External Memorycited by 167
- 2022SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualizationcited by 166
- 2024LLM Defenses Are Not Robust to Multi-Turn Human Jailbreaks Yetcited by 145
- 2022ProsocialDialog: A Prosocial Backbone for Conversational Agentscited by 109
10 more
- 2024Language Models are Homer Simpson! Safety Re-Alignment of Fine-tuned Language Models through Task Arithmeticcited by 105
- 2018EmotionLines: An Emotion Corpus of Multi-Party Conversationscited by 80
- 2025Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providerscited by 67
- 2024Can Large Language Models be Good Emotional Supporter? Mitigating Preference Bias on Emotional Support Conversationcited by 55
- 2024CoSafe: Evaluating Large Language Model Safety in Multi-Turn Dialogue Coreferencecited by 51
- 2024From Lived Experience to Insight: Unpacking the Psychological Risks of Using AI Conversational Agentscited by 25
- 2025Curiosity-Driven Reinforcement Learning from Human Feedbackcited by 14
- 2024The Illusion of Empathy: How AI Chatbots Shape Conversation Perceptioncited by 12
- 2023Sibyl: Empowering Empathetic Dialogue Generation in Large Language Models via Sensible and Visionary Commonsense Inferencecited by 9
- 2024Empathy Level Alignment via Reinforcement Learning for Empathetic Response Generationcited by 8
Built on by
Not cited yet.