Should agentic conversational AI change how we think about ethics? Characterising an interactional ethics centred on respect
On the map: LLM reasoning → Reasoning benchmarks and evaluation
also in 1 more
Abstract (arXiv)
With the growing popularity of conversational agents based on large language models (LLMs), we need to ensure their behaviour is ethical and appropriate. Work in this area largely centres around the 'HHH' criteria: making outputs more helpful and honest, and avoiding harmful (biased, toxic, or inaccurate) statements. Whilst this semantic focus is useful when viewing LLM agents as mere mediums or output-generating systems, it fails to account for pragmatic factors that can make the same speech act seem more or less tactless or inconsiderate in different social situations. With the push towards agentic AI, wherein systems become increasingly proactive in chasing goals and performing actions in the world, considering the pragmatics of interaction becomes essential. We propose an interactional approach to ethics that is centred on relational and situational factors. We explore what it means for a system, as a social actor, to treat an individual respectfully in a (series of) interaction(s). Our work anticipates a set of largely unexplored risks at the level of situated social interaction, and offers practical suggestions to help agentic LLM technologies treat people well.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 11 of its 77 references that are in the map. First posted on arXiv 17 Jan 2024.
Builds on
11 of 77 references.
References · 11
- 2022Training a Helpful and Harmless Assistant with Reinforcement Learning from Human Feedbackcited by 3,634
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2015A Diversity-Promoting Objective Function for Neural Conversation Modelscited by 1,068
- 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,023
- 2023Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategiescited by 236
- 2021Alignment of Language Agentscited by 167
- 2024Agent AI: Surveying the Horizons of Multimodal Interactioncited by 167
- 2022Sociotechnical Harms of Algorithmic Systems: Scoping a Taxonomy for Harm Reductioncited by 137
- 2023Personalisation within bounds: A risk taxonomy and policy framework for the alignment of large language models with personalised feedbackcited by 86
- 2023Aligning Large Language Models with Human: A Surveycited by 31
- 2021Ethics of AI: A Systematic Literature Review of Principles and Challengescited by 18
Built on by
Citing papers per year: 2024: 2; 2025: 4; 2026: 2.
8 papers.
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Surveycited by 56
- 2025Why human-AI relationships need socioaffective alignmentcited by 47
- 2024Towards interactive evaluations for interaction harms in human-AI systemscited by 27
- 2025A Pragmatic View of AI Personhoodcited by 12
- 2024CURATe: Benchmarking Personalised Alignment of Conversational AI Assistantscited by 5
- 2025The Value of Gen-AI Conversations: A bottom-up Framework for AI Value Alignmentcited by 0
- 2026Evaluating Epistemic Guardrails in AI Reading Assistants: A Behavioral Audit of a Minimal Prototypecited by 0
- 2026AI Alignment and Fiduciary Obligationcited by 0
- 2026AI Alignment and Fiduciary Obligation1 Aug 2026
- 2026Evaluating Epistemic Guardrails in AI Reading Assistants: A Behavioral Audit of a Minimal Prototype30 Apr 2026
- 2025A Pragmatic View of AI Personhood30 Oct 2025
- 2025The Value of Gen-AI Conversations: A bottom-up Framework for AI Value Alignment26 Jun 2025
- 2025Evaluating LLM-based Agents for Multi-Turn Conversations: A Survey28 Mar 2025
- 2025Why human-AI relationships need socioaffective alignment4 Feb 2025
- 2024CURATe: Benchmarking Personalised Alignment of Conversational AI Assistants28 Oct 2024
- 2024Towards interactive evaluations for interaction harms in human-AI systems17 May 2024
Similar, not cited
Close in wording, no citation either way
- 2022In conversation with Artificial Intelligence: aligning language models with human values
- 2026A Scoping Review of the Ethical Perspectives on Anthropomorphising Large Language Model-Based Conversational Agents
- 2025Towards Ethical Multi-Agent Systems of Large Language Models: A Mechanistic Interpretability Perspective
- 2025Conversational Alignment with Artificial Intelligence in Context
- 2026Less Interaction But More Explanation: A Communication Perspective on Agentic AI Interfaces
- 2025Do as We Do, Not as You Think: the Conformity of Large Language Models
- 2025Agentic Large Language Models, a survey
- 2025Black Box Deployed -- Functional Criteria for Artificial Moral Agents in the LLM Era