# Responsible Personalisation: The Double-Edged Sword of Personalisation in Human-Robot Interaction

arXiv: https://arxiv.org/abs/2607.06344 · HTML: https://mlsanity.com/paper/2607.06344/

## Key facts

- No citing papers in the map yet (data through 14 Oct 2026).
- Builds on 28 of its 213 references that are in the map.
- First posted on arXiv 7 Jul 2026.

## Builds on (most cited first, 28 of 28)

- [Fairness And Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, And Mitigation Strategies](https://mlsanity.com/paper/2304.07683/) (2023)
- [Stereotype or Personalization? User Identity Biases Chatbot Recommendations](https://mlsanity.com/paper/2410.05613/) (2024)
- [Robotic Vision for Human-Robot Interaction and Collaboration: A Survey and Systematic Review](https://mlsanity.com/paper/2307.15363/) (2023)
- [Reading Between the Prompts: How Stereotypes Shape LLM's Implicit Personalization](https://mlsanity.com/paper/2505.16467/) (2025)
- [LLM-Driven Robots Risk Enacting Discrimination, Violence, and Unlawful Actions](https://mlsanity.com/paper/2406.08824/) (2024)
- [Computers as Bad Social Actors: Dark Patterns and Anti-Patterns in Interfaces that Act Socially](https://mlsanity.com/paper/2302.04720/) (2023)
- [Robots Enact Malignant Stereotypes](https://mlsanity.com/paper/2207.11569/) (2022)
- [VITA: A Multi-modal LLM-based System for Longitudinal, Autonomous, and Adaptive Robotic Mental Well-being Coaching](https://mlsanity.com/paper/2312.09740/) (2023)
- [Applying General Turn-taking Models to Conversational Human-Robot Interaction](https://mlsanity.com/paper/2501.08946/) (2025)
- [Embodiment in Socially Interactive Robots](https://mlsanity.com/paper/1912.00312/) (2019)
- [I am Definitely Manipulated, Even When I am Aware of it. It s Ridiculous! -- Dark Patterns from the End-User Perspective](https://mlsanity.com/paper/2104.12653/) (2021)
- [Not Only WEIRD but "Uncanny"? A Systematic Review of Diversity in Human-Robot Interaction Research](https://mlsanity.com/paper/2304.08750/) (2023)
- [The Sense of Agency in Assistive Robotics Using Shared Autonomy](https://mlsanity.com/paper/2501.07462/) (2025)
- [Understanding Generative AI Risks for Youth: A Taxonomy Based on Empirical Data](https://mlsanity.com/paper/2502.16383/) (2025)
- [A Survey on End-User Robot Programming](https://mlsanity.com/paper/2105.01757/) (2021)
- [Liability regimes in the age of AI: a use-case driven analysis of the burden of proof](https://mlsanity.com/paper/2211.01817/) (2022)
- [How to be Helpful? Supportive Behaviors and Personalization for Human-Robot Collaboration](https://mlsanity.com/paper/1710.11194/) (2017)
- [Learning on the Job: Long-Term Behavioural Adaptation in Human-Robot Interactions](https://mlsanity.com/paper/2203.10518/) (2022)
- [Understanding Factors that Shape Children's Long Term Engagement with an In-Home Learning Companion Robot](https://mlsanity.com/paper/2205.09052/) (2022)
- [Evaluating the Impact of Personalized Value Alignment in Human-Robot Interaction: Insights into Trust and Team Performance Outcomes](https://mlsanity.com/paper/2311.16051/) (2023)
- [Read the Room: Adapting a Robot's Voice to Ambient and Social Contexts](https://mlsanity.com/paper/2205.04952/) (2022)
- [On the impact of robot personalization on human-robot interaction: A review](https://mlsanity.com/paper/2401.11776/) (2024)
- [Identifying Reasons for Bias: An Argumentation-Based Approach](https://mlsanity.com/paper/2310.16506/) (2023)
- [Robots in the Wild: Contextually-Adaptive Human-Robot Interactions in Urban Public Environments](https://mlsanity.com/paper/2412.04728/) (2024)
- [Preserving Sense of Agency: User Preferences for Robot Autonomy and User Control across Household Tasks](https://mlsanity.com/paper/2506.19202/) (2025)
- [Privacy Perceptions in Robot-Assisted Well-Being Coaching: Examining the Roles of Information Transparency, User Control, and Proactivity](https://mlsanity.com/paper/2509.04358/) (2025)
- [Human Autonomy and Sense of Agency in Human-Robot Interaction: A Systematic Literature Review](https://mlsanity.com/paper/2509.22271/) (2025)
- [From Human Bias to Robot Choice: How Occupational Contexts and Racial Priming Shape Robot Selection](https://mlsanity.com/paper/2512.20951/) (2025)

## Abstract (arXiv)

While personalisation is becoming a defining capability in human-robot interaction (HRI), the existing literature on responsible personalisation remains fragmented, offering isolated accounts of ethical risks without a structured understanding of how they emerge across interaction contexts. This gap is particularly critical in HRI, where robots' embodiment and social presence can amplify and reshape such risks or generate new types of risks. We present a lifecycle-based and context-sensitive framework for personalised HRI, grounded in an embodiment-aware perspective. The framework combines stages of the personalisation process with interaction characteristics (short-term vs. long-term, open-domain vs. closed-domain), enabling systematic analysis of how risks arise and evolve. Building on this, we conduct an integrative analysis of key ethical risks, including autonomy erosion, biased user modelling, manipulation, dehumanisation, and privacy violations, and examine how they manifest across contexts. We translate these insights into actionable design recommendations and outline open research challenges. By structuring both the design space and risk landscape of personalised HRI, this work provides a foundation for more systematic, transparent, and ethically grounded approaches to personalised robot behaviour.