# The Dark Side of Ethical Robots

arXiv: https://arxiv.org/abs/1606.02583 · HTML: https://mlsanity.com/paper/1606.02583/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 8 Jun 2016.

## Built on by (most cited first, 5 of 5)

- [Rethinking Machine Ethics -- Can LLMs Perform Moral Reasoning through the Lens of Moral Theories?](https://mlsanity.com/paper/2308.15399/) (2023)
- [On the Current and Emerging Challenges of Developing Fair and Ethical AI Solutions in Financial Services](https://mlsanity.com/paper/2111.01306/) (2021)
- [Reflective Artificial Intelligence](https://mlsanity.com/paper/2301.10823/) (2023)
- [AI Risk Skepticism](https://mlsanity.com/paper/2105.02704/) (2021)
- [Ethics of Artificial Intelligence and Robotics in the Architecture, Engineering, and Construction Industry](https://mlsanity.com/paper/2310.05414/) (2023)

## Abstract (arXiv)

Concerns over the risks associated with advances in Artificial Intelligence have prompted calls for greater efforts toward robust and beneficial AI, including machine ethics. Recently, roboticists have responded by initiating the development of so-called ethical robots. These robots would, ideally, evaluate the consequences of their actions and morally justify their choices. This emerging field promises to develop extensively over the next years. However, in this paper, we point out an inherent limitation of the emerging field of ethical robots. We show that building ethical robots also necessarily facilitates the construction of unethical robots. In three experiments, we show that it is remarkably easy to modify an ethical robot so that it behaves competitively, or even aggressively. The reason for this is that the specific AI, required to make an ethical robot, can always be exploited to make unethical robots. Hence, the development of ethical robots will not guarantee the responsible deployment of AI. While advocating for ethical robots, we conclude that preventing the misuse of robots is beyond the scope of engineering, and requires instead governance frameworks underpinned by legislation. Without this, the development of ethical robots will serve to increase the risks of robotic malpractice instead of diminishing it.