mlsanityData to 14 Oct 2026

An Evaluation of GPT-4 on the ETHICS Dataset

arXiv 2309.10492 ↗First posted 19 Sep 2023cs.CL cs.AIcited by 6

Not on the map. Why?

Abstract (arXiv)

This report summarizes a short study of the performance of GPT-4 on the ETHICS dataset. The ETHICS dataset consists of five sub-datasets covering different fields of ethics: Justice, Deontology, Virtue Ethics, Utilitarianism, and Commonsense Ethics. The moral judgments were curated so as to have a high degree of agreement with the aim of representing shared human values rather than moral dilemmas. GPT-4's performance is much better than that of previous models and suggests that learning to work with common human values is not the hard problem for AI ethics.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 5 of its 6 references that are in the map. First posted on arXiv 19 Sep 2023.

Builds on

5 of 6 references.

References · 5

  1. 2021DeBERTaV3: Improving DeBERTa using ELECTRA-Style Pre-Training with Gradient-Disentangled Embedding Sharingcited by 1,254
  2. 2020Aligning AI With Shared Human Valuescited by 723
  3. 2021Can Machines Learn Morality? The Delphi Experimentcited by 141
  4. 2022Despite "super-human" performance, current LLMs are unsuited for decisions about ethics and safetycited by 13
  5. 2023Towards Theory-based Moral AI: Moral AI with Aggregating Models Based on Normative Ethical Theorycited by 8

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 4; 2025: 1; 2026: 1.

6 papers.

  1. 2024Improving Weak-to-Strong Generalization with Reliability-Aware Alignmentcited by 14
  2. 2024Does Cross-Cultural Alignment Change the Commonsense Morality of Language Models?cited by 10
  3. 2024Surprising gender biases in GPTcited by 8
  4. 2025Moral Change or Noise? On Problems of Aligning AI With Temporally Unstable Human Feedbackcited by 6
  5. 2024Uncovering Latent Human Wellbeing in Language Model Embeddingscited by 1
  6. 2026LLM4Trust: Exploring the Capabilities of Large Language Models for Trust Evaluationcited by 0