LLM Ethics Benchmark: A Three-Dimensional Assessment System for Evaluating Moral Reasoning in Large Language Models
Not on the map. Why?
Abstract (arXiv)
This study establishes a novel framework for systematically evaluating the moral reasoning capabilities of large language models (LLMs) as they increasingly integrate into critical societal domains. Current assessment methodologies lack the precision needed to evaluate nuanced ethical decision-making in AI systems, creating significant accountability gaps. Our framework addresses this challenge by quantifying alignment with human ethical standards through three dimensions: foundational moral principles, reasoning robustness, and value consistency across diverse scenarios. This approach enables precise identification of ethical strengths and weaknesses in LLMs, facilitating targeted improvements and stronger alignment with societal values. To promote transparency and collaborative advancement in ethical AI development, we are publicly releasing both our benchmark datasets and evaluation codebase at https://github.com/ The-Responsible-AI-Initiative/LLM_Ethics_Benchmark.git.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 1 May 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 6; 2026: 15.
21 papers.
Sort:
By area:
- 2026From RAG to Agentic RAG for Faithful Islamic Question Answeringcited by 9
- 2026The Fragility Of Moral Judgment In Large Language Modelscited by 8
- 2025EvalMORAAL: Interpretable Chain-of-Thought and LLM-as-Judge Evaluation for Moral Alignment in Large Language Modelscited by 6
- 2026Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interestcited by 3
- 2025The Moral Consistency Pipeline: Continuous Ethical Evaluation for Large Language Modelscited by 2
- 2026PoliticsBench: Benchmarking Political Values in Large Language Models with Multi-Turn Roleplaycited by 2
- 2026Agent-ValueBench: A Comprehensive Benchmark for Evaluating Agent Valuescited by 2
- 2026What Does the AI Doctor Value? Auditing Pluralism in the Clinical Ethics of Language Modelscited by 2
- 2025Dissecting Role Cognition in Medical LLMs via Neuronal Ablationcited by 1
- 2025BengaliMoralBench: A Benchmark for Auditing Moral Reasoning in Large Language Models within Bengali Language and Culturecited by 1
- 2026Reasoning or Rhetoric? An Empirical Analysis of Moral Reasoning Explanations in Large Language Modelscited by 1
- 2026The yes-no bias of large language models reflects answer order and wording, not shifts in moral judgmentcited by 1
9 more
- 2025EPT Benchmark: Evaluation of Persian Trustworthiness in Large Language Modelscited by 0
- 2025CogniAlign: Survivability-Grounded Multi-Agent Moral Reasoning for Safe and Transparent AIcited by 0
- 2026Assessing and Explaining the Persuadability of Large Language Models as Legal Decision Toolscited by 0
- 2026An Ethical eValuation Agent (EeVA): Results of a Proof-of-Concept Test on a Prototype Agentic-like Workflow to Assist Ethical Deliberationscited by 0
- 2026Are LLMs Bad at Moral Reasoning?cited by 0
- 2026Toward Human Rights Benchmarking for LLMs: A Pilot Methodologycited by 0
- 2026Moral Competence Before Moral Content: Why LLM Agents Lack the Prerequisites for Coherent Alignmentcited by 0
- 2026How do LLMs Evaluate Perceived Moral Agency? Investigating Moral Decision-Making in Human-Artificial Agents Interactionscited by 0
- 2026GesBench: When and Where Do Multimodal Language Models Perceive Social Meaning?cited by 0
- 2026GesBench: When and Where Do Multimodal Language Models Perceive Social Meaning?10 Oct 2026
- 2026How do LLMs Evaluate Perceived Moral Agency? Investigating Moral Decision-Making in Human-Artificial Agents Interactions4 Sep 2026
- 2026Moral Competence Before Moral Content: Why LLM Agents Lack the Prerequisites for Coherent Alignment4 Sep 2026
- 2026Toward Human Rights Benchmarking for LLMs: A Pilot Methodology10 Aug 2026
- 2026The yes-no bias of large language models reflects answer order and wording, not shifts in moral judgment6 Jul 2026
- 2026Are LLMs Bad at Moral Reasoning?10 Jun 2026
- 2026What Does the AI Doctor Value? Auditing Pluralism in the Clinical Ethics of Language Models18 May 2026
- 2026Agent-ValueBench: A Comprehensive Benchmark for Evaluating Agent Values11 May 2026
- 2026An Ethical eValuation Agent (EeVA): Results of a Proof-of-Concept Test on a Prototype Agentic-like Workflow to Assist Ethical Deliberations5 May 2026
- 2026Assessing and Explaining the Persuadability of Large Language Models as Legal Decision Tools29 Apr 2026
- 2026Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interest9 Apr 2026
- 2026PoliticsBench: Benchmarking Political Values in Large Language Models with Multi-Turn Roleplay25 Mar 2026
9 more
- 2026Reasoning or Rhetoric? An Empirical Analysis of Moral Reasoning Explanations in Large Language Models23 Mar 2026
- 2026The Fragility Of Moral Judgment In Large Language Models5 Mar 2026
- 2026From RAG to Agentic RAG for Faithful Islamic Question Answering12 Jan 2026
- 2025The Moral Consistency Pipeline: Continuous Ethical Evaluation for Large Language Models2 Dec 2025
- 2025BengaliMoralBench: A Benchmark for Auditing Moral Reasoning in Large Language Models within Bengali Language and Culture5 Nov 2025
- 2025Dissecting Role Cognition in Medical LLMs via Neuronal Ablation28 Oct 2025
- 2025EvalMORAAL: Interpretable Chain-of-Thought and LLM-as-Judge Evaluation for Moral Alignment in Large Language Models7 Oct 2025
- 2025CogniAlign: Survivability-Grounded Multi-Agent Moral Reasoning for Safe and Transparent AI14 Sep 2025
- 2025EPT Benchmark: Evaluation of Persian Trustworthiness in Large Language Models8 Sep 2025
- 2026From RAG to Agentic RAG for Faithful Islamic Question Answeringcited by 9
- 2026Agent-ValueBench: A Comprehensive Benchmark for Evaluating Agent Valuescited by 2
- 2025CogniAlign: Survivability-Grounded Multi-Agent Moral Reasoning for Safe and Transparent AIcited by 0
- 2026An Ethical eValuation Agent (EeVA): Results of a Proof-of-Concept Test on a Prototype Agentic-like Workflow to Assist Ethical Deliberationscited by 0
- 2026Moral Competence Before Moral Content: Why LLM Agents Lack the Prerequisites for Coherent Alignmentcited by 0
- 2026How do LLMs Evaluate Perceived Moral Agency? Investigating Moral Decision-Making in Human-Artificial Agents Interactionscited by 0
- 2026How do LLMs Evaluate Perceived Moral Agency? Investigating Moral Decision-Making in Human-Artificial Agents Interactions4 Sep 2026
- 2026Moral Competence Before Moral Content: Why LLM Agents Lack the Prerequisites for Coherent Alignment4 Sep 2026
- 2026Agent-ValueBench: A Comprehensive Benchmark for Evaluating Agent Values11 May 2026
- 2026An Ethical eValuation Agent (EeVA): Results of a Proof-of-Concept Test on a Prototype Agentic-like Workflow to Assist Ethical Deliberations5 May 2026
- 2026From RAG to Agentic RAG for Faithful Islamic Question Answering12 Jan 2026
- 2025CogniAlign: Survivability-Grounded Multi-Agent Moral Reasoning for Safe and Transparent AI14 Sep 2025
- 2025EvalMORAAL: Interpretable Chain-of-Thought and LLM-as-Judge Evaluation for Moral Alignment in Large Language Modelscited by 6
- 2025Dissecting Role Cognition in Medical LLMs via Neuronal Ablationcited by 1
- 2025BengaliMoralBench: A Benchmark for Auditing Moral Reasoning in Large Language Models within Bengali Language and Culturecited by 1
- 2026Reasoning or Rhetoric? An Empirical Analysis of Moral Reasoning Explanations in Large Language Modelscited by 1
- 2026Are LLMs Bad at Moral Reasoning?cited by 0
- 2026Are LLMs Bad at Moral Reasoning?10 Jun 2026
- 2026Reasoning or Rhetoric? An Empirical Analysis of Moral Reasoning Explanations in Large Language Models23 Mar 2026
- 2025BengaliMoralBench: A Benchmark for Auditing Moral Reasoning in Large Language Models within Bengali Language and Culture5 Nov 2025
- 2025Dissecting Role Cognition in Medical LLMs via Neuronal Ablation28 Oct 2025
- 2025EvalMORAAL: Interpretable Chain-of-Thought and LLM-as-Judge Evaluation for Moral Alignment in Large Language Models7 Oct 2025
- 2026The Fragility Of Moral Judgment In Large Language Modelscited by 8
- 2026Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interestcited by 3
- 2025The Moral Consistency Pipeline: Continuous Ethical Evaluation for Large Language Modelscited by 2
- 2026PoliticsBench: Benchmarking Political Values in Large Language Models with Multi-Turn Roleplaycited by 2
- 2026What Does the AI Doctor Value? Auditing Pluralism in the Clinical Ethics of Language Modelscited by 2
- 2026The yes-no bias of large language models reflects answer order and wording, not shifts in moral judgmentcited by 1
- 2025EPT Benchmark: Evaluation of Persian Trustworthiness in Large Language Modelscited by 0
- 2026Assessing and Explaining the Persuadability of Large Language Models as Legal Decision Toolscited by 0
- 2026Toward Human Rights Benchmarking for LLMs: A Pilot Methodologycited by 0
- 2026Toward Human Rights Benchmarking for LLMs: A Pilot Methodology10 Aug 2026
- 2026The yes-no bias of large language models reflects answer order and wording, not shifts in moral judgment6 Jul 2026
- 2026What Does the AI Doctor Value? Auditing Pluralism in the Clinical Ethics of Language Models18 May 2026
- 2026Assessing and Explaining the Persuadability of Large Language Models as Legal Decision Tools29 Apr 2026
- 2026Ads in AI Chatbots? An Analysis of How Large Language Models Navigate Conflicts of Interest9 Apr 2026
- 2026PoliticsBench: Benchmarking Political Values in Large Language Models with Multi-Turn Roleplay25 Mar 2026
- 2026The Fragility Of Moral Judgment In Large Language Models5 Mar 2026
- 2025The Moral Consistency Pipeline: Continuous Ethical Evaluation for Large Language Models2 Dec 2025
- 2025EPT Benchmark: Evaluation of Persian Trustworthiness in Large Language Models8 Sep 2025