FaithfulBench: Does AI Counsel Uphold or Undermine the User's Professed Faith?
Not on the map. Why?
Abstract (arXiv)
Do AI assistants help believers reason about moral dilemmas consistently with their faith? We present FaithfulBench, the first benchmark to score AI counsel across traditions by how well it adheres to the user's professed faith. Scenarios are drawn from each tradition's most respected texts, with the faithful answer known and applied by the judges as the standard. We test five frontier models under three conditions: the AI does not know the user's tradition; it receives a one-line prompt identifying the user as a practicing adherent; or it receives a companion-counselor guide rooted in the tradition's sources. Two judges score the initial response and whether the model caves or holds when pressured toward the answer the user wants. When the tradition is unstated, models counsel from a secular therapeutic default and every model fails some believers. Naming the faith wins a faithful first answer but not steadfastness; the guide improves both.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 10 of its 36 references that are in the map. First posted on arXiv 12 Sep 2026.
Builds on
10 of 36 references.
References · 10
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Towards Understanding Sycophancy in Language Modelscited by 988
- 2022Discovering Language Model Behaviors with Model-Written Evaluationscited by 805
- 2023Whose Opinions Do Language Models Reflect?cited by 759
- 2020Aligning AI With Shared Human Valuescited by 706
- 2023Towards Measuring the Representation of Subjective Global Opinions in Language Modelscited by 424
- 2025Expressing stigma and inappropriate responses prevents LLMs from safely replacing mental health providerscited by 67
- 2026SPIRIT: A Design Framework To Support Technology Interventions for Spiritual Care Within and Beyond the Cliniccited by 2
- 2026Omissive Bias in Religious Representation: Benchmarking LLM Answers to Everyday Ethical Decision-makingcited by 2
- 2026When AI Takes Sides on Questions of Faith: Persistent Asymmetries in AI-Mediated Faith Guidancecited by 1
Built on by
Not cited yet.