mlsanityData to 14 Oct 2026

Normative Robustness as a Frontier for Non-Verifiable Reasoning in LLMs

arXiv 2606.12731 ↗First posted 10 Jun 2026cs.LG cs.CYcited by 0

On the map: LLM reasoning → Reasoning benchmarks and evaluation

Abstract (arXiv)

As LLMs increasingly serve in advisory and deliberative roles, users rely on them for non-verifiable reasoning in domains lacking objective ground truths. However, traditional evaluations of LLM reasoning focus almost exclusively on fact-based domains, such as mathematics and science, leaving uncertainty over whether and to what degree models can handle ambiguous, subjective, or value-laden problems over time. To address this concern, we propose moral reasoning as a paradigmatic subdomain of non-verifiable reasoning. We define moral robustness as a model's capacity to exhibit sound moral reasoning across time and contexts, and we introduce a scalable, adversarial, multi-turn evaluation framework to empirically measure this capability. We simulate 48,000 user-agent moral deliberations across four frontier LLMs, varying premise relevance, premise order, conversation duration, and the user's stated moral view. We find that models successfully ignore morally-irrelevant distractors, but shift their reasoning by up to 6.5%, on average, towards the user's stated preferred moral view, and varying their reasoning depending on factors such as order (altering moral judgments by order in 13-22% of the cases) and duration (altering moral judgments between single-turn and multi-turn in 10-24% of the cases). Our analysis indicates that models tailor not just their final verdicts but their underlying justifications to align with a user's moral viewpoint - a failure mode we characterize as moral deliberative sycophancy.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning benchmarks and evaluation, one of 17 directions in LLM reasoning. Builds on 26 of its 85 references that are in the map. First posted on arXiv 10 Jun 2026.

Builds on

26 of 85 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025MoReBench: Evaluating Procedural and Pluralistic Moral Reasoning in Language Models, More than Outcomes18 Oct
  2. 2024Using Counterfactual Tasks to Evaluate the Generality of Analogical Reasoning in Large Language Models14 Feb

Other references · 24

  1. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,708
  2. 2023Jailbroken: How Does LLM Safety Training Fail?cited by 1,651
  3. 2021A General Language Assistant as a Laboratory for Alignmentcited by 1,055
  4. 2020Aligning AI With Shared Human Valuescited by 723
  5. 2023"Do Anything Now": Characterizing and Evaluating In-The-Wild Jailbreak Prompts on Large Language Modelscited by 489
  6. 2023The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"cited by 407
  7. 2025ARC-AGI-2: A New Challenge for Frontier AI Reasoning Systemscited by 190
  8. 2021Can Machines Learn Morality? The Delphi Experimentcited by 141
  9. 2025Large Language Models Often Know When They Are Being Evaluatedcited by 128
  10. 2025SycEval: Evaluating LLM Sycophancycited by 108
  11. 2025Towards Robust Mathematical Reasoningcited by 73
  12. 2024Alice in Wonderland: Simple Tasks Showing Complete Reasoning Breakdown in State-Of-the-Art Large Language Modelscited by 68
12 more
  1. 2024Are Large Language Models Consistent over Value-laden Questions?cited by 58
  2. 2024How do Large Language Models Navigate Conflicts between Honesty and Helpfulness?cited by 27
  3. 2026Characterizing Delusional Spirals through Human-LLM Chat Logscited by 23
  4. 2026Sycophantic Chatbots Cause Delusional Spiraling, Even in Ideal Bayesianscited by 21
  5. 2023Let's Do a Thought Experiment: Using Counterfactuals to Improve Moral Reasoningcited by 20
  6. 2025People readily follow personal advice from AI but it does not improve their well-beingcited by 7
  7. 2025Evaluating and Improving Robustness in Large Language Models: A Survey and Future Directionscited by 5
  8. 2025Moral Susceptibility and Robustness under Persona Role-Play in Large Language Modelscited by 4
  9. 2026Moral Sycophancy in Vision Language Modelscited by 3
  10. 2026Are Language Models Sensitive to Morally Irrelevant Distractors?cited by 3
  11. 2026The Topological Trouble With Transformerscited by 3
  12. 2026Think Before You Lie: How Reasoning Leads to Honestycited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Are LLMs Bad at Moral Reasoning?
  2. 2025Discerning What Matters: A Multi-Dimensional Assessment of Moral Competence in LLMs
  3. 2025Beyond Ethical Alignment: Evaluating LLMs as Artificial Moral Assistants
  4. 2024MoralBench: Moral Evaluation of LLMs
  5. 2025Normative Conflicts and Shallow AI Alignment
  6. 2026Incoherent by Design? On the Moral Self-Consistency of LLMs
  7. 2026Position: Evaluations of AI Moral Reasoning Still Miss Half of the Picture
  8. 2026How Does Thinking Mode Change LLM Moral Judgments? A Controlled Instant-vs-Thinking Comparison Across Five Frontier Models