mlsanityData to 13 Oct 2026

Crisis-Bench: Benchmarking Strategic Ambiguity and Reputation Management in Large Language Models

arXiv 2601.05570 ↗First posted 9 Jan 2026cs.AI cs.MAcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

Abstract (arXiv)

Standard safety alignment optimizes Large Language Models (LLMs) for universal helpfulness and honesty, effectively instilling a rigid "Boy Scout" morality. While robust for general-purpose assistants, this one-size-fits-all ethical framework imposes a "transparency tax" on professional domains requiring strategic ambiguity and information withholding, such as public relations, negotiation, and crisis management. To measure this gap between general safety and professional utility, we introduce Crisis-Bench, a multi-agent Partially Observable Markov Decision Process (POMDP) that evaluates LLMs in high-stakes corporate crises. Spanning 80 diverse storylines across 8 industries, Crisis-Bench tasks an LLM-based Public Relations (PR) Agent with navigating a dynamic 7-day corporate crisis simulation while managing strictly separated Private and Public narrative states to enforce rigorous information asymmetry. Unlike traditional benchmarks that rely on static ground truths, we introduce the Adjudicator-Market Loop: a novel evaluation metric where public sentiment is adjudicated and translated into a simulated stock price, creating a realistic economic incentive structure. Our results expose a critical dichotomy: while some models capitulate to ethical concerns, others demonstrate the capacity for Machiavellian, legitimate strategic withholding in order to stabilize the simulated stock price. Crisis-Bench provides the first quantitative framework for assessing "Reputation Management" capabilities, arguing for a shift from rigid moral absolutism to context-aware professional alignment.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 9 of its 69 references that are in the map. First posted on arXiv 9 Jan 2026.

Builds on

9 of 69 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Value Drifts: Tracing Value Alignment During LLM Post-Training30 Oct

Other references · 8

  1. 2024MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmarkcited by 1,799
  2. 2024TravelPlanner: A Benchmark for Real-World Planning with Language Agentscited by 386
  3. 2024AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding Agentscited by 377
  4. 2024TradingAgents: Multi-Agents LLM Financial Trading Frameworkcited by 186
  5. 2024Editable Scene Simulation for Autonomous Driving via Collaborative LLM-Agentscited by 91
  6. 2025Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agentscited by 77
  7. 2025How Post-Training Reshapes LLMs: A Mechanistic View on Knowledge, Truthfulness, Refusal, and Confidencecited by 12
  8. 2025EvalMORAAL: Interpretable Chain-of-Thought and LLM-as-Judge Evaluation for Moral Alignment in Large Language Modelscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Same Game, Different Story: A Minimal Conservative Strategic Robustness Benchmark for Large Language Model Agents
  2. 2024Gradual Vigilance and Interval Communication: Enhancing Value Alignment in Multi-Agent Debates
  3. 2024GreedLlama: Performance of Financial Value-Aligned Large Language Models in Moral Reasoning
  4. 2026PieArena: Ranking and Profiling Language Agents in Realistic Negotiation Scenarios
  5. 2025From Competition to Coordination: Market Making as a Scalable Framework for Safe and Aligned Multi-Agent LLM Systems
  6. 2026ContextAdapt: Evaluating Contextual Adaptation and Value Alignment in LLMs
  7. 2025StockSim: A Dual-Mode Order-Level Simulator for Evaluating Multi-Agent LLMs in Financial Markets
  8. 2026Emergent Misaligned Communication in Long-Horizon Multi-Agent LLM Commerce