mlsanityData to 14 Oct 2026

Evaluating Intra-firm LLM Alignment Strategies in Business Contexts

arXiv 2505.18779 ↗First posted 24 May 2025cs.CYcited by 0

On the map: LLM alignment / RLHF / preference optimisation → Human values and AI feedback alignment

Abstract (arXiv)

Instruction-tuned Large Language Models (LLMs) are increasingly deployed as AI Assistants in firms for support in cognitive tasks. These AI assistants carry embedded perspectives which influence factors across the firm including decision-making, collaboration, and organizational culture. This paper argues that firms must align the perspectives of these AI Assistants intentionally with their objectives and values, framing alignment as a strategic and ethical imperative crucial for maintaining control over firm culture and intra-firm moral norms. The paper highlights how AI perspectives arise from biases in training data and the fine-tuning objectives of developers, and discusses their impact and ethical significance, foregrounding ethical concerns like automation bias and reduced critical thinking. Drawing on normative business ethics, particularly non-reductionist views of professional relationships, three distinct alignment strategies are proposed: supportive (reinforcing the firm's mission), adversarial (stress-testing ideas), and diverse (broadening moral horizons by incorporating multiple stakeholder views). The ethical trade-offs of each strategy and their implications for manager-employee and employee-employee relationships are analyzed, alongside the potential to shape the culture and moral fabric of the firm.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Human values and AI feedback alignment, one of 10 directions in LLM alignment / RLHF / preference optimisation. Builds on 3 of its 22 references that are in the map. First posted on arXiv 24 May 2025.

Builds on

3 of 22 references.

References · 3

  1. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  2. 2023RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedbackcited by 625
  3. 2017Word Embeddings Quantify 100 Years of Gender and Ethnic Stereotypescited by 253

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Are We Aligned? A Preliminary Investigation of the Alignment of Responsible AI Values between LLMs and Human Judgment
  2. 2024Chat Bankman-Fried: an Exploration of LLM Alignment in Finance
  3. 2025Evaluating AI Alignment in LLMs: Output Analysis of Value Priorities Across 75 Models with Human Benchmarking
  4. 2025Getting In Contract with Large Language Models -- An Agency Theory Perspective On Large Language Model Alignment
  5. 2025Decoding Alignment: A Critical Survey of LLM Development Initiatives through Value-setting and Data-centric Lens
  6. 2024AI as Decision-Maker: Ethics and Risk Preferences of LLMs
  7. 2023Unpacking the Ethical Value Alignment in Big Models
  8. 2024ValueCompass: A Framework for Measuring Contextual Value Alignment Between Human and LLMs