mlsanityData to 14 Oct 2026

Contextual Multi-Objective Optimization: Rethinking Objectives in Frontier AI Systems

arXiv 2605.03900 ↗First posted 5 May 2026cs.AIcited by 0

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

Frontier AI systems perform best in settings with clear, stable, and verifiable objectives, such as code generation, mathematical reasoning, games, and unit-test-driven tasks. They remain less reliable in open-ended settings, including scientific assistance, long-horizon agents, high-stakes advice, personalization, and tool use, where the relevant objective is ambiguous, context-dependent, delayed, or only partially observable. We argue that many such failures are not merely failures of scale or capability, but failures of objective selection: the system optimizes a locally visible signal while missing which objectives should govern the interaction. We formulate this problem as contextual multi-objective optimization. In this setting, systems must consider multiple, context-dependent objectives, such as helpfulness, truthfulness, safety, privacy, calibration, non-manipulation, user preference, reversibility, and stakeholder impact, while determining which objectives are active, which are soft preferences, and which must function as hard or quasi-hard constraints. These examples are not intended as an exhaustive taxonomy: different domains and deployment settings may activate different objective dimensions and different conflict-resolution procedures. Our framework models AI behavior as a context-dependent choice rule over candidate actions, objective estimates, active constraints, stakeholders, uncertainty, and conflict-resolution procedures. We outline an implementation pathway based on decomposed objective representations, context-to-objective routing, hierarchical constraints, deliberative policy reasoning, controlled personalization, tool-use control, diagnostic evaluation, auditing, and post-deployment revision.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 28 of its 37 references that are in the map. First posted on arXiv 5 May 2026.

Builds on

28 of 37 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024Deliberative Alignment: Reasoning Enables Safer Language Models20 Dec

Other references · 27

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2022Training language models to follow instructions with human feedbackcited by 15,971
  4. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  5. 2020Scaling Laws for Neural Language Modelscited by 6,586
  6. 2017Deep reinforcement learning from human preferencescited by 3,912
  7. 2023Universal and Transferable Adversarial Attacks on Aligned Language Modelscited by 3,104
  8. 2022Constitutional AI: Harmlessness from AI Feedbackcited by 3,050
  9. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  10. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  11. 2016Equality of Opportunity in Supervised Learningcited by 2,007
  12. 2016Concrete Problems in AI Safetycited by 1,642
15 more
  1. 2018Datasheets for Datasetscited by 1,386
  2. 2022Scaling Laws for Reward Model Overoptimizationcited by 1,095
  3. 2018Model Cards for Model Reportingcited by 1,080
  4. 2023Towards Understanding Sycophancy in Language Modelscited by 1,040
  5. 2022Red Teaming Language Models with Language Modelscited by 1,026
  6. 2022Toy Models of Superpositioncited by 971
  7. 2023A General Theoretical Paradigm to Understand Learning from Human Preferencescited by 912
  8. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 729
  9. 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 586
  10. 2023Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak Supervisioncited by 467
  11. 2018AI safety via debatecited by 400
  12. 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 384
  13. 2021A Practical Guide to Multi-Objective Reinforcement Learning and Planningcited by 256
  14. 2014A Survey of Multi-Objective Sequential Decision-Makingcited by 242
  15. 2024Traversing Pareto Optimal Policies: Provably Efficient Multi-Objective Reinforcement Learningcited by 15

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Thomson: Continual Learning of Frontier Models for SovereignAI
  2. 2024From homeostasis to resource sharing: Biologically and economically aligned multi-objective multi-agent gridworld-based AI safety benchmarks
  3. 2026Resolving Conflicts Where and When They Arise: Reactive Composition of Multi-Goal Behavior
  4. 2025CAPE: Capability Achievement via Policy Execution
  5. 2026MOCHA: Multi-Objective Chebyshev Annealing for Agent Skill Optimization
  6. 2025FrontierCS: Evolving Challenges for Evolving Intelligence
  7. 2024Frontier Models are Capable of In-context Scheming
  8. 2026AI Agents Do Not Fail Alone:The Context Fails First