mlsanityData to 7 Oct 2026

STEER: Inference-Time Risk Control via Constrained Quality-Diversity Search

arXiv 2602.02862 ↗First posted 2 Feb 2026cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) trained for average correctness often exhibit mode collapse, producing narrow decision behaviors on tasks where multiple responses may be reasonable. This limitation is particularly problematic in ordinal decision settings such as clinical triage, where standard alignment removes the ability to trade off specificity and sensitivity (the ROC operating point) based on contextual constraints. We propose STEER (Steerable Tuning via Evolutionary Ensemble Refinement), a training-free framework that reintroduces this tunable control. STEER constructs a population of natural-language personas through an offline, constrained quality-diversity search that promotes behavioral coverage while enforcing minimum safety, reasoning, and stability thresholds. At inference time, STEER exposes a single, interpretable control parameter that maps a user-specified risk percentile to a selected persona, yielding a monotonic adjustment of decision conservativeness. On two clinical triage benchmarks, STEER achieves broader behavioral coverage compared to temperature-based sampling and static persona ensembles. Compared to a representative post-training method, STEER maintains substantially higher accuracy on unambiguous urgent cases while providing comparable control over ambiguous decisions. These results demonstrate STEER as a safety-preserving paradigm for risk control, capable of steering behavior without compromising domain competence.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 24 references that are in the map. First posted on arXiv 2 Feb 2026.

Builds on

17 of 24 references.

References · 17

  1. 2023Improving Factuality and Reasoning in Language Models through Multiagent Debatecited by 1,739
  2. 2023Encouraging Divergent Thinking in Large Language Models through Multi-Agent Debatecited by 995
  3. 2025OpenAI GPT-5 System Cardcited by 910
  4. 2023Large Language Models as Optimizerscited by 830
  5. 2023Promptbreeder: Self-Referential Self-Improvement Via Prompt Evolutioncited by 521
  6. 2025GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learningcited by 449
  7. 2023Understanding the Effects of RLHF on LLM Generalisation and Diversitycited by 386
  8. 2023EvoPrompt: Connecting LLMs with Evolutionary Algorithms Yields Powerful Prompt Optimizerscited by 189
  9. 2024Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffoldingcited by 115
  10. 2025Verbalized Sampling: How to Mitigate Mode Collapse and Unlock LLM Diversitycited by 100
  11. 2025Jointly Reinforcing Diversity and Quality in Language Model Generationscited by 79
  12. 2025Diverse Preference Optimizationcited by 48
5 more
  1. 2024Detecting Mode Collapse in Language Models via Narrationcited by 24
  2. 2025SteerConf: Steering LLMs for Confidence Elicitationcited by 20
  3. 2024Quality-Diversity Algorithms Can Provably Be Helpful for Optimizationcited by 9
  4. 2024Attribute Controlled Fine-tuning for Large Language Models: A Case Study on Detoxificationcited by 7
  5. 2025From Promising Capability to Pervasive Bias: Assessing Large Language Models for Emergency Department Triagecited by 5

Built on by

Not cited yet.