Interactive Multi-Objective Probabilistic Preference Learning with Soft and Hard Bounds
Not on the map. Why?
Abstract (arXiv)
High-stakes decision-making involves navigating multiple competing objectives with expensive evaluations. For instance, in brachytherapy, clinicians must balance maximizing tumor coverage (e.g., an aspirational target or soft bound of >95% coverage) against strict organ dose limits (e.g., a non-negotiable hard bound of <601cGy to the bladder). Selecting Pareto-optimal solutions that match implicit preferences is challenging, as exhaustive Pareto frontier exploration is computationally and cognitively prohibitive, necessitating interactive frameworks to guide users. While decision-makers (DMs) often possess domain knowledge to narrow the search via such soft-hard bounds, current methods often lack systematic approaches to iteratively refine these multi-faceted preference structures. Furthermore, DMs often require confidence that they have not overlooked superior alternatives, a paramount necessity in high-stakes scenarios. We present Active-MoSH, an interactive local-global framework designed for this process. Its local component integrates probabilistic preference learning with an active sampling strategy to adaptively refine Pareto subsets while minimizing cognitive burden. To bolster decision confidence, Active-MoSH's global component, C-MoSH, leverages multi-objective sensitivity analysis to identify potentially overlooked, high-value points beyond immediate feedback. We demonstrate Active-MoSH's performance benefits through diverse synthetic and real-world applications. A high-stakes case study with real cervical cancer brachytherapy treatment plans and an image selection user study further validate our hypotheses regarding the framework's ability to improve convergence, enhance DM confidence, and provide expressive preference articulation.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 35 of its 104 references that are in the map. First posted on arXiv 27 Jun 2025.
Builds on
35 of 104 references.
References · 35
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,555
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2023FlashAttention-2: Faster Attention with Better Parallelism and Work Partitioningcited by 2,598
- 2017Understanding Black-box Predictions via Influence Functionscited by 1,741
- 2014A Survey of Multi-Objective Sequential Decision-Makingcited by 242
- 2023Camels in a Changing Climate: Enhancing LM Adaptation with Tulu 2cited by 229
- 2018To Trust Or Not To Trust A Classifiercited by 207
- 2021MARS: Markov Molecular Sampling for Multi-objective Drug Discoverycited by 125
- 2018A Flexible Framework for Multi-Objective Bayesian Optimization using Random Scalarizationscited by 99
- 2024Decoding-Time Language Model Alignment with Multiple Objectivescited by 94
- 2024Tuning Language Models by Proxycited by 89
23 more
- 2015Predictive Entropy Search for Multi-objective Bayesian Optimizationcited by 88
- 2018Batch Active Preference-Based Learning of Reward Functionscited by 87
- 2020An Easy-to-use Real-world Multi-objective Optimization Problem Suitecited by 71
- 2019Asking Easy Questions: A User-Friendly Approach to Active Reward Learningcited by 68
- 2019Learning Reward Functions by Integrating Human Demonstrations and Preferencescited by 64
- 2023An Emulator for Fine-Tuning Large Language Models using Small Language Modelscited by 61
- 2019Quantifying Interpretability and Trust in Machine Learning Systemscited by 49
- 2021Learning Multimodal Rewards from Rankingscited by 41
- 2024Aligning Language Models with Demonstrated Feedbackcited by 34
- 2022Computer-Aided Multi-Objective Optimization in Small Molecule Discoverycited by 31
- 2021Learning Reward Functions from Scale Feedbackcited by 24
- 2013Multiobjective optimization using Gaussian process emulators via stepwise uncertainty reductioncited by 21
- 2019Multi-Attribute Bayesian Optimization With Interactive Preference Learningcited by 21
- 2018Including Uncertainty when Learning from Human Correctionscited by 15
- 2019The Green Choice: Learning and Influencing Human Decisions on Shared Roadscited by 14
- 2023Multi-Objective Bayesian Optimization with Active Preference Learningcited by 13
- 2019Learning an Urban Air Mobility Encounter Model from Expert Preferencescited by 12
- 2015Pantheon 1.0, a manually verified dataset of globally famous biographiescited by 8
- 2021Toward a Taxonomy of Trust for Probabilistic Machine Learningcited by 8
- 2023Interactive Hyperparameter Optimization in Multi-Objective Problems via Preference Learningcited by 8
- 2021Leveraging Trust for Joint Multi-Objective and Multi-Fidelity Optimizationcited by 7
- 2023Learning Choice Functions with Gaussian Processescited by 5
- 2024Modeling Multi-Objective Tradeoffs with Monotonic Utility Functionscited by 2
Built on by
Citing papers per year: 2026: 2.
2 papers.