Information efficient learning of complexly structured preferences: Elicitation procedures and their application to decision making under uncertainty
Not on the map. Why?
Abstract (arXiv)
In this paper we propose efficient methods for elicitation of complexly structured preferences and utilize these in problems of decision making under (severe) uncertainty. Based on the general framework introduced in Jansen, Schollmeyer and Augustin (2018, Int. J. Approx. Reason), we now design elicitation procedures and algorithms that enable decision makers to reveal their underlying preference system (i.e. two relations, one encoding the ordinal, the other the cardinal part of the preferences) while having to answer as few as possible simple ranking questions. Here, two different approaches are followed. The first approach directly utilizes the collected ranking data for obtaining the ordinal part of the preferences, while their cardinal part is constructed implicitly by measuring meta data on the decision maker's consideration times. In contrast, the second approach explicitly elicits also the cardinal part of the decision maker's preference system, however, only an approximate version of it. This approximation is obtained by additionally collecting labels of preference strength during the elicitation procedure. For both approaches, we give conditions under which they produce the decision maker's true preference system and investigate how their efficiency can be improved. For the latter purpose, besides data-free approaches, we also discuss ways for effectively guiding the elicitation procedure if data from previous elicitation rounds is available. Finally, we demonstrate how the proposed elicitation methods can be utilized in problems of decision under (severe) uncertainty. Precisely, we show that under certain conditions optimal decisions can be found without fully specifying the preference system.
Key facts. Cited by 10 papers in the map (data through 13 Oct 2026). Builds on 5 of its 71 references that are in the map. First posted on arXiv 19 Oct 2021.
Builds on
5 of 71 references.
References · 5
- 2019Aleatoric and Epistemic Uncertainty in Machine Learning: An Introduction to Concepts and Methodscited by 910
- 2013A Hybrid Approach to Reasoning with Partially Elicited Preference Modelscited by 2
- 2017Efficiently Discovering Locally Exceptional yet Globally Representative Subgroupscited by 2
- 2018Discovering Reliable Dependencies from Data: Hardness and Improved Algorithmscited by 1
- 2021Robust decision analysis under severe uncertainty and ambiguous tradeoffs: an invasive species case studycited by 1
Built on by
Citing papers per year: 2022: 2; 2023: 3; 2024: 2; 2025: 3.
10 papers.
- 2022Statistical Comparisons of Classifiers by Generalized Stochastic Dominancecited by 20
- 2023Robust Statistical Comparison of Random Variables with Locally Varying Scale of Measurementcited by 13
- 2024Statistical Multicriteria Benchmarking via the GSD-Frontcited by 11
- 2025Statistical Multicriteria Evaluation of LLM-Generated Textcited by 9
- 2022Multi-Target Decision Making under Conditions of Severe Uncertaintycited by 7
- 2025A Statistical Case Against Empirical Human-AI Alignmentcited by 6
- 2023Depth Functions for Partial Orders with a Descriptive Analysis of Machine Learning Algorithmscited by 5
- 2023In all LikelihoodS: How to Reliably Select Pseudo-Labeled Data for Self-Training in Semi-Supervised Learningcited by 0
- 2024Reciprocal Learningcited by 0
- 2025Empirical Decision Theorycited by 0
- 2025Empirical Decision Theory5 Dec 2025
- 2025Statistical Multicriteria Evaluation of LLM-Generated Text22 Jun 2025
- 2025A Statistical Case Against Empirical Human-AI Alignment20 Feb 2025
- 2024Reciprocal Learning12 Aug 2024
- 2024Statistical Multicriteria Benchmarking via the GSD-Front6 Jun 2024
- 2023Robust Statistical Comparison of Random Variables with Locally Varying Scale of Measurement22 Jun 2023
- 2023Depth Functions for Partial Orders with a Descriptive Analysis of Machine Learning Algorithms19 Apr 2023
- 2023In all LikelihoodS: How to Reliably Select Pseudo-Labeled Data for Self-Training in Semi-Supervised Learning2 Mar 2023
- 2022Multi-Target Decision Making under Conditions of Severe Uncertainty13 Dec 2022
- 2022Statistical Comparisons of Classifiers by Generalized Stochastic Dominance5 Sep 2022