Uncovering Utility Functions from Observed Outcomes
Not on the map. Why?
Abstract (arXiv)
Determining consumer preferences and utility is a foundational challenge in economics. They are central in determining consumer behaviour through the utility-maximising consumer decision-making process. However, preferences and utilities are not observable and may not even be known to the individual making the choice; only the outcome is observed in the form of demand. Without the ability to observe the decision-making mechanism, demand estimation becomes a challenging task and current methods fall short due to lack of scalability or ability to identify causal effects. Estimating these effects is critical when considering changes in policy, such as pricing, the impact of taxes and subsidies, and the effect of a tariff. To address the shortcomings of existing methods, we combine revealed preference theory and inverse reinforcement learning to present a novel algorithm, Preference Extraction and Reward Learning (PEARL) which, to the best of our knowledge, is the only algorithm that can uncover a representation of the utility function that best rationalises observed consumer choice data given a specified functional form. We introduce a flexible utility function, the Input-Concave Neural Network which captures complex relationships across goods, including cross-price elasticities. Results show PEARL outperforms the benchmark on both noise-free and noisy synthetic data.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 3 of its 52 references that are in the map. First posted on arXiv 17 Mar 2025.
Builds on
3 of 52 references.
References · 3
- 2016Input Convex Neural Networkscited by 407
- 2015Maximum Entropy Deep Inverse Reinforcement Learningcited by 173
- 2019Identifying Cognitive Radars -- Inverse Reinforcement Learning using Revealed Preferencescited by 13
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Semiparametric Preference Optimization: Your Language Model is Secretly a Single-Index Model
- 2026A Lecture Note on Offline RL and IRL, Part II: Foundations of Inverse Reinforcement Learning and Dynamic Discrete Choice Models
- 2024Enhancing Preference-based Linear Bandits via Human Response Time
- 2026Understanding electricity consumption behaviour through Inverse Reinforcement Learning
- 2026Causal-Aware Foundation-Model for Bilevel Optimization in Discrete Choice Settings
- 2025Efficient Inference for Inverse Reinforcement Learning and Dynamic Discrete Choice Models
- 2026Learning Heterogeneous Preferences
- 2021Uncertain Decisions Facilitate Better Preference Learning