Blind Inverse Game Theory: Jointly Decoding Rewards and Rationality in Entropy-Regularized Competitive Games
Not on the map. Why?
Abstract (arXiv)
Inverse Game Theory (IGT) methods based on the entropy-regularized Quantal Response Equilibrium (QRE) offer a tractable approach for competitive settings, but critically assume the agents' rationality parameter (temperature τ) is known a priori. When τ is unknown, a fundamental scale ambiguity emerges that couples τ with the reward parameters (θ), making them statistically unidentifiable. We introduce Blind-IGT, the first statistical framework to jointly recover both θ and τ from observed behavior. We analyze this bilinear inverse problem and establish necessary and sufficient conditions for unique identification by introducing a normalization constraint that resolves the scale ambiguity. We propose an efficient Normalized Least Squares (NLS) estimator and prove it achieves the optimal O(N-1/2) convergence rate for joint parameter recovery. When strong identifiability conditions fail, we provide partial identification guarantees through confidence set construction. We extend our framework to Markov games and demonstrate optimal convergence rates with strong empirical performance even when transition dynamics are unknown.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 36 references that are in the map. First posted on arXiv 7 Nov 2025.
Builds on
18 of 36 references.
References · 18
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2019Provably Efficient Reinforcement Learning with Linear Function Approximationcited by 514
- 2016Guided Cost Learning: Deep Inverse Optimal Control via Policy Optimizationcited by 400
- 2018A Survey of Inverse Reinforcement Learning: Challenges, Methods and Progresscited by 294
- 2015Maximum Entropy Deep Inverse Reinforcement Learningcited by 173
- 2018Understanding the impact of entropy on policy optimizationcited by 171
- 2020Fast Global Convergence of Natural Policy Gradient Methods with Entropy Regularizationcited by 170
- 2021Policy Mirror Descent for Regularized Reinforcement Learning: A Generalized Framework with Linear Convergencecited by 83
- 2019Multi-Agent Adversarial Inverse Reinforcement Learningcited by 60
- 2021Identifiability in inverse reinforcement learningcited by 55
- 2021Inverse Optimization: Theory and Applicationscited by 48
- 2013Computational Rationalization: The Inverse Equilibrium Problemcited by 24
6 more
- 2014Multi-agent Inverse Reinforcement Learning for Two-person Zero-sum Gamescited by 17
- 2022Identifiability and generalizability from multiple experts in Inverse Reinforcement Learningcited by 16
- 2018Competitive Multi-agent Inverse Reinforcement Learning with Sub-optimal Demonstrationscited by 11
- 2022Inverse Game Theory for Stackelberg Games: the Blessing of Bounded Rationalitycited by 5
- 2020Learning Nash Equilibria in Zero-Sum Stochastic Games via Entropy-Regularized Policy Approximationcited by 4
- 2017A Robust Utility Learning Framework via Inverse Optimizationcited by 3
Built on by
Not cited yet.