mlsanityData to 14 Oct 2026

A Tale of Two Cities: Pessimism and Opportunism in Offline Dynamic Pricing

arXiv 2411.08126 ↗First posted 12 Nov 2024stat.ML cs.LGcited by 2

On the map: Offline RL and imitation learning from data → Offline RL algorithms

Abstract (arXiv)

We study offline dynamic pricing when historical data provide incomplete coverage of the price space such that some candidate prices, including the optimal one, may be entirely unobserved. This setting is common in practice and is especially difficult in dynamic environments. Existing offline reinforcement learning methods typically rely on full or partial coverage and can therefore perform poorly in such settings. We develop a nonparametric partial identification framework for offline dynamic pricing that exploits the monotonicity of demand in price to bound the value of unobserved prices. Within this framework, we formulate two dynamic decision rules: a pessimistic policy that maximizes worst-case revenue and an opportunistic policy that minimizes worst-case regret. These rules are tailored to a sequential no-coverage environment and are not direct extensions of existing pessimistic offline RL or static opportunistic approaches. We establish finite-sample regret bounds for both policies, recovering the standard rate when the optimal price is covered and quantifying the additional cost when it is not. We also develop efficient algorithms and show, through simulations and an airline ticket application, that our methods outperform standard offline RL baselines in no-coverage settings. Managerially, the framework provides a practical mapping from a firm's risk posture to its pricing policy: firms seeking revenue stability and downside protection should prefer the pessimistic policy, whereas firms willing to bear measured risk for potential gains from underexplored prices should prefer the opportunistic policy.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Offline RL algorithms, one of 13 directions in Offline RL and imitation learning from data. First posted on arXiv 12 Nov 2024.

Builds on

0 of 0 references.

No references here yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Offline Dynamic Inventory and Pricing Strategy: Addressing Censored and Dependent Demand
  2. 2026A Comparative Study of Dynamic Programming and Reinforcement Learning in Finite Horizon Dynamic Pricing
  3. 2022On the Role of Discount Factor in Offline Reinforcement Learning
  4. 2024Diffusion Policies for Risk-Averse Behavior Modeling in Offline Reinforcement Learning
  5. 2022Pessimism meets VCG: Learning Dynamic Mechanism Design via Offline Reinforcement Learning
  6. 2025Bayesian Optimization for Dynamic Pricing and Learning
  7. 2023An Offline Learning Approach to Propagator Models
  8. 2020Is Pessimism Provably Efficient for Offline RL?