Bayesian dynamic learning and pricing with strategic customers

We consider a seller who repeatedly sells a nondurable product to a single customer whose valuations of the product are drawn from a certain distribution. The seller, who initially does not know the valuation distribution, may use the customer's purchase history to learn and wishes to choose a pricing policy that maximizes her long‐run revenue. Such a problem is at the core of personalized revenue management where the seller can access each customer's individual purchase history and offer personalized prices. In this paper, we study such a learning problem when the customer is aware of the seller's policy and thus may behave strategically when making a purchase decision. By using a Bayesian setting with a binary prior, we first show that a popular policy in this setting—the myopic Bayesian policy (MBP)—may lead to incomplete learning of the seller, namely, the seller may never be able to ascertain the true type of the customer and the regret may grow linearly over time. The failure of the MBP is due to the strategic action taken by the customer. To address the strategic behavior of the customers, we first analyze a Stackelberg game under a two‐period model. We derive the optimal policy of the seller in the two‐period model and show that the regret can be significantly reduced by using the optimal policy rather than the myopic policy. However, such a game is hard to analyze in general. Nevertheless, based on the idea used in the two‐period model, we propose a randomized Bayesian policy (RBP), which updates the posterior belief of the customer in each period with a certain probability, as well as a deterministic Bayesian policy (DBP), in which the seller updates the posterior belief periodically and always defers her update to the next cycle. For both the RBP and DBP, we show that the seller can learn the customer type exponentially fast even if the customer is strategic, and the regret is bounded by a constant. We also propose policies that achieve asymptotically optimal regrets when only a finite number of price changes are allowed.