IDEAS home Printed from https://ideas.repec.org/a/inm/ormnsc/v51y2005i9p1400-1416.html
   My bibliography  Save this article

A Partially Observed Markov Decision Process for Dynamic Pricing

Author

Listed:
  • Yossi Aviv

    (Olin School of Business, Washington University, St. Louis, Missouri 63130)

  • Amit Pazgal

    (Olin School of Business, Washington University, St. Louis, Missouri 63130)

Abstract

In this paper, we develop a stylized partially observed Markov decision process (POMDP) framework to study a dynamic pricing problem faced by sellers of fashion-like goods. We consider a retailer that plans to sell a given stock of items during a finite sales season. The objective of the retailer is to dynamically price the product in a way that maximizes expected revenues. Our model brings together various types of uncertainties about the demand, some of which are resolvable through sales observations. We develop a rigorous upper bound for the seller's optimal dynamic decision problem and use it to propose an active-learning heuristic pricing policy. We conduct a numerical study to test the performance of four different heuristic dynamic pricing policies in order to gain insight into several important managerial questions that arise in the context of revenue management.

Suggested Citation

  • Yossi Aviv & Amit Pazgal, 2005. "A Partially Observed Markov Decision Process for Dynamic Pricing," Management Science, INFORMS, vol. 51(9), pages 1400-1416, September.
    • Handle: RePEc:inm:ormnsc:v:51:y:2005:i:9:p:1400-1416
    DOI: 10.1287/mnsc.1050.0393
    as

    Download full text from publisher

    File URL: http://dx.doi.org/10.1287/mnsc.1050.0393
    Download Restriction: no
    File URL: https://libkey.io/10.1287/mnsc.1050.0393?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. William S. Lovejoy, 1991. "Computationally Feasible Bounds for Partially Observed Markov Decision Processes," Operations Research, INFORMS, vol. 39(1), pages 162-175, February.
    2. Guillermo Gallego & Garrett van Ryzin, 1994. "Optimal Dynamic Pricing of Inventories with Stochastic Demand over Finite Horizons," Management Science, INFORMS, vol. 40(8), pages 999-1020, August.
    3. Lode Li, 1988. "A Stochastic Theory of the Firm," Mathematics of Operations Research, INFORMS, vol. 13(3), pages 447-466, August.
    4. Martin A. Lariviere & Evan L. Porteus, 1999. "Stalking Information: Bayesian Inventory Management with Unobserved Lost Sales," Management Science, INFORMS, vol. 45(3), pages 346-363, March.
    5. Richard D. Smallwood & Edward J. Sondik, 1973. "The Optimal Control of Partially Observable Markov Processes over a Finite Horizon," Operations Research, INFORMS, vol. 21(5), pages 1071-1088, October.
    6. James T. Treharne & Charles R. Sox, 2002. "Adaptive Inventory Control for Nonstationary Demand and Partial Information," Management Science, INFORMS, vol. 48(5), pages 607-624, May.
    7. Jing-Sheng Song & Paul Zipkin, 1993. "Inventory Control in a Fluctuating Demand Environment," Operations Research, INFORMS, vol. 41(2), pages 351-370, April.
    8. George E. Monahan, 1982. "State of the Art---A Survey of Partially Observable Markov Decision Processes: Theory, Models, and Algorithms," Management Science, INFORMS, vol. 28(1), pages 1-16, January.
    9. William S. Lovejoy, 1993. "Suboptimal Policies, with Bounds, for Parameter Adaptive Decision Processes," Operations Research, INFORMS, vol. 41(3), pages 583-599, June.
    10. Awi Federgruen & Aliza Heching, 1999. "Combined Pricing and Inventory Control Under Uncertainty," Operations Research, INFORMS, vol. 47(3), pages 454-475, June.
    11. Suresh P. Sethi & Feng Cheng, 1997. "Optimality of ( s , S ) Policies in Inventory Models with Markovian Demand," Operations Research, INFORMS, vol. 45(6), pages 931-939, December.
    12. White, Chelsea C. & White, Douglas J., 1989. "Markov decision processes," European Journal of Operational Research, Elsevier, vol. 39(1), pages 1-16, March.
    13. Gabriel R. Bitran & Susana V. Mondschein, 1997. "Periodic Pricing of Seasonal Products in Retailing," Management Science, INFORMS, vol. 43(1), pages 64-79, January.
    14. Chelsea C. White & William T. Scherer, 1989. "Solution Procedures for Partially Observed Markov Decision Processes," Operations Research, INFORMS, vol. 37(5), pages 791-797, October.
    15. David J. Braden & Shmuel S. Oren, 1994. "Nonlinear Pricing to Produce Information," Marketing Science, INFORMS, vol. 13(3), pages 310-326.
    16. Balvers, Ronald J & Cosimano, Thomas F, 1990. "Actively Learning about Demand and the Dynamics of Price Adjustment," Economic Journal, Royal Economic Society, vol. 100(402), pages 882-898, September.
    17. Serhan Ziya & Hayriye Ayhan & Robert D. Foley, 2004. "Relationships Among Three Assumptions in Revenue Management," Operations Research, INFORMS, vol. 52(5), pages 804-809, October.
    18. Chuanpu Hu & William S. Lovejoy & Steven L. Shafer, 1996. "Comparison of Some Suboptimal Control Policies in Medical Drug Therapy," Operations Research, INFORMS, vol. 44(5), pages 696-709, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. James T. Treharne & Charles R. Sox, 2002. "Adaptive Inventory Control for Nonstationary Demand and Partial Information," Management Science, INFORMS, vol. 48(5), pages 607-624, May.
    2. Hao Zhang, 2010. "Partially Observable Markov Decision Processes: A Geometric Technique and Analysis," Operations Research, INFORMS, vol. 58(1), pages 214-228, February.
    3. Chernonog, Tatyana & Avinadav, Tal, 2016. "A two-state partially observable Markov decision process with three actionsAuthor-Name: Ben-Zvi, Tal," European Journal of Operational Research, Elsevier, vol. 254(3), pages 957-967.
    4. Alexandre X. Carvalho & Martin L. Puterman, 2005. "Dynamic Optimization and Learning: How Should a Manager set Prices when the Demand Function is Unknown ?," Discussion Papers 1117, Instituto de Pesquisa Econômica Aplicada - IPEA.
    5. Alexandre X. Carvalho & Martin L. Puterman, 2015. "Dynamic Optimization and Learning: How Should a Manager Set Prices When the Demand Function is Unknown?," Discussion Papers 0158, Instituto de Pesquisa Econômica Aplicada - IPEA.
    6. Satya S. Malladi & Alan L. Erera & Chelsea C. White, 2023. "Inventory control with modulated demand and a partially observed modulation process," Annals of Operations Research, Springer, vol. 321(1), pages 343-369, February.
    7. Nicholas C. Petruzzi & Maqbool Dada, 2002. "Dynamic pricing and inventory control with learning," Naval Research Logistics (NRL), John Wiley & Sons, vol. 49(3), pages 303-325, April.
    8. Yanling Chang & Alan Erera & Chelsea White, 2015. "Value of information for a leader–follower partially observed Markov game," Annals of Operations Research, Springer, vol. 235(1), pages 129-153, December.
    9. Yin, Rui & Rajaram, Kumar, 2007. "Joint pricing and inventory control with a Markovian demand model," European Journal of Operational Research, Elsevier, vol. 182(1), pages 113-126, October.
    10. Erhan Bayraktar & Michael Ludkovski, 2010. "Inventory management with partially observed nonstationary demand," Annals of Operations Research, Springer, vol. 176(1), pages 7-39, April.
    11. Arifoglu, Kenan & Özekici, Süleyman, 2011. "Inventory management with random supply and imperfect information: A hidden Markov model," International Journal of Production Economics, Elsevier, vol. 134(1), pages 123-137, November.
    12. Arifoglu, Kenan & Özekici, Süleyman, 2010. "Optimal policies for inventory systems with finite capacity and partially observed Markov-modulated demand and supply processes," European Journal of Operational Research, Elsevier, vol. 204(3), pages 421-438, August.
    13. Anyan Qi & Hyun-Soo Ahn & Amitabh Sinha, 2017. "Capacity Investment with Demand Learning," Operations Research, INFORMS, vol. 65(1), pages 145-164, February.
    14. Pirayesh Neghab, Davood & Khayyati, Siamak & Karaesmen, Fikri, 2022. "An integrated data-driven method using deep learning for a newsvendor problem with unobservable features," European Journal of Operational Research, Elsevier, vol. 302(2), pages 482-496.
    15. Shoshana Anily & Abraham Grosfeld-Nir, 2006. "An Optimal Lot-Sizing and Offline Inspection Policy in the Case of Nonrigid Demand," Operations Research, INFORMS, vol. 54(2), pages 311-323, April.
    16. Ghuloum, Mohammad & Song, Boqian & Aydin, Goker & Souza, Gilvan C., 2022. "Joint Dynamic Pricing with Acquisition and Selling Opportunities," European Journal of Operational Research, Elsevier, vol. 297(1), pages 252-267.
    17. Liu, Yifeng & Yang, Jian, 2015. "Joint pricing-procurement control under fluctuating raw material costs," International Journal of Production Economics, Elsevier, vol. 168(C), pages 91-104.
    18. Anyan Qi & Hyun-Soo Ahn & Amitabh Sinha, 2017. "Capacity Investment with Demand Learning," Operations Research, INFORMS, vol. 65(1), pages 145-164, February.
    19. Bernardo Bertoldi & Chiara Giachino & Alberto Pastore, 2016. "Strategic pricing management in the omnichannel era," MERCATI & COMPETITIVIT?, FrancoAngeli Editore, vol. 2016(4), pages 131-152.
    20. Jean-Philippe Gayon & Isilay Talay-Degirmenci & F. Karaesmen & L. Örmeci, 2009. "Optimal Pricing and Production Policies of a Make-to-Stock System with Fluctuating Demand," Post-Print hal-00363686, HAL.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:inm:ormnsc:v:51:y:2005:i:9:p:1400-1416. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Asher (email available below). General contact details of provider: https://edirc.repec.org/data/inforea.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.