IDEAS home Printed from https://ideas.repec.org/a/gam/jsusta/v15y2023i4p3363-d1066081.html
   My bibliography  Save this article

Real-Time Pricing Method for Spot Cloud Services with Non-Stationary Excess Capacity

Author

Listed:
  • Huijie Peng

    (School of Business, East China University of Science and Technology, Shanghai 200237, China)

  • Yan Cheng

    (School of Business, East China University of Science and Technology, Shanghai 200237, China)

  • Xingyuan Li

    (School of Business, East China University of Science and Technology, Shanghai 200237, China)

Abstract

Cloud operators face massive unused excess computing capacity with a stochastic non-stationary nature due to time-varying resource utilization with peaks and troughs. Low-priority spot (pre-emptive) cloud services with real-time pricing have been launched by many cloud operators, which allow them to maximize excess capacity revenue while keeping the right to reclaim capacities when resource scarcity occurs. However, real-time spot pricing with the non-stationarity of excess capacity has two challenges: (1) it faces incomplete peak–trough and pattern shifts in excess capacity, and (2) it suffers time and space inefficiency in optimal spot pricing policy, which needs to search over the large space of history-dependent policies in a non-stationary state. Our objective was to develop a real-time pricing method with a spot pricing scheme to maximize expected cumulative revenue under a non-stationary state. We first formulated the real-time spot pricing problem as a non-stationary Markov decision process. We then developed an improved reinforcement learning algorithm to obtain the optimal solution for real-time pricing problems. Our simulation experiments demonstrate that the profitability of the proposed reinforcement learning algorithm outperforms that of existing solutions. Our study provides both efficient optimization algorithms and valuable insights into cloud operators’ excess capacity management practices.

Suggested Citation

  • Huijie Peng & Yan Cheng & Xingyuan Li, 2023. "Real-Time Pricing Method for Spot Cloud Services with Non-Stationary Excess Capacity," Sustainability, MDPI, vol. 15(4), pages 1-21, February.
    • Handle: RePEc:gam:jsusta:v:15:y:2023:i:4:p:3363-:d:1066081
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2071-1050/15/4/3363/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2071-1050/15/4/3363/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Rana, Rupal & Oliveira, Fernando S., 2014. "Real-time dynamic pricing in a non-stationary environment using model-free reinforcement learning," Omega, Elsevier, vol. 47(C), pages 116-126.
    2. Yanzhe (Murray) Lei & Stefanus Jasin, 2020. "Real-Time Dynamic Pricing for Revenue Management with Reusable Resources, Advance Reservation, and Deterministic Service Time Requirements," Operations Research, INFORMS, vol. 68(3), pages 676-685, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Bouchra El Akraoui & Daoui Cherki, 2023. "Solving Finite-Horizon Discounted Non-Stationary MDPS," Folia Oeconomica Stetinensia, Sciendo, vol. 23(1), pages 1-15, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nikhil Garg & Hamid Nazerzadeh, 2022. "Driver Surge Pricing," Management Science, INFORMS, vol. 68(5), pages 3219-3235, May.
    2. den Boer, Arnoud V., 2015. "Tracking the market: Dynamic pricing and learning in a changing environment," European Journal of Operational Research, Elsevier, vol. 247(3), pages 914-927.
    3. Li, Yuanyuan & Li, Junxiang & He, Jianjia & Zhang, Shuyuan, 2021. "The real-time pricing optimization model of smart grid based on the utility function of the logistic function," Energy, Elsevier, vol. 224(C).
    4. Lu, Renzhi & Hong, Seung Ho & Zhang, Xiongfeng, 2018. "A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach," Applied Energy, Elsevier, vol. 220(C), pages 220-230.
    5. Yilin Liang & Yuping Hu & Dongjun Luo & Qi Zhu & Qingxuan Chen & Chunmei Wang, 2023. "Distributed Dynamic Pricing Strategy Based on Deep Reinforcement Learning Approach in a Presale Mechanism," Sustainability, MDPI, vol. 15(13), pages 1-20, July.
    6. Yuan, Guanxiu & Gao, Yan & Ye, Bei, 2021. "Optimal dispatching strategy and real-time pricing for multi-regional integrated energy systems based on demand response," Renewable Energy, Elsevier, vol. 179(C), pages 1424-1446.
    7. Raad Khraishi & Ramin Okhrati, 2022. "Offline Deep Reinforcement Learning for Dynamic Pricing of Consumer Credit," Papers 2203.03003, arXiv.org.
    8. Yan, Yimo & Chow, Andy H.F. & Ho, Chin Pang & Kuo, Yong-Hong & Wu, Qihao & Ying, Chengshuo, 2022. "Reinforcement learning for logistics and supply chain management: Methodologies, state of the art, and future opportunities," Transportation Research Part E: Logistics and Transportation Review, Elsevier, vol. 162(C).
    9. Justin Dumouchelle & Emma Frejinger & Andrea Lodi, 2024. "Reinforcement learning for freight booking control problems," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 23(4), pages 318-345, August.
    10. Chen, Jing & Dong, Ming & Rong, Ying & Yang, Liang, 2018. "Dynamic pricing for deteriorating products with menu cost," Omega, Elsevier, vol. 75(C), pages 13-26.
    11. Yu Xia & Ali Arian & Sriram Narayanamoorthy & Joshua Mabry, 2023. "RetailSynth: Synthetic Data Generation for Retail AI Systems Evaluation," Papers 2312.14095, arXiv.org.
    12. Alexander Kastius & Rainer Schlosser, 2022. "Dynamic pricing under competition using reinforcement learning," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 21(1), pages 50-63, February.
    13. Jian Wang & Murtaza Das & Stephen Tappert, 2021. "Applying reinforcement learning to estimating apartment reference rents," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 20(3), pages 330-343, June.
    14. Kazemi, Mohammad Sadegh & Fotopoulos, Stergios B. & Wang, Xinchang, 2023. "Minimizing online retailers’ revenue loss under a time-varying willingness-to-pay distribution," International Journal of Production Economics, Elsevier, vol. 257(C).
    15. Yi Zheng & Zehao Li & Peng Jiang & Yijie Peng, 2024. "Dual-Agent Deep Reinforcement Learning for Dynamic Pricing and Replenishment," Papers 2410.21109, arXiv.org.
    16. Bajwa, Naeem & Sox, Charles R. & Ishfaq, Rafay, 2016. "Coordinating pricing and production decisions for multiple products," Omega, Elsevier, vol. 64(C), pages 86-101.
    17. Klein, Robert & Kolb, Johannes, 2015. "Maximizing customer equity subject to capacity constraints," Omega, Elsevier, vol. 55(C), pages 111-125.
    18. Basu, Sumanta & Chakraborty, Soumyakanti & Sharma, Megha, 2015. "Pricing cloud services—the impact of broadband quality," Omega, Elsevier, vol. 50(C), pages 96-114.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jsusta:v:15:y:2023:i:4:p:3363-:d:1066081. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.