IDEAS home Printed from https://ideas.repec.org/a/pal/jorapm/v21y2022i6d10.1057_s41272-022-00389-4.html
   My bibliography  Save this article

Forecasting at capacity: the bias of unconstrained forecasts in model evaluation

Author

Listed:
  • Timothy Webb

    (University of Delaware)

Abstract

Revenue management practices require accurate forecasts for optimal rate decisions, and therefore researchers and industry are keen on identifying the most accurate methods. This study is first to discuss the challenges of forecasting evaluation when predictions exceed capacity. Specifically, evaluators face two choices that are identified and defined, leading to the studies hypotheses. The empirical investigation confirms the importance of considering how to manage these predictions in the evaluation phase and demonstrates how the choice may sway overall accuracy measures and bias the results of model performance. The findings have important implications for capacity-based forecasting research and revenue management practice, since this previously undiscussed capacity-induced bias may alter the results of forecasting studies in academia, as well as the effectiveness of revenue management practices.

Suggested Citation

  • Timothy Webb, 2022. "Forecasting at capacity: the bias of unconstrained forecasts in model evaluation," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 21(6), pages 645-656, December.
    • Handle: RePEc:pal:jorapm:v:21:y:2022:i:6:d:10.1057_s41272-022-00389-4
    DOI: 10.1057/s41272-022-00389-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1057/s41272-022-00389-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1057/s41272-022-00389-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Gaojun Zhang & Jinfeng Wu & Bing Pan & Junyi Li & Minjie Ma & Muzi Zhang & Jian Wang, 2017. "Improving daily occupancy forecasting accuracy for hotels based on EEMD-ARIMA model," Tourism Economics, , vol. 23(7), pages 1496-1514, November.
    2. Larry Weatherford, 2016. "The history of forecasting models in revenue management," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 15(3), pages 212-221, July.
    3. Weatherford, Larry R. & Kimes, Sheryl E., 2003. "A comparison of forecasting methods for hotel revenue management," International Journal of Forecasting, Elsevier, vol. 19(3), pages 401-415.
    4. Larry Weatherford, 2016. "The history of unconstraining models in revenue management," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 15(3), pages 222-228, July.
    5. Sh. Sharif Azadeh & R. Labib & G. Savard, 2013. "Railway demand forecasting in revenue management using neural networks," International Journal of Revenue Management, Inderscience Enterprises Ltd, vol. 7(1), pages 18-36.
    6. Makridakis, Spyros, 1993. "Accuracy measures: theoretical and practical concerns," International Journal of Forecasting, Elsevier, vol. 9(4), pages 527-529, December.
    7. Haensel, Alwin & Koole, Ger, 2011. "Booking horizon forecasting with dynamic updating: A case study of hotel reservation data," International Journal of Forecasting, Elsevier, vol. 27(3), pages 942-960.
    8. Haensel, Alwin & Koole, Ger, 2011. "Booking horizon forecasting with dynamic updating: A case study of hotel reservation data," International Journal of Forecasting, Elsevier, vol. 27(3), pages 942-960, July.
    9. Zvi Schwartz & Timothy Webb & Jean-Pierre I van der Rest & Larissa Koupriouchina, 2021. "Enhancing the accuracy of revenue management system forecasts: The impact of machine and human learning on the effectiveness of hotel occupancy forecast combinations across multiple forecasting horizo," Tourism Economics, , vol. 27(2), pages 273-291, March.
    10. Apostolos Ampountolas, 2019. "Forecasting hotel demand uncertainty using time series Bayesian VAR models," Tourism Economics, , vol. 25(5), pages 734-756, August.
    11. Armstrong, J. Scott & Collopy, Fred, 1992. "Error measures for generalizing about forecasting methods: Empirical comparisons," International Journal of Forecasting, Elsevier, vol. 8(1), pages 69-80, June.
    12. Dirk Sierag & Jean-Pierre Van Der Rest & Ger Koole & Rob Van Der Mei & Bert Zwart, 2017. "A call for exploratory data analysis in revenue management forecasting: a case study of a small and independent hotel in The Netherlands," International Journal of Revenue Management, Inderscience Enterprises Ltd, vol. 10(1), pages 28-51.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Ian Yeoman, 2022. "How COVID-19 changed things and what we did about it," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 21(6), pages 579-580, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Larissa Koupriouchina & Jean-Pierre van der Rest & Zvi Schwartz, 2023. "Judgmental Adjustments of Algorithmic Hotel Occupancy Forecasts: Does User Override Frequency Impact Accuracy at Different Time Horizons?," Tourism Economics, , vol. 29(8), pages 2143-2164, December.
    2. Ulrich Gunter, 2021. "Improving Hotel Room Demand Forecasts for Vienna across Hotel Classes and Forecast Horizons: Single Models and Combination Techniques Based on Encompassing Tests," Forecasting, MDPI, vol. 3(4), pages 1-36, November.
    3. Tianxiang Zheng & Shaopeng Liu & Zini Chen & Yuhan Qiao & Rob Law, 2020. "Forecasting Daily Room Rates on the Basis of an LSTM Model in Difficult Times of Hong Kong: Evidence from Online Distribution Channels on the Hotel Industry," Sustainability, MDPI, vol. 12(18), pages 1-17, September.
    4. Apostolos Ampountolas, 2019. "Forecasting hotel demand uncertainty using time series Bayesian VAR models," Tourism Economics, , vol. 25(5), pages 734-756, August.
    5. Naragain Phumchusri & Phoom Ungtrakul, 2020. "Hotel daily demand forecasting for high-frequency and complex seasonality data: a case study in Thailand," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 19(1), pages 8-25, February.
    6. Zvi Schwartz & Timothy Webb & Jean-Pierre I van der Rest & Larissa Koupriouchina, 2021. "Enhancing the accuracy of revenue management system forecasts: The impact of machine and human learning on the effectiveness of hotel occupancy forecast combinations across multiple forecasting horizo," Tourism Economics, , vol. 27(2), pages 273-291, March.
    7. E. Martinez-De-Pison & J. Fernandez-Ceniceros & A. V. Pernia-Espinoza & F. J. Martinez-De-Pison & Andres Sanz-Garcia, 2016. "Hotel Reservation Forecasting Using Flexible Soft Computing Techniques: A Case of Study in a Spanish Hotel," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 15(05), pages 1211-1234, September.
    8. Bacci, Livio Agnew & Mello, Luiz Gustavo & Incerti, Taynara & Paulo de Paiva, Anderson & Balestrassi, Pedro Paulo, 2019. "Optimization of combined time series methods to forecast the demand for coffee in Brazil: A new approach using Normal Boundary Intersection coupled with mixture designs of experiments and rotated fact," International Journal of Production Economics, Elsevier, vol. 212(C), pages 186-211.
    9. Larry Weatherford, 2016. "The history of forecasting models in revenue management," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 15(3), pages 212-221, July.
    10. Blaskowitz, Oliver & Herwartz, Helmut, 2011. "On economic evaluation of directional forecasts," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1058-1065, October.
    11. Dean W. Wichern & Benito E. Flores, 2005. "Evaluating forecasts: a look at aggregate bias and accuracy measures," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 24(6), pages 433-451.
    12. Bruce G. S. Hardie & Peter S. Fader & Robert Zeithammer, 2003. "Forecasting new product trial in a controlled test market environment," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 22(5), pages 391-410.
    13. Guizzardi, Andrea & Pons, Flavio Maria Emanuele & Angelini, Giovanni & Ranieri, Ercolino, 2021. "Big data from dynamic pricing: A smart approach to tourism demand forecasting," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1049-1060.
    14. Yoon, Sung Wook & Jeong, Suk Jae, 2015. "An alternative methodology for planning baggage carousel capacity expansion: A case study of Incheon International Airport," Journal of Air Transport Management, Elsevier, vol. 42(C), pages 63-74.
    15. Kim, Sungil & Kim, Heeyoung, 2016. "A new metric of absolute percentage error for intermittent demand forecasts," International Journal of Forecasting, Elsevier, vol. 32(3), pages 669-679.
    16. Goodwin, Paul & Lawton, Richard, 1999. "On the asymmetry of the symmetric MAPE," International Journal of Forecasting, Elsevier, vol. 15(4), pages 405-408, October.
    17. Schmidt, Johannes & Leduc, Sylvain & Dotzauer, Erik & Kindermann, Georg & Schmid, Erwin, 2010. "Cost-effective CO2 emission reduction through heat, power and biofuel production from woody biomass: A spatially explicit comparison of conversion technologies," Applied Energy, Elsevier, vol. 87(7), pages 2128-2141, July.
    18. Kavitha Balaiyan & R. K. Amit & Atul Kumar Malik & Xiaodong Luo & Amit Agarwal, 2019. "Joint forecasting for airline pricing and revenue management," Journal of Revenue and Pricing Management, Palgrave Macmillan, vol. 18(6), pages 465-482, December.
    19. McKenzie, Jordi, 2011. "Mean absolute percentage error and bias in economic forecasting," Economics Letters, Elsevier, vol. 113(3), pages 259-262.
    20. repec:kap:iaecre:v:15:y:2009:i:4:p:409-420 is not listed on IDEAS
    21. Wen, Xin & Jaxa-Rozen, Marc & Trutnevyte, Evelina, 2022. "Accuracy indicators for evaluating retrospective performance of energy system models," Applied Energy, Elsevier, vol. 325(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pal:jorapm:v:21:y:2022:i:6:d:10.1057_s41272-022-00389-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.palgrave.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.