IDEAS home Printed from https://ideas.repec.org/a/sae/toueco/v25y2019i3p402-424.html
   My bibliography  Save this article

Judgmental adjustments in tourism forecasting practice: How good are they?

Author

Listed:
  • Vera Shanshan Lin

    (School of Management, Zhejiang University, China)

Abstract

This study aims to evaluate the accuracy of different judgmental forecasting tasks, compare the judgmental forecasting behaviour of tourism researchers and practitioners and explore the validity of experts’ judgmental behaviour by using the Hong Kong visitor arrivals forecasts over the period 2011Q2−2015Q4. Delphi-based judgmental forecasting procedure was employed through the Hong Kong Tourism Demand Forecasting System, an online forecasting support system, to collect and combine experts’ adjusted forecasts. This study evaluates forecasting performance and explores the characteristics of judgmental adjustment behaviour through the use of a group of error measures and statistical tests. The findings suggest a positive correlation between forecast accuracy and the level of data variability, and that experts’ adjustments are more beneficial in terms of achieving higher accuracy for series with higher variability. Industry practitioners’ forecasts outperformed academic researchers, particularly in making short-term forecasts. However, no significant difference was found between the two panels in making directionally correct forecasts. Experts’ judgmental intervention was found most useful for those series most in need of adjustment. The size of adjustment was found to have a strong and significantly positive association with the direction of forecast adjustment, but no statistically significant evidence was found regarding the relationship between accuracy improvement and adjustment size.

Suggested Citation

  • Vera Shanshan Lin, 2019. "Judgmental adjustments in tourism forecasting practice: How good are they?," Tourism Economics, , vol. 25(3), pages 402-424, May.
    • Handle: RePEc:sae:toueco:v:25:y:2019:i:3:p:402-424
    DOI: 10.1177/1354816618806727
    as

    Download full text from publisher

    File URL: https://journals.sagepub.com/doi/10.1177/1354816618806727
    Download Restriction: no
    File URL: https://libkey.io/10.1177/1354816618806727?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Willemain, Thomas R., 1989. "Graphical adjustment of statistical forecasts," International Journal of Forecasting, Elsevier, vol. 5(2), pages 179-185.
    2. Willemain, Thomas R., 1991. "The effect of graphical adjustment on forecast accuracy," International Journal of Forecasting, Elsevier, vol. 7(2), pages 151-154, August.
    3. Eggleton, Irc, 1982. "Intuitive Time-Series Extrapolation," Journal of Accounting Research, Wiley Blackwell, vol. 20(1), pages 68-102.
    4. Harvey, Nigel & Bolger, Fergus, 1996. "Graphs versus tables: Effects of data presentation format on judgemental forecasting," International Journal of Forecasting, Elsevier, vol. 12(1), pages 119-137, March.
    5. Greer, Mark, 2003. "Directional accuracy tests of long-term interest rate forecasts," International Journal of Forecasting, Elsevier, vol. 19(2), pages 291-298.
    6. Syntetos, Aris A. & Nikolopoulos, Konstantinos & Boylan, John E. & Fildes, Robert & Goodwin, Paul, 2009. "The effects of integrating management judgement into intermittent demand forecasts," International Journal of Production Economics, Elsevier, vol. 118(1), pages 72-81, March.
    7. Webby, Richard & O'Connor, Marcus, 1996. "Judgemental and statistical time series forecasting: a review of the literature," International Journal of Forecasting, Elsevier, vol. 12(1), pages 91-118, March.
    8. John B. Guerard & Carl R. Beidleman, 1987. "Composite Earnings Forecasting Efficiency," Interfaces, INFORMS, vol. 17(5), pages 103-113, October.
    9. Sanders, NR, 1992. "Accuracy of judgmental forecasts: A comparison," Omega, Elsevier, vol. 20(3), pages 353-364, May.
    10. Alberto Musso & Steven Phillips, 2002. "Comparing Projections and Outcomes of IMF-Supported Programs," IMF Staff Papers, Palgrave Macmillan, vol. 49(1), pages 1-3.
    11. Lobo, Gerald J., 1991. "Alternative methods of combining security analysts' and statistical forecasts of annual corporate earnings," International Journal of Forecasting, Elsevier, vol. 7(1), pages 57-63, May.
    12. Witt, Stephen F. & Witt, Christine A., 1995. "Forecasting tourism demand: A review of empirical research," International Journal of Forecasting, Elsevier, vol. 11(3), pages 447-475, September.
    13. Lin, Vera Shanshan & Goodwin, Paul & Song, Haiyan, 2014. "Accuracy and bias of experts’ adjusted forecasts," Annals of Tourism Research, Elsevier, vol. 48(C), pages 156-174.
    14. Wright, George & Lawrence, Michael J. & Collopy, Fred, 1996. "The role and validity of judgment in forecasting," International Journal of Forecasting, Elsevier, vol. 12(1), pages 1-8, March.
    15. Remus, William & O'Conner, Marcus & Griggs, Kenneth, 1996. "Does Feedback Improve the Accuracy of Recurrent Judgmental Forecasts?," Organizational Behavior and Human Decision Processes, Elsevier, vol. 66(1), pages 22-30, April.
    16. Remus, William & O'Connor, Marcus & Griggs, Kenneth, 1998. "The impact of incentives on the accuracy of subjects in judgmental forecasting experiments," International Journal of Forecasting, Elsevier, vol. 14(4), pages 515-522, December.
    17. Fildes, Robert & Goodwin, Paul & Lawrence, Michael & Nikolopoulos, Konstantinos, 2009. "Effective forecasting and judgmental adjustments: an empirical evaluation and strategies for improvement in supply-chain planning," International Journal of Forecasting, Elsevier, vol. 25(1), pages 3-23.
    18. Robert Fildes & Paul Goodwin, 2007. "Against Your Better Judgment? How Organizations Can Improve Their Use of Management Judgment in Forecasting," Interfaces, INFORMS, vol. 37(6), pages 570-576, December.
    19. Song, Haiyan & Gao, Bastian Z. & Lin, Vera S., 2013. "Combining statistical and judgmental forecasts via a web-based tourism demand forecasting system," International Journal of Forecasting, Elsevier, vol. 29(2), pages 295-310.
    20. Goodwin, Paul, 2002. "Integrating management judgment and statistical methods to improve short-term forecasts," Omega, Elsevier, vol. 30(2), pages 127-135, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Larissa Koupriouchina & Jean-Pierre van der Rest & Zvi Schwartz, 2023. "Judgmental Adjustments of Algorithmic Hotel Occupancy Forecasts: Does User Override Frequency Impact Accuracy at Different Time Horizons?," Tourism Economics, , vol. 29(8), pages 2143-2164, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    2. Lin, Vera Shanshan & Goodwin, Paul & Song, Haiyan, 2014. "Accuracy and bias of experts’ adjusted forecasts," Annals of Tourism Research, Elsevier, vol. 48(C), pages 156-174.
    3. Leitner, Johannes & Leopold-Wildburger, Ulrike, 2011. "Experiments on forecasting behavior with several sources of information - A review of the literature," European Journal of Operational Research, Elsevier, vol. 213(3), pages 459-469, September.
    4. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    5. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    6. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    7. Eksoz, Can & Mansouri, S. Afshin & Bourlakis, Michael & Önkal, Dilek, 2019. "Judgmental adjustments through supply integration for strategic partnerships in food chains," Omega, Elsevier, vol. 87(C), pages 20-33.
    8. Petropoulos, Fotios & Goodwin, Paul & Fildes, Robert, 2017. "Using a rolling training approach to improve judgmental extrapolations elicited from forecasters with technical knowledge," International Journal of Forecasting, Elsevier, vol. 33(1), pages 314-324.
    9. Baecke, Philippe & De Baets, Shari & Vanderheyden, Karlien, 2017. "Investigating the added value of integrating human judgement into statistical demand forecasting systems," International Journal of Production Economics, Elsevier, vol. 191(C), pages 85-96.
    10. Thomson, Mary E. & Onkal-Atay, Dilek & Pollock, Andrew C. & Macaulay, Alex, 2003. "The influence of trend strength on directional probabilistic currency predictions," International Journal of Forecasting, Elsevier, vol. 19(2), pages 241-256.
    11. Eksoz, Can & Mansouri, S. Afshin & Bourlakis, Michael, 2014. "Collaborative forecasting in the food supply chain: A conceptual framework," International Journal of Production Economics, Elsevier, vol. 158(C), pages 120-135.
    12. Franses, Philip Hans, 2013. "Improving judgmental adjustment of model-based forecasts," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 1-8.
    13. Van den Broeke, Maud & De Baets, Shari & Vereecke, Ann & Baecke, Philippe & Vanderheyden, Karlien, 2019. "Judgmental forecast adjustments over different time horizons," Omega, Elsevier, vol. 87(C), pages 34-45.
    14. Goodwin, Paul & Fildes, Robert & Lawrence, Michael & Stephens, Greg, 2011. "Restrictiveness and guidance in support systems," Omega, Elsevier, vol. 39(3), pages 242-253, June.
    15. Abolghasemi, Mahdi & Hurley, Jason & Eshragh, Ali & Fahimnia, Behnam, 2020. "Demand forecasting in the presence of systematic events: Cases in capturing sales promotions," International Journal of Production Economics, Elsevier, vol. 230(C).
    16. Webby, Richard & O'Connor, Marcus, 1996. "Judgemental and statistical time series forecasting: a review of the literature," International Journal of Forecasting, Elsevier, vol. 12(1), pages 91-118, March.
    17. Syntetos, Aris A. & Kholidasari, Inna & Naim, Mohamed M., 2016. "The effects of integrating management judgement into OUT levels: In or out of context?," European Journal of Operational Research, Elsevier, vol. 249(3), pages 853-863.
    18. Cedric A. Lehmann & Christiane B. Haubitz & Andreas Fügener & Ulrich W. Thonemann, 2022. "The risk of algorithm transparency: How algorithm complexity drives the effects on the use of advice," Production and Operations Management, Production and Operations Management Society, vol. 31(9), pages 3419-3434, September.
    19. Franses, Philip Hans & Legerstee, Rianne, 2013. "Do statistical forecasting models for SKU-level data benefit from including past expert knowledge?," International Journal of Forecasting, Elsevier, vol. 29(1), pages 80-87.
    20. Han, Weiwei & Wang, Xun & Petropoulos, Fotios & Wang, Jing, 2019. "Brain imaging and forecasting: Insights from judgmental model selection," Omega, Elsevier, vol. 87(C), pages 1-9.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sae:toueco:v:25:y:2019:i:3:p:402-424. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: SAGE Publications (email available below). General contact details of provider: .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.