IDEAS home Printed from https://ideas.repec.org/a/bla/stanee/v63y2009i3p334-346.html
   My bibliography  Save this article

Expert opinion versus expertise in forecasting

Author

Listed:
  • Philip Hans Franses
  • Michael McAleer
  • Rianne Legerstee

Abstract

Expert opinion is an opinion given by an expert, and it can have significant value in forecasting key policy variables in economics and finance. Expert forecasts can either be expert opinions, or forecasts based on an econometric model. An expert forecast that is based on an econometric model is replicable, and can be defined as a replicable expert forecast (REF), whereas an expert opinion that is not based on an econometric model can be defined as a non‐replicable expert forecast (Non‐REF). Both REF and Non‐REF may be made available by an expert regarding a policy variable of interest. In this paper, we develop a model to generate REF, and compare REF with Non‐REF. A method is presented to compare REF and Non‐REF using efficient estimation methods, and a direct test of expertise on expert opinion is given. The latter serves the purpose of investigating whether expert adjustment improves the model‐based forecasts. Illustrations for forecasting pharmaceutical stock keeping unit (SKUs), where the econometric model is of (variations of) the autoregressive integrated moving average model (ARIMA) type, show the relevance of the new methodology proposed in the paper. In particular, experts possess significant expertise, and expert forecasts are significant in explaining actual sales.

Suggested Citation

  • Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2009. "Expert opinion versus expertise in forecasting," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 63(3), pages 334-346, August.
    • Handle: RePEc:bla:stanee:v:63:y:2009:i:3:p:334-346
    DOI: 10.1111/j.1467-9574.2009.00426.x
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/j.1467-9574.2009.00426.x
    Download Restriction: no
    File URL: https://libkey.io/10.1111/j.1467-9574.2009.00426.x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Mcleer, M. & Mckenzie, C.R., 1989. "When Are Two Step Estimators Efficient?," Papers 179, Australian National University - Department of Economics.
    2. Franses, Philip Hans, 2008. "Merging models and experts," International Journal of Forecasting, Elsevier, vol. 24(1), pages 31-33.
    3. McAleer, Michael, 1995. "The significance of testing empirical non-nested models," Journal of Econometrics, Elsevier, vol. 67(1), pages 149-171, May.
    4. Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
    5. Goodwin, Paul, 2000. "Improving the voluntary integration of statistical forecasts and judgment," International Journal of Forecasting, Elsevier, vol. 16(1), pages 85-99.
    6. Fiebig, Denzil G. & McAleer, Michael & Bartels, Robert, 1992. "Properties of ordinary least squares estimators in regression models with nonspherical disturbances," Journal of Econometrics, Elsevier, vol. 54(1-3), pages 321-334.
    7. Suhejla Hoti & Michael McAleer & Daniel Slottje, 2006. "Intellectual Property Litigation Activity In The Usa," Journal of Economic Surveys, Wiley Blackwell, vol. 20(4), pages 715-729, September.
    8. Franses, Ph.H.B.F. & Kranendonk, H.C. & Lanser, D., 2007. "On the optimality of expert-adjusted forecasts," Econometric Institute Research Papers EI 2007-38, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    9. Christina D. Romer & David H. Romer, 2008. "The FOMC versus the Staff: Where Can Monetary Policymakers Add Value?," American Economic Review, American Economic Association, vol. 98(2), pages 230-235, May.
    10. Patton, Andrew J. & Timmermann, Allan, 2007. "Properties of optimal forecasts under asymmetric loss and nonlinearity," Journal of Econometrics, Elsevier, vol. 140(2), pages 884-918, October.
    11. repec:bla:ecorec:v:68:y:1992:i:200:p:65-72 is not listed on IDEAS
    12. Franses, Philip Hans & Legerstee, Rianne, 2009. "Properties of expert adjustments on model-based SKU-level forecasts," International Journal of Forecasting, Elsevier, vol. 25(1), pages 35-47.
    13. Robert C. Blattberg & Stephen J. Hoch, 1990. "Database Models and Managerial Intuition: 50% Model + 50% Manager," Management Science, INFORMS, vol. 36(8), pages 887-899, August.
    14. Oxley, Les & McAleer, Michael, 1993. "Econometric Issues in Macroeconomic Models with Generated Regressors," Journal of Economic Surveys, Wiley Blackwell, vol. 7(1), pages 1-40.
    15. Pagan, Adrian, 1984. "Econometric Issues in the Analysis of Regressions with Generated Regressors," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 25(1), pages 221-247, February.
    16. Bunn, Derek W. & Salo, Ahti A., 1996. "Adjustment of forecasts with model consistent expectations," International Journal of Forecasting, Elsevier, vol. 12(1), pages 163-170, March.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chang, Chia-Lin & de Bruijn, Bert & Franses, Philip Hans & McAleer, Michael, 2013. "Analyzing fixed-event forecast revisions," International Journal of Forecasting, Elsevier, vol. 29(4), pages 622-627.
    2. Chang, C-L. & McAleer, M.J. & Franses, Ph.H.B.F., 2010. "Combining Non-Replicable Forecasts," Econometric Institute Research Papers EI 2010-44, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    3. Chia-Lin Chang & Michael Mcaleer, 2013. "What Do Experts Know About Forecasting Journal Quality? A Comparison With Isi Research Impact In Finance," Annals of Financial Economics (AFE), World Scientific Publishing Co. Pte. Ltd., vol. 8(01), pages 1-30.
    4. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2013. "Are forecast updates progressive?," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 9-18.
    5. Franses, Ph.H.B.F. & McAleer, M.J. & Legerstee, R., 2008. "Does the ROMC have expertise, and can it forecast?," Econometric Institute Research Papers EI 2008-33, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    6. Chia-Lin Chang & Philip Hans Franses & Michael McAleer, 2010. "Evaluating Combined Non-Replicable Forecasts," KIER Working Papers 744, Kyoto University, Institute of Economic Research.
    7. Chang, C-L. & McAleer, M.J., 2012. "What do Experts Know About Ranking Journal Quality? A Comparison with ISI Research Impact in Finance," Econometric Institute Research Papers EI2012-01, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    8. Franses, Ph.H.B.F., 2009. "Forecasting Sales," Econometric Institute Research Papers EI 2009-29, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    9. Franses, Ph.H.B.F. & McAleer, M.J. & Legerstee, R., 2010. "Evaluating Macroeconomic Forecast: A Review of Some Recent Developments," Econometric Institute Research Papers EI 2010-19, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    10. Egor Griva & Irina Butorina & Anatoly Sidorov & Pavel Senchenko, 2022. "Analysis and Forecasting of Sales Funnels," Mathematics, MDPI, vol. 11(1), pages 1-22, December.
    11. Chang, Chia Lin & Franses, Philip Hans & Mcaleer, Michael, 2012. "Evaluating Individual and Mean Non-Replicable Forecasts," Journal for Economic Forecasting, Institute for Economic Forecasting, vol. 0(3), pages 22-43, September.
    12. Franses, Ph.H.B.F., 2010. "Decomposing bias in expert forecast," Econometric Institute Research Papers EI 2010-26, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    13. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2011. "How accurate are government forecasts of economic fundamentals? The case of Taiwan," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1066-1075, October.
    14. Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2014. "Evaluating Macroeconomic Forecasts: A Concise Review Of Some Recent Developments," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 195-208, April.
    15. Franses, Philip Hans, 2013. "Improving judgmental adjustment of model-based forecasts," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 1-8.
    16. Philip Hans Franses, 2011. "Averaging Model Forecasts and Expert Forecasts: Why Does It Work?," Interfaces, INFORMS, vol. 41(2), pages 177-181, April.
    17. Chang, C-L. & Franses, Ph.H.B.F. & McAleer, M.J., 2009. "How Accurate are Government Forecast of Economic Fundamentals?," Econometric Institute Research Papers EI 2009-09, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2011. "How accurate are government forecasts of economic fundamentals? The case of Taiwan," International Journal of Forecasting, Elsevier, vol. 27(4), pages 1066-1075, October.
    2. Chang, C-L. & Franses, Ph.H.B.F. & McAleer, M.J., 2009. "How Accurate are Government Forecast of Economic Fundamentals?," Econometric Institute Research Papers EI 2009-09, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    3. Chia-Lin Chang & Philip Hans Franses & Michael McAleer, 2010. "Combining Non-Replicable Forecasts," Working Papers in Economics 10/35, University of Canterbury, Department of Economics and Finance.
    4. Chang, Chia-Lin & Franses, Philip Hans & McAleer, Michael, 2013. "Are forecast updates progressive?," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 93(C), pages 9-18.
    5. Legerstee, R. & Franses, Ph.H.B.F. & Paap, R., 2011. "Do experts incorporate statistical model forecasts and should they?," Econometric Institute Research Papers EI2011-32, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    6. Philip Hans Franses & Rianne Legerstee, 2010. "Do experts' adjustments on model-based SKU-level forecasts improve forecast quality?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 29(3), pages 331-340.
    7. P H Franses & R Legerstee, 2011. "Experts' adjustment to model-based SKU-level forecasts: does the forecast horizon matter?," Journal of the Operational Research Society, Palgrave Macmillan;The OR Society, vol. 62(3), pages 537-543, March.
    8. Franses, Ph.H.B.F. & McAleer, M.J. & Legerstee, R., 2008. "Does the ROMC have expertise, and can it forecast?," Econometric Institute Research Papers EI 2008-33, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    9. Branston, Christopher B. & Groenewold, Nicolaas, 2004. "Investment and share prices: fundamental versus speculative components," The North American Journal of Economics and Finance, Elsevier, vol. 15(2), pages 199-226, August.
    10. De Baets, Shari & Harvey, Nigel, 2018. "Forecasting from time series subject to sporadic perturbations: Effectiveness of different types of forecasting support," International Journal of Forecasting, Elsevier, vol. 34(2), pages 163-180.
    11. Franses, Ph.H.B.F. & Legerstee, R., 2007. "What drives the relevance and quality of experts' adjustment to model-based forecasts?," Econometric Institute Research Papers EI 2007-43, Erasmus University Rotterdam, Erasmus School of Economics (ESE), Econometric Institute.
    12. Arvan, Meysam & Fahimnia, Behnam & Reisi, Mohsen & Siemsen, Enno, 2019. "Integrating human judgement into quantitative forecasting methods: A review," Omega, Elsevier, vol. 86(C), pages 237-252.
    13. Kearney, Colm, 2000. "The determination and international transmission of stock market volatility," Global Finance Journal, Elsevier, vol. 11(1-2), pages 31-52.
    14. Rianne Legerstee & Philip Hans Franses, 2014. "Do Experts’ SKU Forecasts Improve after Feedback?," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 33(1), pages 69-79, January.
    15. Philip Hans Franses & Michael McAleer & Rianne Legerstee, 2014. "Evaluating Macroeconomic Forecasts: A Concise Review Of Some Recent Developments," Journal of Economic Surveys, Wiley Blackwell, vol. 28(2), pages 195-208, April.
    16. Franses, Philip Hans & Kranendonk, Henk C. & Lanser, Debby, 2011. "One model and various experts: Evaluating Dutch macroeconomic forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 482-495.
    17. Philip Hans Franses, 2021. "Modeling Judgment in Macroeconomic Forecasts," Journal of Quantitative Economics, Springer;The Indian Econometric Society (TIES), vol. 19(1), pages 401-417, December.
    18. Diamandis, Panayiotis F. & Kouretas, Georgios P. & Zarangas, Leonidas, 2007. "Dual foreign currency markets and the role of expectations: Evidence from the Pacific Basin countries," Research in International Business and Finance, Elsevier, vol. 21(2), pages 238-259, June.
    19. Kearney, Colm & Daly, Kevin, 1997. "Monetary volatility and real output volatility: An empirical model of the financial transmission mechanism in Australia," International Review of Financial Analysis, Elsevier, vol. 6(2), pages 77-95.
    20. Christian Pierdzioch & Jan-Christoph Rülke & Peter Tillmann, 2013. "Using forecasts to uncover the loss function of FOMC members," MAGKS Papers on Economics 201302, Philipps-Universität Marburg, Faculty of Business Administration and Economics, Department of Economics (Volkswirtschaftliche Abteilung).

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:stanee:v:63:y:2009:i:3:p:334-346. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0039-0402 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.