IDEAS home Printed from https://ideas.repec.org/a/wly/fufsci/v4y2022i3-4nffo2124.html
   My bibliography  Save this article

Point, interval, and density forecasts: Differences in bias, judgment noise, and overall accuracy

Author

Listed:
  • Xiaoxiao Niu
  • Nigel Harvey

Abstract

There are three main ways in which judgmental predictions are expressed: point forecasts; interval forecasts; probability density forecasts. Do these approaches differ solely in terms of their simplicity of elicitation and the detail they provide? We examined error in values of the central tendency extracted from these three types of forecast in a domain in which all of them are used: lay forecasts of inflation. A first experiment using a between‐participant design showed that the mean level of forecasts and the bias in them are unaffected by the type of forecast but that judgment noise (and, hence, overall error) is higher in point forecasts than in interval or density forecasts. A second experiment replicated the difference between point and interval forecasts in a within‐participant design (of the sort used in inflation surveys) and showed no effect of the order in which different types of forecast are made but revealed that people are more overconfident in interval than in point forecasts. A third experiment showed that volatility in past data increases bias in point but not interval forecasts, and that taking the average of two point forecasts made by an individual reduces judgment noise to the level found in interval forecasting.

Suggested Citation

  • Xiaoxiao Niu & Nigel Harvey, 2022. "Point, interval, and density forecasts: Differences in bias, judgment noise, and overall accuracy," Futures & Foresight Science, John Wiley & Sons, vol. 4(3-4), September.
  • Handle: RePEc:wly:fufsci:v:4:y:2022:i:3-4:n:ffo2124
    DOI: 10.1002/ffo2.124
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/ffo2.124
    Download Restriction: no

    File URL: https://libkey.io/10.1002/ffo2.124?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. David Tannenbaum & Craig R. Fox & Gülden Ülkümen, 2017. "Judgment Extremity and Accuracy Under Epistemic vs. Aleatory Uncertainty," Management Science, INFORMS, vol. 63(2), pages 497-518, February.
    2. Bruine de Bruin, Wändi & van der Klaauw, Wilbert & Topa, Giorgio, 2011. "Expectations of inflation: The biasing effect of thoughts about specific prices," Journal of Economic Psychology, Elsevier, vol. 32(5), pages 834-845.
    3. Wändi Bruine De Bruin & Charles F. Manski & Giorgio Topa & Wilbert van der Klaauw, 2011. "Measuring consumer uncertainty about future inflation," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 26(3), pages 454-478, April.
    4. David Tannenbaum & Craig R. Fox & Gülden Ülkümen, 2017. "Judgment Extremity and Accuracy Under Epistemic vs. Aleatory Uncertainty," Management Science, INFORMS, vol. 63(2), pages 497-518, February.
    5. Dennie van Dolder & Martijn J. van den Assem, 2018. "The wisdom of the inner crowd in three large natural experiments," Nature Human Behaviour, Nature, vol. 2(1), pages 21-26, January.
    6. Engelberg, Joseph & Manski, Charles F. & Williams, Jared, 2009. "Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters," Journal of Business & Economic Statistics, American Statistical Association, vol. 27, pages 30-41.
    7. Benson, P. George & Onkal, Dilek, 1992. "The effects of feedback and training on the performance of probability forecasters," International Journal of Forecasting, Elsevier, vol. 8(4), pages 559-573, December.
    8. Lawrence, Michael & Goodwin, Paul & O'Connor, Marcus & Onkal, Dilek, 2006. "Judgmental forecasting: A review of progress over the last 25 years," International Journal of Forecasting, Elsevier, vol. 22(3), pages 493-518.
    9. Lawrence, Michael & O'Connor, Marcus, 1992. "Exploring judgemental forecasting," International Journal of Forecasting, Elsevier, vol. 8(1), pages 15-26, June.
    10. Fischhoff, Baruch, 1994. "What forecasts (seem to) mean," International Journal of Forecasting, Elsevier, vol. 10(3), pages 387-403, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Pfajfar, D. & Zakelj, B., 2012. "Uncertainty and Disagreement in Forecasting Inflation : Evidence from the Laboratory (Revised version of CentER DP 2011-053)," Other publications TiSEM 38fac5ce-fe8f-4b61-a679-f, Tilburg University, School of Economics and Management.
    2. Crump, Richard K. & Eusepi, Stefano & Tambalotti, Andrea & Topa, Giorgio, 2022. "Subjective intertemporal substitution," Journal of Monetary Economics, Elsevier, vol. 126(C), pages 118-133.
    3. Armantier, Olivier & Koşar, Gizem & Pomerantz, Rachel & Skandalis, Daphné & Smith, Kyle & Topa, Giorgio & van der Klaauw, Wilbert, 2021. "How economic crises affect inflation beliefs: Evidence from the Covid-19 pandemic," Journal of Economic Behavior & Organization, Elsevier, vol. 189(C), pages 443-469.
    4. Pfajfar, D. & Zakelj, B., 2012. "Uncertainty and Disagreement in Forecasting Inflation : Evidence from the Laboratory (Revised version of EBC DP 2011-014)," Other publications TiSEM 2b92a09f-918e-4614-978d-0, Tilburg University, School of Economics and Management.
    5. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    6. Olivier Armantier & Giorgio Topa & Wilbert Van der Klaauw & Basit Zafar, 2017. "An overview of the Survey of Consumer Expectations," Economic Policy Review, Federal Reserve Bank of New York, issue 23-2, pages 51-72.
    7. Becker, Christoph & Dürsch, Peter & Eife, Thomas A. & Glas, Alexander, 2023. "Households' probabilistic inflation expectations in high-inflation regimes," ZEW Discussion Papers 23-072, ZEW - Leibniz Centre for European Economic Research.
    8. Claire I. Tsai & Min Zhao & Dilip Soman, 2022. "Salient knowledge that others are also evaluating reduces judgment extremity," Journal of the Academy of Marketing Science, Springer, vol. 50(2), pages 366-387, March.
    9. Pennings, Clint L.P. & van Dalen, Jan & Rook, Laurens, 2019. "Coordinating judgmental forecasting: Coping with intentional biases," Omega, Elsevier, vol. 87(C), pages 46-56.
    10. Christopher Roth & Johannes Wohlfart, 2020. "How Do Expectations about the Macroeconomy Affect Personal Expectations and Behavior?," The Review of Economics and Statistics, MIT Press, vol. 102(4), pages 731-748, October.
    11. Thomson, Mary E. & Onkal-Atay, Dilek & Pollock, Andrew C. & Macaulay, Alex, 2003. "The influence of trend strength on directional probabilistic currency predictions," International Journal of Forecasting, Elsevier, vol. 19(2), pages 241-256.
    12. Daniel J. Walters & Philip M. Fernbach & Craig R. Fox & Steven A. Sloman, 2017. "Known Unknowns: A Critical Determinant of Confidence and Calibration," Management Science, INFORMS, vol. 63(12), pages 4298-4307, December.
    13. Alvarado-Valencia, Jorge & Barrero, Lope H. & Önkal, Dilek & Dennerlein, Jack T., 2017. "Expertise, credibility of system forecasts and integration methods in judgmental demand forecasting," International Journal of Forecasting, Elsevier, vol. 33(1), pages 298-313.
    14. Alexander Dietrich & Edward S. Knotek & Kristian Ove R. Myrseth & Robert W. Rich & Raphael Schoenle & Michael Weber, 2022. "Greater Than the Sum of the Parts: Aggregate vs. Aggregated Inflation Expectations," Working Papers 22-20, Federal Reserve Bank of Cleveland.
    15. Song, Haiyan & Gao, Bastian Z. & Lin, Vera S., 2013. "Combining statistical and judgmental forecasts via a web-based tourism demand forecasting system," International Journal of Forecasting, Elsevier, vol. 29(2), pages 295-310.
    16. Robert W. Rich & Joseph Tracy, 2017. "The behavior of uncertainty and disagreement and their roles in economic prediction: a panel analysis," Staff Reports 808, Federal Reserve Bank of New York.
    17. Wilbert van der Klaauw, 2012. "On the Use of Expectations Data in Estimating Structural Dynamic Choice Models," Journal of Labor Economics, University of Chicago Press, vol. 30(3), pages 521-554.
    18. Perera, H. Niles & Hurley, Jason & Fahimnia, Behnam & Reisi, Mohsen, 2019. "The human factor in supply chain forecasting: A systematic review," European Journal of Operational Research, Elsevier, vol. 274(2), pages 574-600.
    19. Webby, Richard & O'Connor, Marcus, 1996. "Judgemental and statistical time series forecasting: a review of the literature," International Journal of Forecasting, Elsevier, vol. 12(1), pages 91-118, March.
    20. Mirko Kremer & Brent Moritz & Enno Siemsen, 2011. "Demand Forecasting Behavior: System Neglect and Change Detection," Management Science, INFORMS, vol. 57(10), pages 1827-1843, October.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:fufsci:v:4:y:2022:i:3-4:n:ffo2124. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: https://doi.org/10.1002/(ISSN)2573-5152 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.