IDEAS home Printed from https://ideas.repec.org/p/pra/mprapa/8836.html
   My bibliography  Save this paper

Assessing probabilistic forecasts about particular situations

Author

Listed:
  • Green, Kesten C.

Abstract

How useful are probabilistic forecasts of the outcomes of particular situations? Potentially, they contain more information than unequivocal forecasts and, as they allow a more realistic representation of the relative likelihood of different outcomes, they might be more accurate and therefore more useful to decision makers. To test this proposition, I first compared a Squared-Error Skill Score (SESS) based on the Brier score with an Absolute-Error Skill Score (AESS), and found the latter more closely coincided with decision-makers’ interests. I then analysed data obtained in researching the problem of forecasting the decisions people make in conflict situations. In that research, participants were given lists of decisions that might be made and were asked to make a prediction either by choosing one of the decisions or by allocating percentages or relative frequencies to more than one of them. For this study I transformed the percentage and relative frequencies data into probabilistic forecasts. In most cases the participants chose a single decision. To obtain more data, I used a rule to derive probabilistic forecasts from structured analogies data, and transformed multiple singular forecasts for each combination of forecasting method and conflict into probabilistic forecasts. When compared using the AESS, probabilistic forecasts were not more skilful than unequivocal forecasts.

Suggested Citation

  • Green, Kesten C., 2008. "Assessing probabilistic forecasts about particular situations," MPRA Paper 8836, University Library of Munich, Germany.
  • Handle: RePEc:pra:mprapa:8836
    as

    Download full text from publisher

    File URL: https://mpra.ub.uni-muenchen.de/8836/1/MPRA_paper_8836.pdf
    File Function: original version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kesten C. Green & J. Scott Armstrong, 2004. "Value of Expertise For Forecasting Decisions in Conflicts," Monash Econometrics and Business Statistics Working Papers 27/04, Monash University, Department of Econometrics and Business Statistics.
    2. Green, Kesten C. & Armstrong, J. Scott, 2007. "Structured analogies for forecasting," International Journal of Forecasting, Elsevier, vol. 23(3), pages 365-376.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Green, Kesten C. & Armstrong, J. Scott, 2011. "Role thinking: Standing in other people's shoes to forecast decisions in conflicts," International Journal of Forecasting, Elsevier, vol. 27(1), pages 69-80, January.
    2. J. Scott Armstrong & Kesten C. Green, 2005. "Demand Forecasting: Evidence-based Methods," Monash Econometrics and Business Statistics Working Papers 24/05, Monash University, Department of Econometrics and Business Statistics.
    3. Nikolopoulos, Konstantinos & Litsa, Akrivi & Petropoulos, Fotios & Bougioukos, Vasileios & Khammash, Marwan, 2015. "Relative performance of methods for forecasting special events," Journal of Business Research, Elsevier, vol. 68(8), pages 1785-1791.
    4. Armstrong, J. Scott & Green, Kesten C. & Graefe, Andreas, 2015. "Golden rule of forecasting: Be conservative," Journal of Business Research, Elsevier, vol. 68(8), pages 1717-1731.
    5. Litsiou, Konstantia & Polychronakis, Yiannis & Karami, Azhdar & Nikolopoulos, Konstantinos, 2022. "Relative performance of judgmental methods for forecasting the success of megaprojects," International Journal of Forecasting, Elsevier, vol. 38(3), pages 1185-1196.
    6. Green, Kesten C., 2005. "Game theory, simulated interaction, and unaided judgement for forecasting decisions in conflicts: Further evidence," International Journal of Forecasting, Elsevier, vol. 21(3), pages 463-472.
    7. Green, Kesten C. & Armstrong, J. Scott, 2015. "Simple versus complex forecasting: The evidence," Journal of Business Research, Elsevier, vol. 68(8), pages 1678-1685.
    8. António Brandão Moniz, 2012. "Avaliação participativa de tecnologia e sustentabilidade organizacional [Participative technology assessment and organisational sustainability]," IET Working Papers Series 06/2012, Universidade Nova de Lisboa, IET/CICS.NOVA-Interdisciplinary Centre on Social Sciences, Faculty of Science and Technology.
    9. Schnaars, Steven, 2009. "Forecasting the future of technology by analogy—An evaluation of two prominent cases from the 20th century," Technology in Society, Elsevier, vol. 31(2), pages 187-195.
    10. Green, Kesten C. & Armstrong, J. Scott, 2007. "Structured analogies for forecasting," International Journal of Forecasting, Elsevier, vol. 23(3), pages 365-376.
    11. Savio, Nicolas D. & Nikolopoulos, Konstantinos, 2013. "A strategic forecasting framework for governmental decision-making and planning," International Journal of Forecasting, Elsevier, vol. 29(2), pages 311-321.
    12. Mauksch, Stefanie & von der Gracht, Heiko A. & Gordon, Theodore J., 2020. "Who is an expert for foresight? A review of identification methods," Technological Forecasting and Social Change, Elsevier, vol. 154(C).
    13. Akrivi LITSA & Fotios PETROPOULOS & Konstantinos NIKOLOPOULOS, 2012. "Forecasting the Success of Governmental "Incentivized" Initiatives: Case Study of a New Policy Promoting the Replacement of Old Household; Air-conditioners," Journal of Knowledge Management, Economics and Information Technology, ScientificPapers.org, vol. 2(1), pages 1-15, February.
    14. Michael R. Czinkota & Ilkka A. Ronkainen, 2009. "Trends and Indications in International Business," Management International Review, Springer, vol. 49(2), pages 249-265, April.
    15. Philippe Jacquart & J. Scott Armstrong, 2013. "The Ombudsman: Are Top Executives Paid Enough? An Evidence-Based Review," Interfaces, INFORMS, vol. 43(6), pages 580-589, December.
    16. Lee, Wing Yee & Goodwin, Paul & Fildes, Robert & Nikolopoulos, Konstantinos & Lawrence, Michael, 2007. "Providing support for the use of analogies in demand forecasting tasks," International Journal of Forecasting, Elsevier, vol. 23(3), pages 377-390.
    17. repec:cup:judgdm:v:12:y:2017:i:4:p:369-381 is not listed on IDEAS
    18. Katsagounos, Ilias & Thomakos, Dimitrios D. & Litsiou, Konstantia & Nikolopoulos, Konstantinos, 2021. "Superforecasting reality check: Evidence from a small pool of experts and expedited identification," European Journal of Operational Research, Elsevier, vol. 289(1), pages 107-117.
    19. Kang, Yanfei & Spiliotis, Evangelos & Petropoulos, Fotios & Athiniotis, Nikolaos & Li, Feng & Assimakopoulos, Vassilios, 2021. "Déjà vu: A data-centric forecasting approach through time series cross-similarity," Journal of Business Research, Elsevier, vol. 132(C), pages 719-731.
    20. Aysun Kapucugil Ikiz & Gizem Halil Utma, 2023. "Combined Forecasts of Intermittent Demand for Stock-keeping Units (SKUs)," World Journal of Applied Economics, WERI-World Economic Research Institute, vol. 9(1), pages 1-31, June.
    21. Piecyk, Maja I. & McKinnon, Alan C., 2010. "Forecasting the carbon footprint of road freight transport in 2020," International Journal of Production Economics, Elsevier, vol. 128(1), pages 31-42, November.

    More about this item

    Keywords

    accuracy; error measures; evaluation; forecasting methods; prediction;
    All these keywords.

    JEL classification:

    • D74 - Microeconomics - - Analysis of Collective Decision-Making - - - Conflict; Conflict Resolution; Alliances; Revolutions
    • C0 - Mathematical and Quantitative Methods - - General
    • F51 - International Economics - - International Relations, National Security, and International Political Economy - - - International Conflicts; Negotiations; Sanctions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:pra:mprapa:8836. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Joachim Winter (email available below). General contact details of provider: https://edirc.repec.org/data/vfmunde.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.