Proper scoring rules for evaluating asymmetry in density forecasting
Author
Abstract
Suggested Citation
Download full text from publisher
Other versions of this item:
- Matteo Iacopini & Francesco Ravazzolo & Luca Rossini, 2020. "Proper scoring rules for evaluating asymmetry in density forecasting," Papers 2006.11265, arXiv.org, revised Sep 2020.
References listed on IDEAS
- Demetrescu, Matei & Hacıoğlu Hoke, Sinem, 2019.
"Predictive regressions under asymmetric loss: Factor augmentation and model selection,"
International Journal of Forecasting, Elsevier, vol. 35(1), pages 80-99.
- Demetrescu, Matei & Hacioglu Hoke, Sinem, 2018. "Predictive regressions under asymmetric loss: factor augmentation and model selection," Bank of England working papers 723, Bank of England.
- Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
- Michael Artis & Massimiliano Marcellino, 2001.
"Fiscal forecasting: The track record of the IMF, OECD and EC,"
Econometrics Journal, Royal Economic Society, vol. 4(1), pages 20-36.
- Artis, Michael J & Marcellino, Massimiliano, 1999. "Fiscal Forecasting: the Track Record of the IMF, OECD, and EC," CEPR Discussion Papers 2206, C.E.P.R. Discussion Papers.
- Artis, M. & Marcellino, M., 1999. "Fiscal Forecasting: the Track Record of the IMF, OECD and EC," Economics Working Papers eco99/22, European University Institute.
- James E. Matheson & Robert L. Winkler, 1976. "Scoring Rules for Continuous Probability Distributions," Management Science, INFORMS, vol. 22(10), pages 1087-1096, June.
- Christoffersen, Peter F & Diebold, Francis X, 1996.
"Further Results on Forecasting and Model Selection under Asymmetric Loss,"
Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 11(5), pages 561-571, Sept.-Oct.
- Christoffersen & Diebold, "undated". "Further Results on Forecasting and Model Selection Under Asymmetric Loss," Home Pages _059, University of Pennsylvania.
- Raffaella Giacomini & Barbara Rossi, 2010.
"Forecast comparisons in unstable environments,"
Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(4), pages 595-620.
- Giacomini, Raffaella & Rossi, Barbara, 2008. "Forecast Comparisons in Unstable Environments," Working Papers 08-04, Duke University, Department of Economics.
- Tilmann Gneiting & Roopesh Ranjan, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(3), pages 411-422, July.
- Rossi, Barbara & Sekhposyan, Tatevik, 2013.
"Conditional predictive density evaluation in the presence of instabilities,"
Journal of Econometrics, Elsevier, vol. 177(2), pages 199-212.
- Barbara Rossi & Tatevik Sehkposyan, 2013. "Conditional Predictive Density Evaluation in the Presence of Instabilities," Working Papers 688, Barcelona School of Economics.
- Barbara Rossi & Tatevik Sekhposyan, 2013. "Conditional predictive density evaluation in the presence of instabilities," Economics Working Papers 1368, Department of Economics and Business, Universitat Pompeu Fabra.
- G. A. Christodoulakis & E. C. Mamatzakis, 2009. "Assessing the prudence of economic forecasts in the EU," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 24(4), pages 583-606.
- Graham Elliott & Ivana Komunjer & Allan Timmermann, 2008.
"Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?,"
Journal of the European Economic Association, MIT Press, vol. 6(1), pages 122-157, March.
- Allan Timmermann & Graham Elliott & Ivana Komunjer, 2004. "Biases in Macroeconomic Forecasts: Irrationality or Asymmetric Loss?," Econometric Society 2004 North American Summer Meetings 601, Econometric Society.
- Graham Elliott & Ivana Komunjer & Allan Timmermann, 2005. "Biases In Macroeconomic Forecasts: Irrationality Or Asymmetric Loss?," CAMA Working Papers 2005-14, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Rossi, Barbara & Sekhposyan, Tatevik, 2014.
"Evaluating predictive densities of US output growth and inflation in a large macroeconomic data set,"
International Journal of Forecasting, Elsevier, vol. 30(3), pages 662-682.
- Barbara Rossi & Tatevik Sekhposyan, 2013. "Evaluating predictive densities of U.S. output growth and inflation in a large macroeconomic data set," Economics Working Papers 1370, Department of Economics and Business, Universitat Pompeu Fabra.
- Barbara Rossi & Tatevik Sehkposyan, 2013. "Evaluating Predictive Densities of US Output Growth and Inflation in a Large Macroeconomic Data Set," Working Papers 689, Barcelona School of Economics.
- Michael W. McCracken, 2020.
"Diverging Tests of Equal Predictive Ability,"
Econometrica, Econometric Society, vol. 88(4), pages 1753-1754, July.
- Michael W. McCracken, 2019. "Diverging Tests of Equal Predictive Ability," Working Papers 2019-018, Federal Reserve Bank of St. Louis, revised 09 Mar 2020.
- Graham Elliott & Allan Timmermann & Ivana Komunjer, 2005. "Estimation and Testing of Forecast Rationality under Flexible Loss," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 72(4), pages 1107-1125.
- Gneiting, Tilmann & Raftery, Adrian E., 2007. "Strictly Proper Scoring Rules, Prediction, and Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 359-378, March.
- Capistrán, Carlos & Timmermann, Allan, 2009.
"Forecast Combination With Entry and Exit of Experts,"
Journal of Business & Economic Statistics, American Statistical Association, vol. 27(4), pages 428-440.
- Timmermann Allan & Capistrán Carlos, 2006. "Forecast Combination with Entry and Exit of Experts," Working Papers 2006-08, Banco de México.
- Carlos Capistrán & Allan Timmermann, 2008. "Forecast Combination With Entry and Exit of Experts," CREATES Research Papers 2008-55, Department of Economics and Business Economics, Aarhus University.
- Tsuchiya, Yoichi, 2016. "Assessing macroeconomic forecasts for Japan under an asymmetric loss function," International Journal of Forecasting, Elsevier, vol. 32(2), pages 233-242.
- Andrea Carriero & Todd E. Clark & Marcellino Massimiliano, 2020. "Nowcasting Tail Risks to Economic Activity with Many Indicators," Working Papers 20-13R2, Federal Reserve Bank of Cleveland, revised 22 Sep 2020.
- Rossi, Barbara & Sekhposyan, Tatevik, 2019.
"Alternative tests for correct specification of conditional predictive densities,"
Journal of Econometrics, Elsevier, vol. 208(2), pages 638-657.
- Barbara Rossi & Tatevik Sekhposyan, 2014. "Alternative tests for correct specification of conditional predictive densities," Economics Working Papers 1416, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2017.
- Barbara Rossi & Tatevik Sekhposyan, 2015. "Alternative Tests for Correct Specification of Conditional Predictive Densities," Working Papers 758, Barcelona School of Economics.
- Christoffersen, Peter F. & Diebold, Francis X., 1997.
"Optimal Prediction Under Asymmetric Loss,"
Econometric Theory, Cambridge University Press, vol. 13(6), pages 808-817, December.
- Peter F. Christoffersen & Francis X. Diebold, "undated". "Optimal Prediction Under Asymmetric Loss," CARESS Working Papres 97-20, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
- Peter F. Christoffersen & Francis X. Diebold, 1997. "Optimal prediction under asymmetric loss," Working Papers 97-11, Federal Reserve Bank of Philadelphia.
- Peter F. Christoffersen & Francis X. Diebold, 1994. "Optimal Prediction Under Asymmetric Loss," NBER Technical Working Papers 0167, National Bureau of Economic Research, Inc.
- Christoffersen & Diebold, "undated". "Optimal Prediction Under Asymmetric Loss," Home Pages 167, 1996., University of Pennsylvania.
- George A. Christodoulakis & Emmanuel C. Mamatzakis, 2008. "An assessment of the EU growth forecasts under asymmetric preferences," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 27(6), pages 483-492.
- Rossi, Barbara & Odendahl, Florens & Sekhposyan, Tatevik, 2020. "Comparing Forecast Performance with State Dependence," CEPR Discussion Papers 15217, C.E.P.R. Discussion Papers.
- Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
- Robert L. Winkler, 1994. "Evaluating Probabilities: Asymmetric Scoring Rules," Management Science, INFORMS, vol. 40(11), pages 1395-1405, November.
- Amisano, Gianni & Giacomini, Raffaella, 2007.
"Comparing Density Forecasts via Weighted Likelihood Ratio Tests,"
Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
- Gianni Amisano & Raffaella Giacomini, 2005. "Comparing Density Forecsts via Weighted Likelihood Ratio Tests," Working Papers ubs0504, University of Brescia, Department of Economics.
- Elliott, Graham & Timmermann, Allan, 2004.
"Optimal forecast combinations under general loss functions and forecast error distributions,"
Journal of Econometrics, Elsevier, vol. 122(1), pages 47-79, September.
- Elliott, Graham & Timmermann, Allan, 2002. "Optimal Forecast Combination Under General Loss Functions and Forecast Error Distributions," University of California at San Diego, Economics Working Paper Series qt15r9t2q2, Department of Economics, UC San Diego.
- Timmermann, Allan, 2006.
"Forecast Combinations,"
Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 4, pages 135-196,
Elsevier.
- Timmermann, Allan, 2005. "Forecast Combinations," CEPR Discussion Papers 5361, C.E.P.R. Discussion Papers.
- Marco Aiolfi & Carlos Capistrán & Allan Timmermann, 2010. "Forecast Combinations," CREATES Research Papers 2010-21, Department of Economics and Business Economics, Aarhus University.
- Aiolfi Marco & Capistrán Carlos & Timmermann Allan, 2010. "Forecast Combinations," Working Papers 2010-04, Banco de México.
- Gneiting, Tilmann & Ranjan, Roopesh, 2011. "Comparing Density Forecasts Using Threshold- and Quantile-Weighted Scoring Rules," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(3), pages 411-422.
- Angelica Gianfreda & Francesco Ravazzolo & Luca Rossini, 2020. "Large Time-Varying Volatility Models for Electricity Prices," Working Papers No 05/2020, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
- Patton, Andrew J. & Timmermann, Allan, 2007. "Testing Forecast Optimality Under Unknown Loss," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1172-1184, December.
- Dovern, Jonas & Jannsen, Nils, 2017.
"Systematic errors in growth expectations over the business cycle,"
International Journal of Forecasting, Elsevier, vol. 33(4), pages 760-769.
- Dovern, Jonas & Jannsen, Nils, 2015. "Systematic errors in growth expectations over the business cycle," Kiel Working Papers 1989, Kiel Institute for the World Economy (IfW Kiel).
Most related items
These are the items that most often cite the same works as this one and are cited by the same works as this one.- Emilio Zanetti Chini, 2018.
"Forecasters’ utility and forecast coherence,"
CREATES Research Papers
2018-23, Department of Economics and Business Economics, Aarhus University.
- Emilio Zanetti Chini, 2018. "Forecaster’s utility and forecasts coherence," DEM Working Papers Series 145, University of Pavia, Department of Economics and Management.
- Emilio Zanetti Chini, 2018. "Forecaster’s utility and forecasts coherence," CREATES Research Papers 2018-01, Department of Economics and Business Economics, Aarhus University.
- Demetrescu, Matei & Hacıoğlu Hoke, Sinem, 2019.
"Predictive regressions under asymmetric loss: Factor augmentation and model selection,"
International Journal of Forecasting, Elsevier, vol. 35(1), pages 80-99.
- Demetrescu, Matei & Hacioglu Hoke, Sinem, 2018. "Predictive regressions under asymmetric loss: factor augmentation and model selection," Bank of England working papers 723, Bank of England.
- Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207, April.
- Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022.
"Forecasting: theory and practice,"
International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
- Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
- Gneiting, Tilmann, 2011. "Quantiles as optimal point forecasts," International Journal of Forecasting, Elsevier, vol. 27(2), pages 197-207.
- Tsuchiya, Yoichi, 2023. "Assessing the World Bank’s growth forecasts," Economic Analysis and Policy, Elsevier, vol. 77(C), pages 64-84.
- Bjørnland, Hilde C. & Ravazzolo, Francesco & Thorsrud, Leif Anders, 2017.
"Forecasting GDP with global components: This time is different,"
International Journal of Forecasting, Elsevier, vol. 33(1), pages 153-173.
- Hilde C. Bjørnland & Francesco Ravazzolo & Leif Anders Thorsrud, 2015. "Forecasting GDP with global components. This time is different," Working Papers No 1/2015, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
- Hilde C. Bjørnland & Francesco Ravazzolo & Leif Anders Thorsrud, 2015. "Forecasting GDP with global components. This time is different," Working Paper 2015/05, Norges Bank.
- Hilde C. Bjornland & Francesco Ravazzolo & Leif Anders Thorsrud, 2016. "Forecasting GDP with global components. This time is different," CAMA Working Papers 2016-26, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Manzan, Sebastiano & Zerom, Dawit, 2013.
"Are macroeconomic variables useful for forecasting the distribution of U.S. inflation?,"
International Journal of Forecasting, Elsevier, vol. 29(3), pages 469-478.
- Manzan, Sebastiano & Zerom, Dawit, 2009. "Are Macroeconomic Variables Useful for Forecasting the Distribution of U.S. Inflation?," MPRA Paper 14387, University Library of Munich, Germany.
- Garratt, Anthony & Henckel, Timo & Vahey, Shaun P., 2023.
"Empirically-transformed linear opinion pools,"
International Journal of Forecasting, Elsevier, vol. 39(2), pages 736-753.
- Anthony Garratt & Timo Henckel & Shaun P. Vahey, 2019. "Empirically-transformed linear opinion pools," CAMA Working Papers 2019-47, Centre for Applied Macroeconomic Analysis, Crawford School of Public Policy, The Australian National University.
- Barbara Rossi, 2019.
"Forecasting in the presence of instabilities: How do we know whether models predict well and how to improve them,"
Economics Working Papers
1711, Department of Economics and Business, Universitat Pompeu Fabra, revised Jul 2021.
- Barbara Rossi, 2019. "Forecasting in the Presence of Instabilities: How Do We Know Whether Models Predict Well and How to Improve Them," Working Papers 1162, Barcelona School of Economics.
- Rossi, Barbara, 2020. "Forecasting in the Presence of Instabilities: How Do We Know Whether Models Predict Well and How to Improve Them," CEPR Discussion Papers 14472, C.E.P.R. Discussion Papers.
- Behrens, Christoph & Pierdzioch, Christian & Risse, Marian, 2018. "Testing the optimality of inflation forecasts under flexible loss with random forests," Economic Modelling, Elsevier, vol. 72(C), pages 270-277.
- Christoph Behrens, 2019. "A Nonparametric Evaluation of the Optimality of German Export and Import Growth Forecasts under Flexible Loss," Economies, MDPI, vol. 7(3), pages 1-23, September.
- Yoichi Tsuchiya, 2024. "Conservatism and information rigidity of the European Bank for Reconstruction and Development's growth forecast: Quarter‐century assessment," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 43(5), pages 1399-1421, August.
- Jörg Döpke & Ulrich Fritsche & Boriss Siliverstovs, 2010.
"Evaluating German business cycle forecasts under an asymmetric loss function,"
OECD Journal: Journal of Business Cycle Measurement and Analysis, OECD Publishing, Centre for International Research on Economic Tendency Surveys, vol. 2010(1), pages 1-18.
- Joerg Doepke & Ulrich Fritsche & Boriss Siliverstovs, 2009. "Evaluating German business cycle forecasts under an asymmetric loss function," KOF Working papers 09-237, KOF Swiss Economic Institute, ETH Zurich.
- Joerg Doepke & Ulrich Fritsche & Boriss Siliverstovs, 2009. "Evaluating German Business Cycle Forecasts Under an Asymmetric Loss Function," Macroeconomics and Finance Series 200905, University of Hamburg, Department of Socioeconomics.
- Federico Bassetti & Roberto Casarin & Francesco Ravazzolo, 2019. "Density Forecasting," BEMPS - Bozen Economics & Management Paper Series BEMPS59, Faculty of Economics and Management at the Free University of Bozen.
- Giovannelli, Alessandro & Pericoli, Filippo Maria, 2020. "Are GDP forecasts optimal? Evidence on European countries," International Journal of Forecasting, Elsevier, vol. 36(3), pages 963-973.
- Sebastiano Manzan, 2015. "Forecasting the Distribution of Economic Variables in a Data-Rich Environment," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 33(1), pages 144-164, January.
- Davide Pettenuzzo & Francesco Ravazzolo, 2016.
"Optimal Portfolio Choice Under Decision‐Based Model Combinations,"
Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 31(7), pages 1312-1332, November.
- Davide Pettenuzzo & Francesco Ravazzolo, 2014. "Optimal Portfolio Choice under Decision-Based Model Combinations," Working Papers 80, Brandeis University, Department of Economics and International Business School.
- Davide Pettenuzzo & Francesco Ravazzolo, 2015. "Optimal Portfolio Choice under Decision-Based Model Combinations," Working Papers No 9/2015, Centre for Applied Macro- and Petroleum economics (CAMP), BI Norwegian Business School.
- Davide Pettenuzzo & Francesco Ravazzolo, 2014. "Optimal portfolio choice under decision-based model combinations," Working Paper 2014/15, Norges Bank.
- Magnus Reif, 2020. "Macroeconomics, Nonlinearities, and the Business Cycle," ifo Beiträge zur Wirtschaftsforschung, ifo Institute - Leibniz Institute for Economic Research at the University of Munich, number 87.
- Rossi, Barbara, 2013.
"Advances in Forecasting under Instability,"
Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 1203-1324,
Elsevier.
- Barbara Rossi, 2011. "Advances in Forecasting Under Instability," Working Papers 11-20, Duke University, Department of Economics.
More about this item
Keywords
asymmetric continuous probablistic score; asymmetric loss; proper score; density forecast; predictive distribution; weighted score; probabilistic forecast;All these keywords.
NEP fields
This paper has been announced in the following NEP Reports:- NEP-FOR-2020-10-05 (Forecasting)
Statistics
Access and download statisticsCorrections
All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bny:wpaper:0089. See general information about how to correct material in RePEc.
If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.
If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .
If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.
For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Helene Olsen (email available below). General contact details of provider: https://edirc.repec.org/data/cambino.html .
Please note that corrections may take a couple of weeks to filter through the various RePEc services.