IDEAS home Printed from https://ideas.repec.org/a/eee/moneco/v118y2021icp312-330.html
   My bibliography  Save this article

Backtesting global Growth-at-Risk

Author

Listed:
  • Brownlees, Christian
  • Souza, André B.M.

Abstract

We conduct an out-of-sample backtesting exercise of Growth-at-Risk (GaR) predictions for 24 OECD countries. We consider forecasts constructed from quantile regression and GARCH models. The quantile regression forecasts are based on a set of recently proposed measures of downside risks to GDP, including the national financial conditions index. The backtesting results show that quantile regression and GARCH forecasts have a similar performance. If anything, our evidence suggests that standard volatility models such as the GARCH(1,1) are more accurate.

Suggested Citation

  • Brownlees, Christian & Souza, André B.M., 2021. "Backtesting global Growth-at-Risk," Journal of Monetary Economics, Elsevier, vol. 118(C), pages 312-330.
    • Handle: RePEc:eee:moneco:v:118:y:2021:i:c:p:312-330
    DOI: 10.1016/j.jmoneco.2020.11.003
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304393220301288
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmoneco.2020.11.003?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
    2. Mr. Ananthakrishnan Prasad & Mr. Selim A Elekdag & Mr. Phakawa Jeasakul & Romain Lafarguette & Mr. Adrian Alter & Alan Xiaochen Feng & Changchun Wang, 2019. "Growth at Risk: Concept and Application in IMF Country Surveillance," IMF Working Papers 2019/036, International Monetary Fund.
    3. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    4. Stock, James H. & Watson, Mark W., 2006. "Forecasting with Many Predictors," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 10, pages 515-554, Elsevier.
    5. Amisano, Gianni & Giacomini, Raffaella, 2007. "Comparing Density Forecasts via Weighted Likelihood Ratio Tests," Journal of Business & Economic Statistics, American Statistical Association, vol. 25, pages 177-190, April.
    6. Jon Faust & Simon Gilchrist & Jonathan H. Wright & Egon Zakrajšsek, 2013. "Credit Spreads as Predictors of Real-Time Economic Activity: A Bayesian Model-Averaging Approach," The Review of Economics and Statistics, MIT Press, vol. 95(5), pages 1501-1519, December.
    7. Scott R. Baker & Nicholas Bloom & Steven J. Davis, 2016. "Measuring Economic Policy Uncertainty," The Quarterly Journal of Economics, President and Fellows of Harvard College, vol. 131(4), pages 1593-1636.
    8. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    9. Tobias Adrian & Federico Grinberg & Nellie Liang & Sheheryar Malik & Jie Yu, 2022. "The Term Structure of Growth-at-Risk," American Economic Journal: Macroeconomics, American Economic Association, vol. 14(3), pages 283-323, July.
    10. Joseph P. Romano & Azeem M. Shaikh & Michael Wolf, 2010. "Hypothesis Testing in Econometrics," Annual Review of Economics, Annual Reviews, vol. 2(1), pages 75-104, September.
    11. White, Halbert & Kim, Tae-Hwan & Manganelli, Simone, 2015. "VAR for VaR: Measuring tail dependence using multivariate regression quantiles," Journal of Econometrics, Elsevier, vol. 187(1), pages 169-188.
    12. Linda Allen & Turan G. Bali & Yi Tang, 2012. "Does Systemic Risk in the Financial Sector Predict Future Economic Downturns?," The Review of Financial Studies, Society for Financial Studies, vol. 25(10), pages 3000-3036.
    13. Adelchi Azzalini & Antonella Capitanio, 2003. "Distributions generated by perturbation of symmetry with emphasis on a multivariate skew t‐distribution," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 65(2), pages 367-389, May.
    14. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    15. Christian Brownlees & Robert F. Engle, 2017. "SRISK: A Conditional Capital Shortfall Measure of Systemic Risk," The Review of Financial Studies, Society for Financial Studies, vol. 30(1), pages 48-79.
    16. Stijn Claessens & M. Ayhan Kose & Marco E. Terrones, 2009. "What happens during recessions, crunches and busts? [Business cycles for G-7 and European countries]," Economic Policy, CEPR, CESifo, Sciences Po;CES;MSH, vol. 24(60), pages 653-700.
    17. Estrella, Arturo & Hardouvelis, Gikas A, 1991. "The Term Structure as a Predictor of Real Economic Activity," Journal of Finance, American Finance Association, vol. 46(2), pages 555-576, June.
    18. Faust, Jon & Wright, Jonathan H., 2013. "Forecasting Inflation," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 2-56, Elsevier.
    19. Sulkhan Chavleishvili & Simone Manganelli, 2024. "Forecasting and stress testing with quantile vector autoregression," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(1), pages 66-85, January.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Diks, Cees & Fang, Hao, 2020. "Comparing density forecasts in a risk management context," International Journal of Forecasting, Elsevier, vol. 36(2), pages 531-551.
    2. Leopoldo Catania & Alessandra Luati & Pierluigi Vallarino, 2021. "Economic vulnerability is state dependent," CREATES Research Papers 2021-09, Department of Economics and Business Economics, Aarhus University.
    3. Iseringhausen, Martin, 2024. "A time-varying skewness model for Growth-at-Risk," International Journal of Forecasting, Elsevier, vol. 40(1), pages 229-246.
    4. Giglio, Stefano & Kelly, Bryan & Pruitt, Seth, 2016. "Systemic risk and the macroeconomy: An empirical evaluation," Journal of Financial Economics, Elsevier, vol. 119(3), pages 457-471.
    5. František Čech & Jozef Baruník, 2019. "Panel quantile regressions for estimating and predicting the value‐at‐risk of commodities," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 39(9), pages 1167-1189, September.
    6. Niango Ange Joseph Yapi, 2020. "Exchange rate predictive densities and currency risks: A quantile regression approach," EconomiX Working Papers 2020-16, University of Paris Nanterre, EconomiX.
    7. Timo Dimitriadis & Yannick Hoga, 2023. "Regressions under Adverse Conditions," Papers 2311.13327, arXiv.org, revised Jul 2024.
    8. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    9. Gaglianone, Wagner Piazza & Marins, Jaqueline Terra Moura, 2017. "Evaluation of exchange rate point and density forecasts: An application to Brazil," International Journal of Forecasting, Elsevier, vol. 33(3), pages 707-728.
    10. Laura Garcia-Jorcano & Lidia Sanchis-Marco, 2023. "Measuring Systemic Risk Using Multivariate Quantile-Located ES Models," Journal of Financial Econometrics, Oxford University Press, vol. 21(1), pages 1-72.
    11. Hua, Jian & Manzan, Sebastiano, 2013. "Forecasting the return distribution using high-frequency volatility measures," Journal of Banking & Finance, Elsevier, vol. 37(11), pages 4381-4403.
    12. Schüler, Yves S., 2020. "The impact of uncertainty and certainty shocks," Discussion Papers 14/2020, Deutsche Bundesbank.
    13. Bonaccolto, Giovanni & Caporin, Massimiliano & Paterlini, Sandra, 2019. "Decomposing and backtesting a flexible specification for CoVaR," Journal of Banking & Finance, Elsevier, vol. 108(C).
    14. Chen, Cathy W.S. & Gerlach, Richard & Hwang, Bruce B.K. & McAleer, Michael, 2012. "Forecasting Value-at-Risk using nonlinear regression quantiles and the intra-day range," International Journal of Forecasting, Elsevier, vol. 28(3), pages 557-574.
    15. Gloria González‐Rivera & C. Vladimir Rodríguez‐Caballero & Esther Ruiz, 2024. "Expecting the unexpected: Stressed scenarios for economic growth," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 39(5), pages 926-942, August.
    16. Chuliá, Helena & Garrón, Ignacio & Uribe, Jorge M., 2024. "Daily growth at risk: Financial or real drivers? The answer is not always the same," International Journal of Forecasting, Elsevier, vol. 40(2), pages 762-776.
    17. Hartwig, Benny & Meinerding, Christoph & Schüler, Yves S., 2021. "Identifying indicators of systemic risk," Journal of International Economics, Elsevier, vol. 132(C).
    18. Gaglianone, Wagner Piazza & Lima, Luiz Renato & Linton, Oliver & Smith, Daniel R., 2011. "Evaluating Value-at-Risk Models via Quantile Regression," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 150-160.
    19. Frantisek Cech & Jozef Barunik, 2017. "Measurement of Common Risk Factors: A Panel Quantile Regression Model for Returns," Working Papers IES 2017/20, Charles University Prague, Faculty of Social Sciences, Institute of Economic Studies, revised Sep 2017.
    20. Timo Dimitriadis & Xiaochun Liu & Julie Schnaitmann, 2020. "Encompassing Tests for Value at Risk and Expected Shortfall Multi-Step Forecasts based on Inference on the Boundary," Papers 2009.07341, arXiv.org.

    More about this item

    Keywords

    Growth-at-Risk; Backtesting; Quantile regression; GARCH;
    All these keywords.

    JEL classification:

    • C22 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Time-Series Models; Dynamic Quantile Regressions; Dynamic Treatment Effect Models; Diffusion Processes
    • C23 - Mathematical and Quantitative Methods - - Single Equation Models; Single Variables - - - Models with Panel Data; Spatio-temporal Models
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C53 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Forecasting and Prediction Models; Simulation Methods
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:moneco:v:118:y:2021:i:c:p:312-330. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/inca/505566 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.