IDEAS home Printed from https://ideas.repec.org/p/bcb/wpaper/161.html
   My bibliography  Save this paper

Evaluating Value-at-Risk Models via Quantile Regressions

Author

Listed:
  • Wagner P. Gaglianone
  • Luiz Renato Lima
  • Oliver Linton

Abstract

We propose an alternative backtest to evaluate the performance of Value-at-Risk (VaR) models. The presented methodology allows us to directly test the performance of many competing VaR models, as well as identify periods of an increased risk exposure based on a quantile regression model (Koenker & Xiao, 2002). Quantile regressions provide us an appropriate environment to investigate VaR models, since they can naturally be viewed as a conditional quantile function of a given return series. A Monte Carlo simulation is presented, revealing that our proposed test might exhibit more power in comparison to other backtests presented in the literature. Finally, an empirical exercise is conducted for daily S&P500 return series in order to explore the practical relevance of our methodology by evaluating five competing VaRs through four different backtests.

Suggested Citation

  • Wagner P. Gaglianone & Luiz Renato Lima & Oliver Linton, 2008. "Evaluating Value-at-Risk Models via Quantile Regressions," Working Papers Series 161, Central Bank of Brazil, Research Department.
  • Handle: RePEc:bcb:wpaper:161
    as

    Download full text from publisher

    File URL: https://www.bcb.gov.br/content/publicacoes/WorkingPaperSeries/wps161.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Len Umantsev & Victor Chernozhukov, 2001. "Conditional value-at-risk: Aspects of modeling and estimation," Empirical Economics, Springer, vol. 26(1), pages 271-292.
    2. Moshe Buchinsky, 1998. "Recent Advances in Quantile Regression Models: A Practical Guideline for Empirical Research," Journal of Human Resources, University of Wisconsin Press, vol. 33(1), pages 88-126.
    3. Lima, Luiz Renato & Néri, Breno Pinheiro, 2007. "Comparing Value-at-Risk Methodologies," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 27(1), May.
    4. Jose A. Lopez, 1999. "Methods for evaluating value-at-risk estimates," Economic Review, Federal Reserve Bank of San Francisco, pages 3-17.
    5. Huisman, Ronald, et al, 2001. "Tail-Index Estimates in Small Samples," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(2), pages 208-216, April.
    6. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731.
    7. Linton, O. & Whang, Yoon-Jae, 2007. "The quantilogram: With an application to evaluating directional predictability," Journal of Econometrics, Elsevier, vol. 141(1), pages 250-282, November.
    8. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," Journal of Financial Econometrics, Oxford University Press, vol. 2(1), pages 84-108.
    9. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    10. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    11. Powell, James L., 1984. "Least absolute deviations estimation for the censored regression model," Journal of Econometrics, Elsevier, vol. 25(3), pages 303-325, July.
    12. R. F. Engle & A. J. Patton, 2001. "What good is a volatility model?," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 237-245.
    13. Hartz, Christoph & Mittnik, Stefan & Paolella, Marc, 2006. "Accurate value-at-risk forecasting based on the normal-GARCH model," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2295-2312, December.
    14. Casper G. de Vries & Gennady Samorodnitsky & Bjørn N. Jorgensen & Sarma Mandira & Jon Danielsson, 2005. "Subadditivity Re–Examined: the Case for Value-at-Risk," FMG Discussion Papers dp549, Financial Markets Group.
    15. Giacomini, Raffaella & Komunjer, Ivana, 2002. "Evaluation and Combination of Conditional Quantile Forecasts," University of California at San Diego, Economics Working Paper Series qt4n99t4wz, Department of Economics, UC San Diego.
    16. M.J.B. Hall, 1996. "The amendment to the capital accord to incorporate market risk," BNL Quarterly Review, Banca Nazionale del Lavoro, vol. 49(197), pages 271-277.
    17. Koenker, Roger & Bassett, Gilbert, Jr, 1982. "Robust Tests for Heteroscedasticity Based on Regression Quantiles," Econometrica, Econometric Society, vol. 50(1), pages 43-61, January.
    18. Jon Danielsson & Casper G. De Vries, 2000. "Value-at-Risk and Extreme Returns," Annals of Economics and Statistics, GENES, issue 60, pages 239-270.
    19. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
    20. Charles, Amelie & Darne, Olivier, 2005. "Outliers and GARCH models in financial data," Economics Letters, Elsevier, vol. 86(3), pages 347-352, March.
    21. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    22. Jacob A. Mincer & Victor Zarnowitz, 1969. "The Evaluation of Economic Forecasts," NBER Chapters, in: Economic Forecasts and Expectations: Analysis of Forecasting Behavior and Performance, pages 3-46, National Bureau of Economic Research, Inc.
    23. Jeremy Berkowitz & James O'Brien, 2002. "How Accurate Are Value‐at‐Risk Models at Commercial Banks?," Journal of Finance, American Finance Association, vol. 57(3), pages 1093-1111, June.
    24. Peter Christoffersen & Silvia Gonçalves, 2004. "Estimation Risk in Financial Risk Management," CIRANO Working Papers 2004s-15, CIRANO.
    25. José A. F. Machado & José Mata, 2001. "Earning functions in Portugal 1982-1994: Evidence from quantile regressions," Empirical Economics, Springer, vol. 26(1), pages 115-134.
    26. Sean D. Campbell, 2005. "A review of backtesting and backtesting procedures," Finance and Economics Discussion Series 2005-21, Board of Governors of the Federal Reserve System (U.S.).
    27. Issler, João Victor & Lima, Luiz Renato, 2009. "A panel data approach to economic forecasting: The bias-corrected average forecast," Journal of Econometrics, Elsevier, vol. 152(2), pages 153-164, October.
    28. Ding, Zhuanxin & Granger, Clive W. J. & Engle, Robert F., 1993. "A long memory property of stock market returns and a new model," Journal of Empirical Finance, Elsevier, vol. 1(1), pages 83-106, June.
    29. Keith Kuester & Stefan Mittnik & Marc S. Paolella, 2006. "Value-at-Risk Prediction: A Comparison of Alternative Strategies," Journal of Financial Econometrics, Oxford University Press, vol. 4(1), pages 53-89.
    30. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    31. Danielsson, Jon & Zigrand, Jean-Pierre, 2006. "On time-scaling of risk and the square-root-of-time rule," Journal of Banking & Finance, Elsevier, vol. 30(10), pages 2701-2713, October.
    32. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
    33. Pascual, Lorenzo & Romo, Juan & Ruiz, Esther, 2006. "Bootstrap prediction for returns and volatilities in GARCH models," Computational Statistics & Data Analysis, Elsevier, vol. 50(9), pages 2293-2312, May.
    34. Koenker, Roger & Zhao, Quanshui, 1996. "Conditional Quantile Estimation and Inference for Arch Models," Econometric Theory, Cambridge University Press, vol. 12(5), pages 793-813, December.
    35. Franses, Philip Hans & Ghijsels, Hendrik, 1999. "Additive outliers, GARCH and forecasting volatility," International Journal of Forecasting, Elsevier, vol. 15(1), pages 1-9, February.
    36. Christoffersen, Peter & Hahn, Jinyong & Inoue, Atsushi, 2001. "Testing and comparing Value-at-Risk measures," Journal of Empirical Finance, Elsevier, vol. 8(3), pages 325-342, July.
    37. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    38. Paul Embrechts & Sidney Resnick & Gennady Samorodnitsky, 1999. "Extreme Value Theory as a Risk Management Tool," North American Actuarial Journal, Taylor & Francis Journals, vol. 3(2), pages 30-41.
    39. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    40. Roger Koenker & Zhijie Xiao, 2002. "Inference on the Quantile Regression Process," Econometrica, Econometric Society, vol. 70(4), pages 1583-1612, July.
    41. Stock J.H. & Watson M.W., 2002. "Forecasting Using Principal Components From a Large Number of Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 97, pages 1167-1179, December.
    42. Matthew Pritsker, 2001. "The hidden dangers of historical simulation," Finance and Economics Discussion Series 2001-27, Board of Governors of the Federal Reserve System (U.S.).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    2. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    3. Nieto, María Rosa, 2008. "Measuring financial risk : comparison of alternative procedures to estimate VaR and ES," DES - Working Papers. Statistics and Econometrics. WS ws087326, Universidad Carlos III de Madrid. Departamento de Estadística.
    4. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    5. Benjamin Mögel & Benjamin R. Auer, 2018. "How accurate are modern Value-at-Risk estimators derived from extreme value theory?," Review of Quantitative Finance and Accounting, Springer, vol. 50(4), pages 979-1030, May.
    6. Torben G. Andersen & Tim Bollerslev & Peter F. Christoffersen & Francis X. Diebold, 2005. "Volatility Forecasting," PIER Working Paper Archive 05-011, Penn Institute for Economic Research, Department of Economics, University of Pennsylvania.
    7. Gaglianone, Wagner Piazza & Marins, Jaqueline Terra Moura, 2017. "Evaluation of exchange rate point and density forecasts: An application to Brazil," International Journal of Forecasting, Elsevier, vol. 33(3), pages 707-728.
    8. Lima, Luiz Renato & Néri, Breno Pinheiro, 2007. "Comparing Value-at-Risk Methodologies," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 27(1), May.
    9. Bakshi, Gurdip & Panayotov, George, 2010. "First-passage probability, jump models, and intra-horizon risk," Journal of Financial Economics, Elsevier, vol. 95(1), pages 20-40, January.
    10. Benjamin R. Auer & Benjamin Mögel, 2016. "How Accurate are Modern Value-at-Risk Estimators Derived from Extreme Value Theory?," CESifo Working Paper Series 6288, CESifo.
    11. Escanciano, J. C. & Olmo, J., 2007. "Estimation risk effects on backtesting for parametric value-at-risk models," Working Papers 07/11, Department of Economics, City University London.
    12. Lazar, Emese & Zhang, Ning, 2019. "Model risk of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 105(C), pages 74-93.
    13. Şener, Emrah & Baronyan, Sayad & Ali Mengütürk, Levent, 2012. "Ranking the predictive performances of value-at-risk estimation methods," International Journal of Forecasting, Elsevier, vol. 28(4), pages 849-873.
    14. George Kouretas & Leonidas Zarangas, 2005. "Conditional autoregressive valu at risk by regression quantile: Estimatingmarket risk for major stock markets," Working Papers 0521, University of Crete, Department of Economics.
    15. Xiao, Zhijie, 2009. "Quantile cointegrating regression," Journal of Econometrics, Elsevier, vol. 150(2), pages 248-260, June.
    16. Jimenez-Martin, Juan-Angel & McAleer, Michael & Pérez-Amaral, Teodosio & Santos, Paulo Araújo, 2013. "GFC-robust risk management under the Basel Accord using extreme value methodologies," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 94(C), pages 223-237.
    17. Hartz, Christoph & Mittnik, Stefan & Paolella, Marc, 2006. "Accurate value-at-risk forecasting based on the normal-GARCH model," Computational Statistics & Data Analysis, Elsevier, vol. 51(4), pages 2295-2312, December.
    18. Vica Tendenan & Richard Gerlach & Chao Wang, 2020. "Tail risk forecasting using Bayesian realized EGARCH models," Papers 2008.05147, arXiv.org, revised Aug 2020.
    19. Geenens, Gery & Dunn, Richard, 2022. "A nonparametric copula approach to conditional Value-at-Risk," Econometrics and Statistics, Elsevier, vol. 21(C), pages 19-37.
    20. Chebbi, Ali & Hedhli, Amel, 2022. "Revisiting the accuracy of standard VaR methods for risk assessment: Using the Copula–EVT multidimensional approach for stock markets in the MENA region," The Quarterly Review of Economics and Finance, Elsevier, vol. 84(C), pages 430-445.

    More about this item

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • G11 - Financial Economics - - General Financial Markets - - - Portfolio Choice; Investment Decisions

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bcb:wpaper:161. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Rodrigo Barbone Gonzalez (email available below). General contact details of provider: https://www.bcb.gov.br/en .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.