IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2009.07341.html
   My bibliography  Save this paper

Encompassing Tests for Value at Risk and Expected Shortfall Multi-Step Forecasts based on Inference on the Boundary

Author

Listed:
  • Timo Dimitriadis
  • Xiaochun Liu
  • Julie Schnaitmann

Abstract

We propose forecast encompassing tests for the Expected Shortfall (ES) jointly with the Value at Risk (VaR) based on flexible link (or combination) functions. Our setup allows testing encompassing for convex forecast combinations and for link functions which preclude crossings of the combined VaR and ES forecasts. As the tests based on these link functions involve parameters which are on the boundary of the parameter space under the null hypothesis, we derive and base our tests on nonstandard asymptotic theory on the boundary. Our simulation study shows that the encompassing tests based on our new link functions outperform tests based on unrestricted linear link functions for one-step and multi-step forecasts. We further illustrate the potential of the proposed tests in a real data analysis for forecasting VaR and ES of the S&P 500 index.

Suggested Citation

  • Timo Dimitriadis & Xiaochun Liu & Julie Schnaitmann, 2020. "Encompassing Tests for Value at Risk and Expected Shortfall Multi-Step Forecasts based on Inference on the Boundary," Papers 2009.07341, arXiv.org.
    • Handle: RePEc:arx:papers:2009.07341
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2009.07341
    File Function: Latest version
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Francq, Christian & Zakoïan, Jean-Michel, 2009. "Testing the Nullity of GARCH Coefficients: Correction of the Standard Tests and Relative Efficiency Comparisons," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 313-324.
    2. Natalia Nolde & Johanna F. Ziegel, 2016. "Elicitability and backtesting: Perspectives for banking regulation," Papers 1608.05498, arXiv.org, revised Feb 2017.
    3. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
    4. James W. Taylor, 2005. "Generating Volatility Forecasts from Value at Risk Estimates," Management Science, INFORMS, vol. 51(5), pages 712-725, May.
    5. Gerlach, Richard & Wang, Chao, 2020. "Semi-parametric dynamic asymmetric Laplace models for tail risk forecasting, incorporating realized measures," International Journal of Forecasting, Elsevier, vol. 36(2), pages 489-506.
    6. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    7. Wagner Piazza Gaglianone & Luiz Renato Lima & Oliver Linton & Daniel R. Smith, 2011. "Evaluating Value-at-Risk Models via Quantile Regression," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 29(1), pages 150-160, January.
    8. Raffaella Giacomini & Halbert White, 2006. "Tests of Conditional Predictive Ability," Econometrica, Econometric Society, vol. 74(6), pages 1545-1578, November.
    9. Clements, Michael P. & Reade, J. James, 2020. "Forecasting and forecast narratives: The Bank of England Inflation Reports," International Journal of Forecasting, Elsevier, vol. 36(4), pages 1488-1500.
    10. Pierre Giot & Sébastien Laurent, 2003. "Value-at-risk for long and short trading positions," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(6), pages 641-663.
    11. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    12. Sander Barendse & Erik Kole & Dick van Dijk, 2023. "Backtesting Value-at-Risk and Expected Shortfall in the Presence of Estimation Error," Journal of Financial Econometrics, Oxford University Press, vol. 21(2), pages 528-568.
    13. Mauro Costantini & Ulrich Gunter & Robert M. Kunst, 2017. "Forecast Combinations in a DSGE‐VAR Lab," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 36(3), pages 305-324, April.
    14. West, Kenneth D, 2001. "Tests for Forecast Encompassing When Forecasts Depend on Estimated Regression Parameters," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(1), pages 29-33, January.
    15. Michael P. Clements & David I. Harvey, 2009. "Forecast Combination and Encompassing," Palgrave Macmillan Books, in: Terence C. Mills & Kerry Patterson (ed.), Palgrave Handbook of Econometrics, chapter 4, pages 169-198, Palgrave Macmillan.
    16. Davidson, James, 1994. "Stochastic Limit Theory: An Introduction for Econometricians," OUP Catalogue, Oxford University Press, number 9780198774037.
    17. Weiss, Andrew A., 1991. "Estimating Nonlinear Dynamic Models Using Least Absolute Error Estimation," Econometric Theory, Cambridge University Press, vol. 7(1), pages 46-68, March.
    18. Donald W. K. Andrews, 1999. "Estimation When a Parameter Is on a Boundary," Econometrica, Econometric Society, vol. 67(6), pages 1341-1384, November.
    19. West, Kenneth D, 1996. "Asymptotic Inference about Predictive Ability," Econometrica, Econometric Society, vol. 64(5), pages 1067-1084, September.
    20. Acerbi, Carlo & Tasche, Dirk, 2002. "On the coherence of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1487-1503, July.
    21. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    22. Zhao, Yang & Li, Jianping & Yu, Lean, 2017. "A deep learning ensemble approach for crude oil price forecasting," Energy Economics, Elsevier, vol. 66(C), pages 9-16.
    23. Davidson, Russell & MacKinnon, James G, 1998. "Graphical Methods for Investigating the Size and Power of Hypothesis Tests," The Manchester School of Economic & Social Studies, University of Manchester, vol. 66(1), pages 1-26, January.
    24. Zeileis, Achim, 2004. "Econometric Computing with HC and HAC Covariance Matrix Estimators," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 11(i10).
    25. Kratz, Marie & Lok, Yen H. & McNeil, Alexander J., 2018. "Multinomial VaR backtests: A simple implicit approach to backtesting expected shortfall," Journal of Banking & Finance, Elsevier, vol. 88(C), pages 393-407.
    26. Andrews, Donald W.K., 1992. "Generic Uniform Convergence," Econometric Theory, Cambridge University Press, vol. 8(2), pages 241-257, June.
    27. Georgios Tsiotas, 2018. "A Bayesian encompassing test using combined value-at-risk estimates," Quantitative Finance, Taylor & Francis Journals, vol. 18(3), pages 395-417, March.
    28. Michael P. Clements & David I. Harvey, 2010. "Forecast encompassing tests and probability forecasts," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 25(6), pages 1028-1062.
    29. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    30. Diebold, Francis X., 1989. "Forecast combination and encompassing: Reconciling two divergent literatures," International Journal of Forecasting, Elsevier, vol. 5(4), pages 589-592.
    31. Xiaochun Liu, 2017. "An integrated macro‐financial risk‐based approach to the stressed capital requirement," Review of Financial Economics, John Wiley & Sons, vol. 34(1), pages 86-98, September.
    32. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    33. Andrews, Donald W K, 1991. "Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimation," Econometrica, Econometric Society, vol. 59(3), pages 817-858, May.
    34. Newey, Whitney & West, Kenneth, 2014. "A simple, positive semi-definite, heteroscedasticity and autocorrelation consistent covariance matrix," Applied Econometrics, Russian Presidential Academy of National Economy and Public Administration (RANEPA), vol. 33(1), pages 125-132.
    35. Harvey, David I. & Leybourne, Stephen J. & Whitehouse, Emily J., 2017. "Forecast evaluation tests and negative long-run variance estimates in small samples," International Journal of Forecasting, Elsevier, vol. 33(4), pages 833-847.
    36. Zeileis, Achim, 2006. "Object-oriented Computation of Sandwich Estimators," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 16(i09).
    37. You, Yu & Liu, Xiaochun, 2020. "Forecasting short-run exchange rate volatility with monetary fundamentals: A GARCH-MIDAS approach," Journal of Banking & Finance, Elsevier, vol. 116(C).
    38. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    39. Patton, Andrew J. & Ziegel, Johanna F. & Chen, Rui, 2019. "Dynamic semiparametric models for expected shortfall (and Value-at-Risk)," Journal of Econometrics, Elsevier, vol. 211(2), pages 388-413.
    40. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
    41. Chen, Qian & Gerlach, Richard & Lu, Zudi, 2012. "Bayesian Value-at-Risk and expected shortfall forecasting via the asymmetric Laplace distribution," Computational Statistics & Data Analysis, Elsevier, vol. 56(11), pages 3498-3516.
    42. Engle, Robert F & Manganelli, Simone, 1999. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," University of California at San Diego, Economics Working Paper Series qt06m3d6nv, Department of Economics, UC San Diego.
    43. Fuertes, Ana-Maria & Olmo, Jose, 2013. "Optimally harnessing inter-day and intra-day information for daily value-at-risk prediction," International Journal of Forecasting, Elsevier, vol. 29(1), pages 28-42.
    44. Nick Costanzino & Michael Curran, 2018. "A Simple Traffic Light Approach to Backtesting Expected Shortfall," Risks, MDPI, vol. 6(1), pages 1-7, January.
    45. David Harvey & Paul Newbold, 2000. "Tests for multiple forecast encompassing," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(5), pages 471-482.
    46. Andrews, Donald W K, 2001. "Testing When a Parameter Is on the Boundary of the Maintained Hypothesis," Econometrica, Econometric Society, vol. 69(3), pages 683-734, May.
    47. Hansen, Bruce E., 2008. "Least-squares forecast averaging," Journal of Econometrics, Elsevier, vol. 146(2), pages 342-350, October.
    48. Zaichao Du & Juan Carlos Escanciano, 2017. "Backtesting Expected Shortfall: Accounting for Tail Risk," Management Science, INFORMS, vol. 63(4), pages 940-958, April.
    49. Escanciano, J. Carlos & Olmo, Jose, 2010. "Backtesting Parametric Value-at-Risk With Estimation Risk," Journal of Business & Economic Statistics, American Statistical Association, vol. 28(1), pages 36-51.
    50. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    51. Timo Dimitriadis & Xiaochun Liu & Julie Schnaitmann, 2020. "Encompassing Tests for Value at Risk and Expected Shortfall Multi-Step Forecasts based on Inference on the Boundary," Papers 2009.07341, arXiv.org.
    52. Ophélie Couperier & Jérémy Leymarie, 2020. "Backtesting Expected Shortfall via Multi-Quantile Regression," Working Papers halshs-01909375, HAL.
    53. Taylor, James W., 2020. "Forecast combinations for value at risk and expected shortfall," International Journal of Forecasting, Elsevier, vol. 36(2), pages 428-441.
    54. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    55. Hendry, David F. & Richard, Jean-Francois, 1982. "On the formulation of empirical models in dynamic econometrics," Journal of Econometrics, Elsevier, vol. 20(1), pages 3-33, October.
    56. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    57. Tasche, Dirk, 2002. "Expected shortfall and beyond," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1519-1533, July.
    58. G. Elliott & C. Granger & A. Timmermann (ed.), 2006. "Handbook of Economic Forecasting," Handbook of Economic Forecasting, Elsevier, edition 1, volume 1, number 1.
    59. Mizon, Grayham E & Richard, Jean-Francois, 1986. "The Encompassing Principle and Its Application to Testing Non-nested Hypotheses," Econometrica, Econometric Society, vol. 54(3), pages 657-678, May.
    60. Busetti, Fabio & Marcucci, Juri, 2013. "Comparing forecast accuracy: A Monte Carlo investigation," International Journal of Forecasting, Elsevier, vol. 29(1), pages 13-27.
    61. James W. Taylor, 2019. "Forecasting Value at Risk and Expected Shortfall Using a Semiparametric Approach Based on the Asymmetric Laplace Distribution," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 37(1), pages 121-133, January.
    62. Bayer, Sebastian, 2018. "Combining Value-at-Risk forecasts using penalized quantile regressions," Econometrics and Statistics, Elsevier, vol. 8(C), pages 56-77.
    63. Donald W.K. Andrews, 1997. "Estimation When a Parameter Is on a Boundary: Theory and Applications," Cowles Foundation Discussion Papers 1153, Cowles Foundation for Research in Economics, Yale University.
    64. Timo Dimitriadis & Julie Schnaitmann, 2019. "Forecast Encompassing Tests for the Expected Shortfall," Papers 1908.04569, arXiv.org, revised Aug 2020.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Tobias Fissler & Yannick Hoga, 2021. "Backtesting Systemic Risk Forecasts using Multi-Objective Elicitability," Papers 2104.10673, arXiv.org, revised Feb 2022.
    2. Dimitriadis, Timo & Liu, Xiaochun & Schnaitmann, Julie, 2020. "Encompassing tests for value at risk and expected shortfall multi-step forecasts based on inference on the boundary," Hohenheim Discussion Papers in Business, Economics and Social Sciences 11-2020, University of Hohenheim, Faculty of Business, Economics and Social Sciences.
    3. Timo Dimitriadis & Tobias Fissler & Johanna Ziegel, 2020. "The Efficiency Gap," Papers 2010.14146, arXiv.org, revised Sep 2022.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dimitriadis, Timo & Schnaitmann, Julie, 2021. "Forecast encompassing tests for the expected shortfall," International Journal of Forecasting, Elsevier, vol. 37(2), pages 604-621.
    2. Timo Dimitriadis & Julie Schnaitmann, 2019. "Forecast Encompassing Tests for the Expected Shortfall," Papers 1908.04569, arXiv.org, revised Aug 2020.
    3. Timo Dimitriadis & Tobias Fissler & Johanna Ziegel, 2020. "The Efficiency Gap," Papers 2010.14146, arXiv.org, revised Sep 2022.
    4. Nieto, Maria Rosa & Ruiz, Esther, 2016. "Frontiers in VaR forecasting and backtesting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 475-501.
    5. Sander Barendse & Erik Kole & Dick van Dijk, 2023. "Backtesting Value-at-Risk and Expected Shortfall in the Presence of Estimation Error," Journal of Financial Econometrics, Oxford University Press, vol. 21(2), pages 528-568.
    6. David Happersberger & Harald Lohre & Ingmar Nolte, 2020. "Estimating portfolio risk for tail risk protection strategies," European Financial Management, European Financial Management Association, vol. 26(4), pages 1107-1146, September.
    7. Gordy, Michael B. & McNeil, Alexander J., 2020. "Spectral backtests of forecast distributions with application to risk management," Journal of Banking & Finance, Elsevier, vol. 116(C).
    8. Alessandra Amendola & Vincenzo Candila & Antonio Naimoli & Giuseppe Storti, 2024. "Adaptive combinations of tail-risk forecasts," Papers 2406.06235, arXiv.org.
    9. Sebastian Bayer & Timo Dimitriadis, 2022. "Regression-Based Expected Shortfall Backtesting [Backtesting Expected Shortfall]," Journal of Financial Econometrics, Oxford University Press, vol. 20(3), pages 437-471.
    10. Merlo, Luca & Petrella, Lea & Raponi, Valentina, 2021. "Forecasting VaR and ES using a joint quantile regression and its implications in portfolio allocation," Journal of Banking & Finance, Elsevier, vol. 133(C).
    11. Fritzsch, Simon & Timphus, Maike & Weiß, Gregor, 2024. "Marginals versus copulas: Which account for more model risk in multivariate risk forecasting?," Journal of Banking & Finance, Elsevier, vol. 158(C).
    12. Vica Tendenan & Richard Gerlach & Chao Wang, 2020. "Tail risk forecasting using Bayesian realized EGARCH models," Papers 2008.05147, arXiv.org, revised Aug 2020.
    13. Nieto, María Rosa, 2008. "Measuring financial risk : comparison of alternative procedures to estimate VaR and ES," DES - Working Papers. Statistics and Econometrics. WS ws087326, Universidad Carlos III de Madrid. Departamento de Estadística.
    14. Giacomini, Raffaella & Komunjer, Ivana, 2005. "Evaluation and Combination of Conditional Quantile Forecasts," Journal of Business & Economic Statistics, American Statistical Association, vol. 23, pages 416-431, October.
    15. Komunjer, Ivana, 2013. "Quantile Prediction," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 2, chapter 0, pages 961-994, Elsevier.
    16. Luca Merlo & Lea Petrella & Valentina Raponi, 2021. "Forecasting VaR and ES using a joint quantile regression and implications in portfolio allocation," Papers 2106.06518, arXiv.org.
    17. Kratz, Marie & Lok, Yen H. & McNeil, Alexander J., 2018. "Multinomial VaR backtests: A simple implicit approach to backtesting expected shortfall," Journal of Banking & Finance, Elsevier, vol. 88(C), pages 393-407.
    18. Gerlach, Richard & Wang, Chao, 2020. "Semi-parametric dynamic asymmetric Laplace models for tail risk forecasting, incorporating realized measures," International Journal of Forecasting, Elsevier, vol. 36(2), pages 489-506.
    19. Santos, Douglas G. & Candido, Osvaldo & Tófoli, Paula V., 2022. "Forecasting risk measures using intraday and overnight information," The North American Journal of Economics and Finance, Elsevier, vol. 60(C).
    20. Enrique Molina‐Muñoz & Andrés Mora‐Valencia & Javier Perote, 2021. "Backtesting expected shortfall for world stock index ETFs with extreme value theory and Gram–Charlier mixtures," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 4163-4189, July.

    More about this item

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2009.07341. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.