IDEAS home Printed from https://ideas.repec.org/a/wly/ijfiec/v26y2021i3p4163-4189.html
   My bibliography  Save this article

Backtesting expected shortfall for world stock index ETFs with extreme value theory and Gram–Charlier mixtures

Author

Listed:
  • Enrique Molina‐Muñoz
  • Andrés Mora‐Valencia
  • Javier Perote

Abstract

This paper analyses risk quantification for three main stock market index exchange‐traded funds in world financial markets. We compare the relative performance of a set of parametric and semi‐nonparametric models in terms of both value‐at‐risk and expected shortfall backtesting techniques. To this end, we explore the result of the jointly elicitability of these two risk measures. We provide a new mixture of Gram–Charlier distributions that have been used in this framework for the first time and derive a close formula for directly computing expected shortfall. This model is compared to the Gaussian (benchmark model), Student's t, generalized Pareto (a case of the extreme value theory) and mixtures of Gram–Charlier distributions. The results show that peaks‐over‐threshold (extreme value theory) and flexible Gram–Charlier approximations are suitable to quantify market risk and mitigate concerns about possible financial instabilities generated by misuse of exchange‐traded funds trading.

Suggested Citation

  • Enrique Molina‐Muñoz & Andrés Mora‐Valencia & Javier Perote, 2021. "Backtesting expected shortfall for world stock index ETFs with extreme value theory and Gram–Charlier mixtures," International Journal of Finance & Economics, John Wiley & Sons, Ltd., vol. 26(3), pages 4163-4189, July.
    • Handle: RePEc:wly:ijfiec:v:26:y:2021:i:3:p:4163-4189
    DOI: 10.1002/ijfe.2009
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/ijfe.2009
    Download Restriction: no
    File URL: https://libkey.io/10.1002/ijfe.2009?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Ñíguez, Trino-Manuel & Perote, Javier, 2017. "Moments expansion densities for quantifying financial risk," The North American Journal of Economics and Finance, Elsevier, vol. 42(C), pages 53-69.
    2. Gneiting, Tilmann, 2011. "Making and Evaluating Point Forecasts," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 746-762.
    3. Berkowitz, Jeremy, 2001. "Testing Density Forecasts, with Applications to Risk Management," Journal of Business & Economic Statistics, American Statistical Association, vol. 19(4), pages 465-474, October.
    4. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    5. Del Brio, Esther B. & Mora-Valencia, Andrés & Perote, Javier, 2020. "Risk quantification for commodity ETFs: Backtesting value-at-risk and expected shortfall," International Review of Financial Analysis, Elsevier, vol. 70(C).
    6. Tse, Yiuman, 2015. "Momentum strategies with stock index exchange-traded funds," The North American Journal of Economics and Finance, Elsevier, vol. 33(C), pages 134-148.
    7. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    8. Chen, Rongda & Li, Cong & Wang, Weijin & Wang, Ze, 2014. "Empirical analysis on future-cash arbitrage risk with portfolio VaR," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 398(C), pages 210-216.
    9. Jorge Rosales Contreras, 2014. "Market Risk Measures using Finite Gaussian Mixtures," Journal of Applied Finance & Banking, SCIENPRESS Ltd, vol. 4(6), pages 1-3.
    10. McNeil, Alexander J. & Frey, Rudiger, 2000. "Estimation of tail-related risk measures for heteroscedastic financial time series: an extreme value approach," Journal of Empirical Finance, Elsevier, vol. 7(3-4), pages 271-300, November.
    11. Robert F. Engle & Simone Manganelli, 2004. "CAViaR: Conditional Autoregressive Value at Risk by Regression Quantiles," Journal of Business & Economic Statistics, American Statistical Association, vol. 22, pages 367-381, October.
    12. Dannhauser, Caitlin D., 2017. "The impact of innovation: Evidence from corporate bond exchange-traded funds (ETFs)," Journal of Financial Economics, Elsevier, vol. 125(3), pages 537-560.
    13. Kunlapath Sukcharoen & Hankyeung Choi & David J. Leatham, 2015. "Optimal gasoline hedging strategies using futures contracts and exchange-traded funds," Applied Economics, Taylor & Francis Journals, vol. 47(32), pages 3482-3498, July.
    14. Itzhak Ben-David & Francesco A. Franzoni & Rabih Moussawi, 2016. "Exchange Traded Funds (ETFs)," Swiss Finance Institute Research Paper Series 16-64, Swiss Finance Institute.
    15. Robert JARROW & Andrew RUDD, 2008. "Approximate Option Valuation For Arbitrary Stochastic Processes," World Scientific Book Chapters, in: Financial Derivatives Pricing Selected Works of Robert Jarrow, chapter 1, pages 9-31, World Scientific Publishing Co. Pte. Ltd..
    16. Liu, Qingfu & Tse, Yiuman, 2017. "Overnight returns of stock indexes: Evidence from ETFs and futures," International Review of Economics & Finance, Elsevier, vol. 48(C), pages 440-451.
    17. Rama Cont & Romain Deguest & Giacomo Scandolo, 2010. "Robustness and sensitivity analysis of risk measurement procedures," Post-Print hal-00413729, HAL.
    18. Grant TURNER & Vladyslav SUSHKO, 2018. "What risks do exchange-traded funds pose?," Financial Stability Review, Banque de France, issue 22, pages 133-144, April.
    19. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    20. Zoia, Maria Grazia & Biffi, Paola & Nicolussi, Federica, 2018. "Value at risk and expected shortfall based on Gram-Charlier-like expansions," Journal of Banking & Finance, Elsevier, vol. 93(C), pages 92-104.
    21. Kratz, Marie & Lok, Yen H. & McNeil, Alexander J., 2018. "Multinomial VaR backtests: A simple implicit approach to backtesting expected shortfall," Journal of Banking & Finance, Elsevier, vol. 88(C), pages 393-407.
    22. Fabio Bellini & Valeria Bignozzi, 2015. "On elicitable risk measures," Quantitative Finance, Taylor & Francis Journals, vol. 15(5), pages 725-733, May.
    23. Yang Zhao & Charalampos Stasinakis & Georgios Sermpinis & Yukun Shi, 2018. "Neural network copula portfolio optimization for exchange traded funds," Quantitative Finance, Taylor & Francis Journals, vol. 18(5), pages 761-775, May.
    24. Antonello Maruotti & Antonio Punzo & Luca Bagnato, 2019. "Hidden Markov and Semi-Markov Models with Multivariate Leptokurtic-Normal Components for Robust Modeling of Daily Returns Series," Journal of Financial Econometrics, Oxford University Press, vol. 17(1), pages 91-117.
    25. Glosten, Lawrence R & Jagannathan, Ravi & Runkle, David E, 1993. "On the Relation between the Expected Value and the Volatility of the Nominal Excess Return on Stocks," Journal of Finance, American Finance Association, vol. 48(5), pages 1779-1801, December.
    26. Del Brio, Esther B. & Perote, Javier, 2012. "Gram–Charlier densities: Maximum likelihood versus the method of moments," Insurance: Mathematics and Economics, Elsevier, vol. 51(3), pages 531-537.
    27. Engle, Robert F & Ng, Victor K, 1993. "Measuring and Testing the Impact of News on Volatility," Journal of Finance, American Finance Association, vol. 48(5), pages 1749-1778, December.
    28. Giot, Pierre & Laurent, Sebastien, 2003. "Market risk in commodity markets: a VaR approach," Energy Economics, Elsevier, vol. 25(5), pages 435-457, September.
    29. Doron Israeli & Charles M. C. Lee & Suhas A. Sridharan, 2017. "Is there a dark side to exchange traded funds? An information perspective," Review of Accounting Studies, Springer, vol. 22(3), pages 1048-1083, September.
    30. Del Brio, Esther B. & Ñíguez, Trino-Manuel & Perote, Javier, 2011. "Multivariate semi-nonparametric distributions with dynamic conditional correlations," International Journal of Forecasting, Elsevier, vol. 27(2), pages 347-364.
    31. Zhi Da & Sophie Shive, 2018. "Exchange traded funds and asset return correlations," European Financial Management, European Financial Management Association, vol. 24(1), pages 136-168, January.
    32. Acerbi, Carlo & Tasche, Dirk, 2002. "On the coherence of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1487-1503, July.
    33. Koch-Medina, Pablo & Munari, Cosimo, 2016. "Unexpected shortfalls of Expected Shortfall: Extreme default profiles and regulatory arbitrage," Journal of Banking & Finance, Elsevier, vol. 62(C), pages 141-151.
    34. Rama Cont & Romain Deguest & Giacomo Scandolo, 2010. "Robustness and sensitivity analysis of risk measurement procedures," Quantitative Finance, Taylor & Francis Journals, vol. 10(6), pages 593-606.
    35. R. Cont, 2001. "Empirical properties of asset returns: stylized facts and statistical issues," Quantitative Finance, Taylor & Francis Journals, vol. 1(2), pages 223-236.
    36. Paul Embrechts & Bin Wang & Ruodu Wang, 2015. "Aggregation-robustness and model uncertainty of regulatory risk measures," Finance and Stochastics, Springer, vol. 19(4), pages 763-790, October.
    37. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    38. Lakshithe Wagalath & Jorge Zubelli, 2018. "A Liquidation Risk Adjustment For Value At Risk And Expected Shortfall," Post-Print hal-02572794, HAL.
    39. Nick Costanzino & Michael Curran, 2018. "A Simple Traffic Light Approach to Backtesting Expected Shortfall," Risks, MDPI, vol. 6(1), pages 1-7, January.
    40. Aloui, Chaker & Mabrouk, Samir, 2010. "Value-at-risk estimations of energy commodities via long-memory, asymmetry and fat-tailed GARCH models," Energy Policy, Elsevier, vol. 38(5), pages 2326-2339, May.
    41. Del Brio, Esther B. & Mora-Valencia, Andrés & Perote, Javier, 2014. "Semi-nonparametric VaR forecasts for hedge funds during the recent crisis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 401(C), pages 330-343.
    42. Zaichao Du & Juan Carlos Escanciano, 2017. "Backtesting Expected Shortfall: Accounting for Tail Risk," Management Science, INFORMS, vol. 63(4), pages 940-958, April.
    43. Esther B. Del Brio & Andrés Mora-Valencia & Javier Perote, 2019. "Expected shortfall assessment in commodity (L)ETF portfolios with semi-nonparametric specifications," The European Journal of Finance, Taylor & Francis Journals, vol. 25(17), pages 1746-1764, November.
    44. Lakshithe Wagalath & Jorge P. Zubelli, 2018. "A Liquidation Risk Adjustment For Value At Risk And Expected Shortfall," International Journal of Theoretical and Applied Finance (IJTAF), World Scientific Publishing Co. Pte. Ltd., vol. 21(03), pages 1-21, May.
    45. Del Brio, Esther B. & Mora-Valencia, Andrés & Perote, Javier, 2014. "VaR performance during the subprime and sovereign debt crises: An application to emerging markets," Emerging Markets Review, Elsevier, vol. 20(C), pages 23-41.
    46. Susanne Emmer & Marie Kratz & Dirk Tasche, 2013. "What is the best risk measure in practice? A comparison of standard measures," Papers 1312.1645, arXiv.org, revised Apr 2015.
    47. Ignacio Mauleon & Javier Perote, 2000. "Testing densities with financial data: an empirical comparison of the Edgeworth-Sargan density to the Student's t," The European Journal of Finance, Taylor & Francis Journals, vol. 6(2), pages 225-239.
    48. Huang, Mei-Yueh & Lin, Jun-Biao, 2011. "Do ETFs provide effective international diversification?," Research in International Business and Finance, Elsevier, vol. 25(3), pages 335-344, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Del Brio, Esther B. & Mora-Valencia, Andrés & Perote, Javier, 2020. "Risk quantification for commodity ETFs: Backtesting value-at-risk and expected shortfall," International Review of Financial Analysis, Elsevier, vol. 70(C).
    2. Kratz, Marie & Lok, Yen H. & McNeil, Alexander J., 2018. "Multinomial VaR backtests: A simple implicit approach to backtesting expected shortfall," Journal of Banking & Finance, Elsevier, vol. 88(C), pages 393-407.
    3. Lazar, Emese & Zhang, Ning, 2019. "Model risk of expected shortfall," Journal of Banking & Finance, Elsevier, vol. 105(C), pages 74-93.
    4. Marie Kratz & Yen H Lok & Alexander J Mcneil, 2016. "Multinomial var backtests: A simple implicit approach to backtesting expected shortfall," Working Papers hal-01424279, HAL.
    5. Kratz, Marie & Lok, Y-H & McNeil, Alexander J., 2016. "Multinomial VaR Backtests: A simple implicit approach to backtesting expected shortfall," ESSEC Working Papers WP1617, ESSEC Research Center, ESSEC Business School.
    6. Jiménez, Inés & Mora-Valencia, Andrés & Perote, Javier, 2022. "Semi-nonparametric risk assessment with cryptocurrencies," Research in International Business and Finance, Elsevier, vol. 59(C).
    7. Timo Dimitriadis & Xiaochun Liu & Julie Schnaitmann, 2020. "Encompassing Tests for Value at Risk and Expected Shortfall Multi-Step Forecasts based on Inference on the Boundary," Papers 2009.07341, arXiv.org.
    8. Steven Kou & Xianhua Peng, 2016. "On the Measurement of Economic Tail Risk," Operations Research, INFORMS, vol. 64(5), pages 1056-1072, October.
    9. Sander Barendse & Erik Kole & Dick van Dijk, 2023. "Backtesting Value-at-Risk and Expected Shortfall in the Presence of Estimation Error," Journal of Financial Econometrics, Oxford University Press, vol. 21(2), pages 528-568.
    10. Xu, Qifa & Chen, Lu & Jiang, Cuixia & Yu, Keming, 2020. "Mixed data sampling expectile regression with applications to measuring financial risk," Economic Modelling, Elsevier, vol. 91(C), pages 469-486.
    11. James Ming Chen, 2018. "On Exactitude in Financial Regulation: Value-at-Risk, Expected Shortfall, and Expectiles," Risks, MDPI, vol. 6(2), pages 1-28, June.
    12. Gordy, Michael B. & McNeil, Alexander J., 2020. "Spectral backtests of forecast distributions with application to risk management," Journal of Banking & Finance, Elsevier, vol. 116(C).
    13. Merlo, Luca & Petrella, Lea & Raponi, Valentina, 2021. "Forecasting VaR and ES using a joint quantile regression and its implications in portfolio allocation," Journal of Banking & Finance, Elsevier, vol. 133(C).
    14. Julia S. Mehlitz & Benjamin R. Auer, 2021. "Time‐varying dynamics of expected shortfall in commodity futures markets," Journal of Futures Markets, John Wiley & Sons, Ltd., vol. 41(6), pages 895-925, June.
    15. Luca Merlo & Lea Petrella & Valentina Raponi, 2021. "Forecasting VaR and ES using a joint quantile regression and implications in portfolio allocation," Papers 2106.06518, arXiv.org.
    16. Daniel Velásquez-Gaviria & Andrés Mora-Valencia & Javier Perote, 2020. "A Comparison of the Risk Quantification in Traditional and Renewable Energy Markets," Energies, MDPI, vol. 13(11), pages 1-42, June.
    17. David Happersberger & Harald Lohre & Ingmar Nolte, 2020. "Estimating portfolio risk for tail risk protection strategies," European Financial Management, European Financial Management Association, vol. 26(4), pages 1107-1146, September.
    18. Federico Gatta & Fabrizio Lillo & Piero Mazzarisi, 2024. "CAESar: Conditional Autoregressive Expected Shortfall," Papers 2407.06619, arXiv.org.
    19. Natalia Nolde & Johanna F. Ziegel, 2016. "Elicitability and backtesting: Perspectives for banking regulation," Papers 1608.05498, arXiv.org, revised Feb 2017.
    20. Ophélie Couperier & Jérémy Leymarie, 2020. "Backtesting Expected Shortfall via Multi-Quantile Regression," Working Papers halshs-01909375, HAL.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:ijfiec:v:26:y:2021:i:3:p:4163-4189. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/1076-9307/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.