IDEAS home Printed from https://ideas.repec.org/p/arx/papers/2209.00991.html
   My bibliography  Save this paper

E-backtesting

Author

Listed:
  • Qiuqi Wang
  • Ruodu Wang
  • Johanna Ziegel

Abstract

In the recent Basel Accords, the Expected Shortfall (ES) replaces the Value-at-Risk (VaR) as the standard risk measure for market risk in the banking sector, making it the most important risk measure in financial regulation. One of the most challenging tasks in risk modeling practice is to backtest ES forecasts provided by financial institutions. To design a model-free backtesting procedure for ES, we make use of the recently developed techniques of e-values and e-processes. Backtest e-statistics are introduced to formulate e-processes for risk measure forecasts, and unique forms of backtest e-statistics for VaR and ES are characterized using recent results on identification functions. For a given backtest e-statistic, a few criteria for optimally constructing the e-processes are studied. The proposed method can be naturally applied to many other risk measures and statistical quantities. We conduct extensive simulation studies and data analysis to illustrate the advantages of the model-free backtesting method, and compare it with the ones in the literature.

Suggested Citation

  • Qiuqi Wang & Ruodu Wang & Johanna Ziegel, 2022. "E-backtesting," Papers 2209.00991, arXiv.org, revised Dec 2024.
    • Handle: RePEc:arx:papers:2209.00991
    as

    Download full text from publisher

    File URL: http://arxiv.org/pdf/2209.00991
    File Function: Latest version
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Natalia Nolde & Johanna F. Ziegel, 2016. "Elicitability and backtesting: Perspectives for banking regulation," Papers 1608.05498, arXiv.org, revised Feb 2017.
    2. Rafael M Frongillo & Ian A Kash, 2021. "Elicitation complexity of statistical properties [A characterization of scoring rules for linear properties]," Biometrika, Biometrika Trust, vol. 108(4), pages 857-879.
    3. Alexander J. McNeil & Rüdiger Frey & Paul Embrechts, 2015. "Quantitative Risk Management: Concepts, Techniques and Tools Revised edition," Economics Books, Princeton University Press, edition 2, number 10496.
    4. Christoffersen, Peter, 2011. "Elements of Financial Risk Management," Elsevier Monographs, Elsevier, edition 2, number 9780123744487.
    5. Ruodu Wang & Yunran Wei & Gordon E. Willmot, 2020. "Characterization, Robustness, and Aggregation of Signed Choquet Integrals," Mathematics of Operations Research, INFORMS, vol. 45(3), pages 993-1015, August.
    6. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    7. Patton, Andrew J. & Ziegel, Johanna F. & Chen, Rui, 2019. "Dynamic semiparametric models for expected shortfall (and Value-at-Risk)," Journal of Econometrics, Elsevier, vol. 211(2), pages 388-413.
    8. Ruodu Wang & Aaditya Ramdas, 2022. "False discovery rate control with e‐values," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(3), pages 822-852, July.
    9. Ruodu Wang & Yunran Wei, 2020. "Risk functionals with convex level sets," Mathematical Finance, Wiley Blackwell, vol. 30(4), pages 1337-1367, October.
    10. Ruodu Wang & Ričardas Zitikis, 2021. "An Axiomatic Foundation for the Expected Shortfall," Management Science, INFORMS, vol. 67(3), pages 1413-1429, March.
    11. Zaichao Du & Juan Carlos Escanciano, 2017. "Backtesting Expected Shortfall: Accounting for Tail Risk," Management Science, INFORMS, vol. 63(4), pages 940-958, April.
    12. Tobias Fissler & Hajo Holzmann, 2022. "Measurability of functionals and of ideal point forecasts," Papers 2203.08635, arXiv.org.
    13. Rockafellar, R. Tyrrell & Uryasev, Stanislav, 2002. "Conditional value-at-risk for general loss distributions," Journal of Banking & Finance, Elsevier, vol. 26(7), pages 1443-1471, July.
    14. Paul Embrechts & Tiantian Mao & Qiuqi Wang & Ruodu Wang, 2021. "Bayes risk, elicitability, and the Expected Shortfall," Mathematical Finance, Wiley Blackwell, vol. 31(4), pages 1190-1217, October.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tobias Fissler & Fangda Liu & Ruodu Wang & Linxiao Wei, 2024. "Elicitability and identifiability of tail risk measures," Papers 2404.14136, arXiv.org, revised Jun 2024.
    2. Yuanying Guan & Zhanyi Jiao & Ruodu Wang, 2022. "A reverse ES (CVaR) optimization formula," Papers 2203.02599, arXiv.org, revised May 2023.
    3. Ruodu Wang & Ričardas Zitikis, 2021. "An Axiomatic Foundation for the Expected Shortfall," Management Science, INFORMS, vol. 67(3), pages 1413-1429, March.
    4. Paul Embrechts & Tiantian Mao & Qiuqi Wang & Ruodu Wang, 2021. "Bayes risk, elicitability, and the Expected Shortfall," Mathematical Finance, Wiley Blackwell, vol. 31(4), pages 1190-1217, October.
    5. Xia Han & Bin Wang & Ruodu Wang & Qinyu Wu, 2021. "Risk Concentration and the Mean-Expected Shortfall Criterion," Papers 2108.05066, arXiv.org, revised Apr 2022.
    6. Yi Shen & Zachary Van Oosten & Ruodu Wang, 2024. "Partial Law Invariance and Risk Measures," Papers 2401.17265, arXiv.org, revised Dec 2024.
    7. Xia Han & Liyuan Lin & Ruodu Wang, 2022. "Diversification quotients: Quantifying diversification via risk measures," Papers 2206.13679, arXiv.org, revised Jul 2024.
    8. Li, Hengxin & Wang, Ruodu, 2023. "PELVE: Probability Equivalent Level of VaR and ES," Journal of Econometrics, Elsevier, vol. 234(1), pages 353-370.
    9. Burzoni, Matteo & Munari, Cosimo & Wang, Ruodu, 2022. "Adjusted Expected Shortfall," Journal of Banking & Finance, Elsevier, vol. 134(C).
    10. Maziar Sahamkhadam, 2021. "Dynamic copula-based expectile portfolios," Journal of Asset Management, Palgrave Macmillan, vol. 22(3), pages 209-223, May.
    11. Santos, Douglas G. & Candido, Osvaldo & Tófoli, Paula V., 2022. "Forecasting risk measures using intraday and overnight information," The North American Journal of Economics and Finance, Elsevier, vol. 60(C).
    12. Ruodu Wang & Yunran Wei, 2020. "Risk functionals with convex level sets," Mathematical Finance, Wiley Blackwell, vol. 30(4), pages 1337-1367, October.
    13. Bellini, Fabio & Fadina, Tolulope & Wang, Ruodu & Wei, Yunran, 2022. "Parametric measures of variability induced by risk measures," Insurance: Mathematics and Economics, Elsevier, vol. 106(C), pages 270-284.
    14. James Ming Chen, 2018. "On Exactitude in Financial Regulation: Value-at-Risk, Expected Shortfall, and Expectiles," Risks, MDPI, vol. 6(2), pages 1-28, June.
    15. Tolulope Fadina & Yang Liu & Ruodu Wang, 2021. "A Framework for Measures of Risk under Uncertainty," Papers 2110.10792, arXiv.org, revised Sep 2023.
    16. Sullivan Hu'e & Christophe Hurlin & Yang Lu, 2024. "Backtesting Expected Shortfall: Accounting for both duration and severity with bivariate orthogonal polynomials," Papers 2405.02012, arXiv.org, revised May 2024.
    17. Xia Han & Bin Wang & Ruodu Wang & Qinyu Wu, 2024. "Risk concentration and the mean‐expected shortfall criterion," Mathematical Finance, Wiley Blackwell, vol. 34(3), pages 819-846, July.
    18. Man Wang & Yihan Cheng, 2022. "Forecasting value at risk and expected shortfall using high‐frequency data of domestic and international stock markets," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(8), pages 1595-1607, December.
    19. Yuyu Chen & Peng Liu & Yang Liu & Ruodu Wang, 2022. "Ordering and inequalities for mixtures on risk aggregation," Mathematical Finance, Wiley Blackwell, vol. 32(1), pages 421-451, January.
    20. Patton, Andrew J. & Ziegel, Johanna F. & Chen, Rui, 2019. "Dynamic semiparametric models for expected shortfall (and Value-at-Risk)," Journal of Econometrics, Elsevier, vol. 211(2), pages 388-413.

    More about this item

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:arx:papers:2209.00991. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: arXiv administrators (email available below). General contact details of provider: http://arxiv.org/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.