IDEAS home Printed from https://ideas.repec.org/a/sgh/erfinj/v4y2019i1p41-66.html
   My bibliography  Save this article

Adjusted Evaluation Measures for Asymmetrically Important Data

Author

Listed:
  • Alex Karagrigoriou

    (University of the Aegean)

  • George-Jason Siouris

    (University of the Aegean)

  • Despoina Skilogianni

    (University of the Aegean)

Abstract

In this paper we introduce adjustments for standard evaluation measures appropriate for the analysis of data with asymmetrical importance. In risk analysis, it is understood that the returns of an asset do not all provide the same amount of information. This asymmetry of information is crucial for choosing the most appropriate model and evaluating its forecasting ability. In risk analysis, measures like value at risk (VaR) and expected shortfall (ES) concentrate on the left tail of the distribution of returns so that failures in fitting a model on the right tail are not important. Therefore, when we estimate the VaR of an asset, the days of violations are more important than the days of non-violations. The proposed adjustments take into consideration the asymmetry in importance and are filling the gap in the theory of evaluation of percentiles measures. The measures are divided into fixed partition, based on prior information or the goal of forecasting, and non fixed partition, based on the time proximity of the model failure. The performance of the proposed measures is illustrated with the use of a stock from the industrial metals and minerals index of the American Stock Exchange (NYSE MKT), as well as a warrant, from the Athens Exchange (ATHEX).

Suggested Citation

  • Alex Karagrigoriou & George-Jason Siouris & Despoina Skilogianni, 2019. "Adjusted Evaluation Measures for Asymmetrically Important Data," Econometric Research in Finance, SGH Warsaw School of Economics, Collegium of Economic Analysis, vol. 4(1), pages 41-66, June.
    • Handle: RePEc:sgh:erfinj:v:4:y:2019:i:1:p:41-66
    DOI: 10.33119/ERFIN.2019.4.1.3
    as

    Download full text from publisher

    File URL: http://erfin.org/journal/index.php/erfin/article/view/56
    File Function: Full text
    Download Restriction: no
    File URL: https://libkey.io/10.33119/ERFIN.2019.4.1.3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. George-Jason Siouris & Alex Karagrigoriou, 2017. "A Low Price Correction for Improved Volatility Estimation and Forecasting," Risks, MDPI, vol. 5(3), pages 1-14, August.
    2. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    3. Harvey,Andrew C., 2013. "Dynamic Models for Volatility and Heavy Tails," Cambridge Books, Cambridge University Press, number 9781107630024, September.
    4. Guido W. Imbens & Whitney Newey & Geert Ridder, 2005. "Mean-square-error Calculations for Average Treatment Effects," IEPR Working Papers 05.34, Institute of Economic Policy Research (IEPR).
    5. Gonzalez-Rivera, Gloria & Lee, Tae-Hwy & Mishra, Santosh, 2004. "Forecasting volatility: A reality check based on option pricing, utility function, value-at-risk, and predictive likelihood," International Journal of Forecasting, Elsevier, vol. 20(4), pages 629-645.
    6. Philippe Artzner & Freddy Delbaen & Jean‐Marc Eber & David Heath, 1999. "Coherent Measures of Risk," Mathematical Finance, Wiley Blackwell, vol. 9(3), pages 203-228, July.
    7. Carlo Acerbi & Dirk Tasche, 2002. "Expected Shortfall: A Natural Coherent Alternative to Value at Risk," Economic Notes, Banca Monte dei Paschi di Siena SpA, vol. 31(2), pages 379-388, July.
    8. Drew Creal & Siem Jan Koopman & André Lucas, 2013. "Generalized Autoregressive Score Models With Applications," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 28(5), pages 777-795, August.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Gerlach, Richard & Wang, Chao, 2020. "Semi-parametric dynamic asymmetric Laplace models for tail risk forecasting, incorporating realized measures," International Journal of Forecasting, Elsevier, vol. 36(2), pages 489-506.
    2. Chao Wang & Richard Gerlach, 2019. "Semi-parametric Realized Nonlinear Conditional Autoregressive Expectile and Expected Shortfall," Papers 1906.09961, arXiv.org.
    3. Storti, Giuseppe & Wang, Chao, 2022. "Nonparametric expected shortfall forecasting incorporating weighted quantiles," International Journal of Forecasting, Elsevier, vol. 38(1), pages 224-239.
    4. David Happersberger & Harald Lohre & Ingmar Nolte, 2020. "Estimating portfolio risk for tail risk protection strategies," European Financial Management, European Financial Management Association, vol. 26(4), pages 1107-1146, September.
    5. Chao Wang & Richard Gerlach & Qian Chen, 2018. "A Semi-parametric Realized Joint Value-at-Risk and Expected Shortfall Regression Framework," Papers 1807.02422, arXiv.org, revised Jan 2021.
    6. Troster, Victor & Tiwari, Aviral Kumar & Shahbaz, Muhammad & Macedo, Demian Nicolás, 2019. "Bitcoin returns and risk: A general GARCH and GAS analysis," Finance Research Letters, Elsevier, vol. 30(C), pages 187-193.
    7. Mauro Bernardi & Leopoldo Catania, 2015. "Switching-GAS Copula Models With Application to Systemic Risk," Papers 1504.03733, arXiv.org, revised Jan 2016.
    8. Leopoldo Catania & Nima Nonejad, 2016. "Density Forecasts and the Leverage Effect: Some Evidence from Observation and Parameter-Driven Volatility Models," Papers 1605.00230, arXiv.org, revised Nov 2016.
    9. Geenens, Gery & Dunn, Richard, 2022. "A nonparametric copula approach to conditional Value-at-Risk," Econometrics and Statistics, Elsevier, vol. 21(C), pages 19-37.
    10. Giuseppe Storti & Chao Wang, 2021. "Modelling uncertainty in financial tail risk: a forecast combination and weighted quantile approach," Papers 2104.04918, arXiv.org, revised Jul 2021.
    11. Owusu Junior, Peterson & Alagidede, Imhotep, 2020. "Risks in emerging markets equities: Time-varying versus spatial risk analysis," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 542(C).
    12. Gery Geenens & Richard Dunn, 2017. "A nonparametric copula approach to conditional Value-at-Risk," Papers 1712.05527, arXiv.org, revised Oct 2019.
    13. Luca Vincenzo Ballestra & Enzo D’Innocenzo & Andrea Guizzardi, 2024. "Score-Driven Modeling with Jumps: An Application to S&P500 Returns and Options," Journal of Financial Econometrics, Oxford University Press, vol. 22(2), pages 375-406.
    14. Lucas, André & Zhang, Xin, 2016. "Score-driven exponentially weighted moving averages and Value-at-Risk forecasting," International Journal of Forecasting, Elsevier, vol. 32(2), pages 293-302.
    15. Giuseppe Storti & Chao Wang, 2023. "Modeling uncertainty in financial tail risk: A forecast combination and weighted quantile approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 42(7), pages 1648-1663, November.
    16. Chen, Cathy W.S. & Hsu, Hsiao-Yun & Watanabe, Toshiaki, 2023. "Tail risk forecasting of realized volatility CAViaR models," Finance Research Letters, Elsevier, vol. 51(C).
    17. Mohamed CHIKHI & Claude DIEBOLT & Tapas MISHRA, 2019. "Memory that Drives! New Insights into Forecasting Performance of Stock Prices from SEMIFARMA-AEGAS Model," Working Papers 07-19, Association Française de Cliométrie (AFC).
    18. Liu, Wei & Semeyutin, Artur & Lau, Chi Keung Marco & Gozgor, Giray, 2020. "Forecasting Value-at-Risk of Cryptocurrencies with RiskMetrics type models," Research in International Business and Finance, Elsevier, vol. 54(C).
    19. Andrei Rusu, 2020. "Multivariate VaR: A Romanian Market study," The Review of Finance and Banking, Academia de Studii Economice din Bucuresti, Romania / Facultatea de Finante, Asigurari, Banci si Burse de Valori / Catedra de Finante, vol. 12(1), pages 79-95, June.
    20. Ardia, David & Bluteau, Keven & Boudt, Kris & Catania, Leopoldo, 2018. "Forecasting risk with Markov-switching GARCH models:A large-scale performance study," International Journal of Forecasting, Elsevier, vol. 34(4), pages 733-747.

    More about this item

    Keywords

    PVaR; violation ratios; low price effect; low price correction; backtesting; evaluation measures;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C58 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Financial Econometrics
    • C51 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Construction and Estimation

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:sgh:erfinj:v:4:y:2019:i:1:p:41-66. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Dobromił Serwa (email available below). General contact details of provider: https://edirc.repec.org/data/sgwawpl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.