IDEAS home Printed from https://ideas.repec.org/p/fip/fednrp/9802.html
   My bibliography  Save this paper

Methods for evaluating value-at-risk estimates

Author

Listed:
  • Jose A. Lopez

Abstract

Beginning in 1998, U.S. commercial banks with significant trading activities must hold capital against their defined market risk exposure. Under the current regulatory guidelines, this capital charge is a function of banks' own value-at-risk (VaR) estimates. Two hypothesis-testing methods for evaluating VaR estimates have been proposed; namely, the binomial and the interval forecast methods. As shown in a simulation exercise, the tests generally have low power and thus are prone to misclassifying inaccurate VaR estimates as \\"acceptably accurate\\". An alternative evaluation method, based on loss functions that capture specific regulatory concerns, is proposed. Simulation results indicate that this method is capable of distinguishing between VaR estimates generated by accurate and alternative VaR models. The additional information provided by this method, as well as its flexibility with respect to the specification of the loss function, make a reasonable case for its use in the regulatory evaluation of VaR estimates.

Suggested Citation

  • Jose A. Lopez, 1998. "Methods for evaluating value-at-risk estimates," Research Paper 9802, Federal Reserve Bank of New York.
    • Handle: RePEc:fip:fednrp:9802
    as

    Download full text from publisher

    File URL: https://www.newyorkfed.org/medialibrary/media/research/staff_reports/research_papers/9802.html
    Download Restriction: no
    File URL: https://www.newyorkfed.org/medialibrary/media/research/staff_reports/research_papers/9802.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Paul H. Kupiec & James M. O'Brien, 1995. "A pre-commitment approach to capital requirements for market risk," Proceedings 475, Federal Reserve Bank of Chicago.
    2. Francis X. Diebold & Todd A. Gunther & Anthony S. Tay, "undated". "Evaluating Density Forecasts," CARESS Working Papres 97-18, University of Pennsylvania Center for Analytic Research and Economics in the Social Sciences.
    3. Paul H. Kupiec, 1995. "Techniques for verifying the accuracy of risk measurement models," Finance and Economics Discussion Series 95-24, Board of Governors of the Federal Reserve System (U.S.).
    4. Jose A. Lopez, 1996. "Regulatory Evaluation of Value-at-Risk Models," Center for Financial Institutions Working Papers 96-51, Wharton School Center for Financial Institutions, University of Pennsylvania.
    5. Darryll Hendricks & Beverly Hirtle, 1997. "Bank capital requirements for market risk: the internal models approach," Economic Policy Review, Federal Reserve Bank of New York, vol. 3(Dec), pages 1-12.
    6. Jose A. Lopez, 1999. "Methods for evaluating value-at-risk estimates," Economic Review, Federal Reserve Bank of San Francisco, pages 3-17.
    7. Diebold, Francis X & Gunther, Todd A & Tay, Anthony S, 1998. "Evaluating Density Forecasts with Applications to Financial Risk Management," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 863-883, November.
    8. Jeremy Berkowitz, 1999. "Evaluating the forecasts of risk models," Finance and Economics Discussion Series 1999-11, Board of Governors of the Federal Reserve System (U.S.).
    9. Christoffersen, Peter F, 1998. "Evaluating Interval Forecasts," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 39(4), pages 841-862, November.
    10. Phillip Kearns & Adrian Pagan, 1997. "Estimating The Density Tail Index For Financial Time Series," The Review of Economics and Statistics, MIT Press, vol. 79(2), pages 171-175, May.
    11. Matthew Pritsker, 1996. "Evaluating Value-at-Risk Methodologies: Accuracy versus Computational Time," Center for Financial Institutions Working Papers 96-48, Wharton School Center for Financial Institutions, University of Pennsylvania.
    12. Darryll Hendricks, 1996. "Evaluation of value-at-risk models using historical data," Economic Policy Review, Federal Reserve Bank of New York, vol. 2(Apr), pages 39-69.
    13. Granger, C.W.J. & Pesaran, H., 1996. "A Decision_Theoretic Approach to Forecast Evaluation," Cambridge Working Papers in Economics 9618, Faculty of Economics, University of Cambridge.
    14. Matthew Pritsker, 1997. "Evaluating Value at Risk Methodologies: Accuracy versus Computational Time," Journal of Financial Services Research, Springer;Western Finance Association, vol. 12(2), pages 201-242, October.
    15. Francis X. Diebold & Jose A. Lopez, 1995. "Forecast evaluation and combination," Research Paper 9525, Federal Reserve Bank of New York.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jose A. Lopez, 1996. "Regulatory Evaluation of Value-at-Risk Models," Center for Financial Institutions Working Papers 96-51, Wharton School Center for Financial Institutions, University of Pennsylvania.
    2. M. Hashem Pesaran & Paolo Zaffaroni, 2004. "Model Averaging and Value-at-Risk Based Evaluation of Large Multi Asset Volatility Models for Risk Management," CESifo Working Paper Series 1358, CESifo.
    3. Lopez, Jose A. & Saidenberg, Marc R., 2000. "Evaluating credit risk models," Journal of Banking & Finance, Elsevier, vol. 24(1-2), pages 151-165, January.
    4. Peter Christoffersen, 2004. "Backtesting Value-at-Risk: A Duration-Based Approach," Journal of Financial Econometrics, Oxford University Press, vol. 2(1), pages 84-108.
    5. Jeremy Berkowitz, 1999. "Evaluating the forecasts of risk models," Finance and Economics Discussion Series 1999-11, Board of Governors of the Federal Reserve System (U.S.).
    6. Matthew Pritsker, 2001. "The hidden dangers of historical simulation," Finance and Economics Discussion Series 2001-27, Board of Governors of the Federal Reserve System (U.S.).
    7. Chrétien, Stéphane & Coggins, Frank, 2010. "Performance and conservatism of monthly FHS VaR: An international investigation," International Review of Financial Analysis, Elsevier, vol. 19(5), pages 323-333, December.
    8. Jeremy Berkowitz & James M. O'Brien, 2001. "How accurate are Value-at-Risk models at commercial banks?," Finance and Economics Discussion Series 2001-31, Board of Governors of the Federal Reserve System (U.S.).
    9. Sean D. Campbell, 2005. "A review of backtesting and backtesting procedures," Finance and Economics Discussion Series 2005-21, Board of Governors of the Federal Reserve System (U.S.).
    10. Boucher, Christophe M. & Daníelsson, Jón & Kouontchou, Patrick S. & Maillet, Bertrand B., 2014. "Risk models-at-risk," Journal of Banking & Finance, Elsevier, vol. 44(C), pages 72-92.
    11. Trino-Manuel Ñíguez & Javier Perote, 2012. "Forecasting Heavy-Tailed Densities with Positive Edgeworth and Gram-Charlier Expansions," Oxford Bulletin of Economics and Statistics, Department of Economics, University of Oxford, vol. 74(4), pages 600-627, August.
    12. Wai Yan Cheng & Michael Chak Sham Wong & Clement Yuk Pang Wong, 2003. "Market risk management of banks: implications from the accuracy of Value-at-Risk forecasts," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 22(1), pages 23-33.
    13. Stavroyiannis, S. & Makris, I. & Nikolaidis, V. & Zarangas, L., 2012. "Econometric modeling and value-at-risk using the Pearson type-IV distribution," International Review of Financial Analysis, Elsevier, vol. 22(C), pages 10-17.
    14. Lucio Sarno, 2003. "Nonlinear Exchange Rate Models: A Selective Overview," Rivista di Politica Economica, SIPI Spa, vol. 93(4), pages 3-46, July-Augu.
    15. Polanski, Arnold & Stoja, Evarist, 2012. "Efficient evaluation of multidimensional time-varying density forecasts, with applications to risk management," International Journal of Forecasting, Elsevier, vol. 28(2), pages 343-352.
    16. Francis X. Diebold & Jinyong Hahn & Anthony S. Tay, 1998. "Real-Time Multivariate Density Forecast Evaluation and Calibration: Monitoring the Risk of High-Frequency Returns on Foreign Exchange," New York University, Leonard N. Stern School Finance Department Working Paper Seires 98-079, New York University, Leonard N. Stern School of Business-.
    17. Pesaran, M. Hashem & Schleicher, Christoph & Zaffaroni, Paolo, 2009. "Model averaging in risk management with an application to futures markets," Journal of Empirical Finance, Elsevier, vol. 16(2), pages 280-305, March.
    18. Flavio Bazzana, 2001. "I modelli interni per la valutazione del rischio di mercato secondo l'approccio del Value at Risk," Alea Tech Reports 011, Department of Computer and Management Sciences, University of Trento, Italy, revised 14 Jun 2008.
    19. Jose A. Lopez & Christian Walter, 2000. "Evaluating covariance matrix forecasts in a value-at-risk framework," Working Paper Series 2000-21, Federal Reserve Bank of San Francisco.
    20. Pritsker, Matthew, 2006. "The hidden dangers of historical simulation," Journal of Banking & Finance, Elsevier, vol. 30(2), pages 561-582, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fednrp:9802. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Gabriella Bucciarelli (email available below). General contact details of provider: https://edirc.repec.org/data/frbnyus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.