IDEAS home Printed from https://ideas.repec.org/a/taf/quantf/v12y2012i3p437-449.html
   My bibliography  Save this article

A comparison of statistical tests for the adequacy of a neural network regression model

Author

Listed:
  • Nikos S. Thomaidis
  • Georgios D. Dounias

Abstract

An integral part of econometric practice is to test the adequacy of model specifications. If a model is adequately specified, it should not leave interesting features of the data-generating process in the errors. Despite the common tradition, the importance of diagnostic checking as a safeguard against mis-specification has only recently been recognized by neural network (NN) practitioners, possibly because this type of semi-parametric methodology was not originally designed for economic and financial applications. The purpose of this paper is to compare a number of analytical statistical testing procedures suitable to diagnostic checking on a neural network regression model. We present the standard Lagrange multiplier (LM) testing framework designed under the assumption of identically distributed disturbances and also examine two modifications that are robust to heteroskedasticity in errors. One modification also gives the researcher an opportunity to incorporate information concerning the volatility structure of the data-generating process in the testing procedure. By means of a Monte Carlo simulation, we investigate the performance of these tests under GARCH-type heteroskedasticity in errors and various distributional assumptions. The results show that although the primary concern of the researcher may be to design a regression model that accurately captures relations in the mean of the conditional distribution, developing a good approximation of the underlying volatility structure generally increases the efficiency of tests in detecting non-adequacy of a NN model. † http://fidelity.fme.ae gean.gr/decision

Suggested Citation

  • Nikos S. Thomaidis & Georgios D. Dounias, 2012. "A comparison of statistical tests for the adequacy of a neural network regression model," Quantitative Finance, Taylor & Francis Journals, vol. 12(3), pages 437-449, October.
    • Handle: RePEc:taf:quantf:v:12:y:2012:i:3:p:437-449
    DOI: 10.1080/14697680903426573
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1080/14697680903426573
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1080/14697680903426573?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Engle, Robert F., 1982. "A general approach to lagrange multiplier model diagnostics," Journal of Econometrics, Elsevier, vol. 20(1), pages 83-104, October.
    2. Eitrheim, Oyvind & Terasvirta, Timo, 1996. "Testing the adequacy of smooth transition autoregressive models," Journal of Econometrics, Elsevier, vol. 74(1), pages 59-75, September.
    3. Marcelo C. Medeiros & Alvaro Veiga, 2003. "Diagnostic Checking in a Flexible Nonlinear Time Series Model," Journal of Time Series Analysis, Wiley Blackwell, vol. 24(4), pages 461-482, July.
    4. Bollerslev, Tim, 1986. "Generalized autoregressive conditional heteroskedasticity," Journal of Econometrics, Elsevier, vol. 31(3), pages 307-327, April.
    5. Schwert, G William, 1990. "Stock Volatility and the Crash of '87," The Review of Financial Studies, Society for Financial Studies, vol. 3(1), pages 77-102.
    6. Nelson, Daniel B, 1991. "Conditional Heteroskedasticity in Asset Returns: A New Approach," Econometrica, Econometric Society, vol. 59(2), pages 347-370, March.
    7. Wooldridge, Jeffrey M., 1991. "On the application of robust, regression- based diagnostics to models of conditional means and conditional variances," Journal of Econometrics, Elsevier, vol. 47(1), pages 5-46, January.
    8. T. S. Breusch & A. R. Pagan, 1980. "The Lagrange Multiplier Test and its Applications to Model Specification in Econometrics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(1), pages 239-253.
    9. Christian M. Hafner & Helmut Herwartz, 2000. "Testing for linear autoregressive dynamics under heteroskedasticity," Econometrics Journal, Royal Economic Society, vol. 3(2), pages 177-197.
    10. French, Kenneth R. & Schwert, G. William & Stambaugh, Robert F., 1987. "Expected stock returns and volatility," Journal of Financial Economics, Elsevier, vol. 19(1), pages 3-29, September.
    11. Teräsvirta, Timo, 1996. "Smooth Transition Models," SSE/EFI Working Paper Series in Economics and Finance 132, Stockholm School of Economics.
    12. Wooldridge, Jeffrey M., 1990. "A Unified Approach to Robust, Regression-Based Specification Tests," Econometric Theory, Cambridge University Press, vol. 6(1), pages 17-43, March.
    13. Bollerslev, Tim, 1987. "A Conditionally Heteroskedastic Time Series Model for Speculative Prices and Rates of Return," The Review of Economics and Statistics, MIT Press, vol. 69(3), pages 542-547, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Sinan Deng & John Inekwe & Vladimir Smirnov & Andrew Wait & Chao Wang, 2023. "Machine Learning and Deep Learning Forecasts of Electricity Imbalance Prices," Working Papers 2023-03, University of Sydney, School of Economics.
    2. Golmohammadi, Davood, 2016. "Predicting hospital admissions to reduce emergency department boarding," International Journal of Production Economics, Elsevier, vol. 182(C), pages 535-544.
    3. Golmohammadi, Davood & Zhao, Lingyu & Dreyfus, David, 2023. "Using machine learning techniques to reduce uncertainty for outpatient appointment scheduling practices in outpatient clinics," Omega, Elsevier, vol. 120(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. McAleer, Michael & Medeiros, Marcelo C., 2008. "A multiple regime smooth transition Heterogeneous Autoregressive model for long memory and asymmetries," Journal of Econometrics, Elsevier, vol. 147(1), pages 104-119, November.
    2. Franses,Philip Hans & Dijk,Dick van, 2000. "Non-Linear Time Series Models in Empirical Finance," Cambridge Books, Cambridge University Press, number 9780521779654, September.
    3. Scharth, Marcel & Medeiros, Marcelo C., 2009. "Asymmetric effects and long memory in the volatility of Dow Jones stocks," International Journal of Forecasting, Elsevier, vol. 25(2), pages 304-327.
    4. Demos, Antonis & Sentana, Enrique, 1998. "Testing for GARCH effects: a one-sided approach," Journal of Econometrics, Elsevier, vol. 86(1), pages 97-127, June.
    5. Kim, Dongcheol & Kon, Stanley J., 1999. "Structural change and time dependence in models of stock returns," Journal of Empirical Finance, Elsevier, vol. 6(3), pages 283-308, September.
    6. Degiannakis, Stavros & Xekalaki, Evdokia, 2004. "Autoregressive Conditional Heteroskedasticity (ARCH) Models: A Review," MPRA Paper 80487, University Library of Munich, Germany.
    7. BAUWENS, Luc & HAFNER, Christian & LAURENT, Sébastien, 2011. "Volatility models," LIDAM Discussion Papers CORE 2011058, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
      • Bauwens, L. & Hafner, C. & Laurent, S., 2012. "Volatility Models," LIDAM Reprints ISBA 2012028, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
      • Bauwens, L. & Hafner C. & Laurent, S., 2011. "Volatility Models," LIDAM Discussion Papers ISBA 2011044, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    8. Bollerslev, Tim & Engle, Robert F. & Nelson, Daniel B., 1986. "Arch models," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 49, pages 2959-3038, Elsevier.
    9. Bollerslev, Tim & Chou, Ray Y. & Kroner, Kenneth F., 1992. "ARCH modeling in finance : A review of the theory and empirical evidence," Journal of Econometrics, Elsevier, vol. 52(1-2), pages 5-59.
    10. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2005. "Volatility forecasting," CFS Working Paper Series 2005/08, Center for Financial Studies (CFS).
    11. Yung-Shun Chen & Shiu-Tung Wang, 2004. "The empirical evidence of the leverage effect on volatility in international bulk shipping market," Maritime Policy & Management, Taylor & Francis Journals, vol. 31(2), pages 109-124, April.
    12. Geoffrey F. Loudon & Wing H. Watt & Pradeep K. Yadav, 2000. "An empirical analysis of alternative parametric ARCH models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(2), pages 117-136.
    13. Eskandar A. Tooma, 2003. "Modeling and Forecasting Egyptian Stock Market Volatility Before and After Price Limits," Working Papers 0310, Economic Research Forum, revised Apr 2003.
    14. Pal, Debdatta, 2022. "Does hospitality industry stock volatility react asymmetrically to health and economic crises?," Economic Modelling, Elsevier, vol. 108(C).
    15. Andersen, Torben G. & Bollerslev, Tim & Christoffersen, Peter F. & Diebold, Francis X., 2006. "Volatility and Correlation Forecasting," Handbook of Economic Forecasting, in: G. Elliott & C. Granger & A. Timmermann (ed.), Handbook of Economic Forecasting, edition 1, volume 1, chapter 15, pages 777-878, Elsevier.
    16. Alagidede, Paul & Panagiotidis, Theodore, 2009. "Modelling stock returns in Africa's emerging equity markets," International Review of Financial Analysis, Elsevier, vol. 18(1-2), pages 1-11, March.
    17. repec:wyi:journl:002087 is not listed on IDEAS
    18. Dongweí Su, 2003. "Risk, Return and Regulation in Chinese Stock Markets," World Scientific Book Chapters, in: Chinese Stock Markets A Research Handbook, chapter 3, pages 75-122, World Scientific Publishing Co. Pte. Ltd..
    19. Philip Rothman & Dick van Dijk & Philip Hans Franses, 1999. "A Multivariate STAR Analysis of the Relationship Between Money and Output," Working Papers 9913, East Carolina University, Department of Economics.
    20. Tim Bollerslev, 2008. "Glossary to ARCH (GARCH)," CREATES Research Papers 2008-49, Department of Economics and Business Economics, Aarhus University.
    21. Kai-Li Wang & Christopher Fawson & Christopher B. Barrett & James B. McDonald, 2001. "A flexible parametric GARCH model with an application to exchange rates," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 16(4), pages 521-536.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:taf:quantf:v:12:y:2012:i:3:p:437-449. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Chris Longhurst (email available below). General contact details of provider: http://www.tandfonline.com/RQUF20 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.