IDEAS home Printed from https://ideas.repec.org/p/fip/fedgif/317.html
   My bibliography  Save this paper

Monte Carlo methodology and the finite sample properties of statistics for testing nested and non-nested hypotheses

Author

Abstract

Using recently developed Monte Carlo methodology, this paper investigates the effect of dynamics and simultaneity on the finite sample properties of maximum likelihood and instrumental variables statistics for testing both nested and non-nested hypotheses. Numerical-analytical approximations (response surfaces) to the unknown finite sample size and power functions of those statistics are obtained for dynamic one-and two-equation models. The results illustrate the value of asymptotic theory in interpreting finite sample properties and certain limitations for doing so. Two practical finite sample results arise: the F form of the Wald statistic is strongly favored over its chi-squared form; and the effects of \"large-sigma\" and a small effective sample size are particularly pronounced for Sargan's (1958) instrumental variables statistic and Ericsson's (1983) Cox-type instrumental variables statistic. Re-examining Pesaran and Deaton's (1978) empirical example illustrates the additional information gained from the instrumental variables statistics.

Suggested Citation

  • Neil R. Ericsson, 1987. "Monte Carlo methodology and the finite sample properties of statistics for testing nested and non-nested hypotheses," International Finance Discussion Papers 317, Board of Governors of the Federal Reserve System (U.S.).
    • Handle: RePEc:fip:fedgif:317
    as

    Download full text from publisher

    File URL: http://www.federalreserve.gov/pubs/ifdp/1987/317/default.htm
    Download Restriction: no
    File URL: http://www.federalreserve.gov/pubs/ifdp/1987/317/ifdp317.pdf
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Kiviet, Jan F., 1985. "Model selection test procedures in a single linear equation of a dynamic simultaneous system and their defects in small samples," Journal of Econometrics, Elsevier, vol. 28(3), pages 327-362, June.
    2. Maasoumi, Esfandiar & Phillips, Peter C. B., 1982. "On the behavior of inconsistent instrumental variable estimators," Journal of Econometrics, Elsevier, vol. 19(2-3), pages 183-201, August.
    3. Sargan, J D, 1976. "Econometric Estimators and the Edgeworth Approximation," Econometrica, Econometric Society, vol. 44(3), pages 421-448, May.
    4. Sargan, J D & Mikhail, W M, 1971. "A General Approximation to the Distribution of Instrumental Variables Estimates," Econometrica, Econometric Society, vol. 39(1), pages 131-169, January.
    5. Phillips, P C B, 1986. "The Exact Distribution of the Wald Statistic," Econometrica, Econometric Society, vol. 54(4), pages 881-895, July.
    6. Phillips, P.C.B., 1986. "Understanding spurious regressions in econometrics," Journal of Econometrics, Elsevier, vol. 33(3), pages 311-340, December.
    7. Neil R. Ericsson, 1986. "Post-simulation Analysis of Monte Carlo Experiments: Interpreting Pesaran's (1974) Study of Non-nested Hypothesis Test Statistics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 691-707.
    8. Neil R. Ericsson, 1983. "Asymptotic Properties of Instrumental Variables Statistics for Testing Non-Nested Hypotheses," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 50(2), pages 287-304.
    9. Hendry, David F. & Richard, Jean-Francois, 1982. "On the formulation of empirical models in dynamic econometrics," Journal of Econometrics, Elsevier, vol. 20(1), pages 3-33, October.
    10. J. D. Sargan, 1980. "A Model of Wage-Price Inflation," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(1), pages 97-112.
    11. Farebrother, R W, 1980. "The Durbin-Watson Test for Serial Correlation When There Is No Intercept in the Regression," Econometrica, Econometric Society, vol. 48(6), pages 1553-1563, September.
    12. Mizon, Grayham E & Richard, Jean-Francois, 1986. "The Encompassing Principle and Its Application to Testing Non-nested Hypotheses," Econometrica, Econometric Society, vol. 54(3), pages 657-678, May.
    13. Sargan, J D, 1980. "Some Approximations to the Distribution of Econometric Criteria Which are Asymptotically Distributed as Chi-Squared," Econometrica, Econometric Society, vol. 48(5), pages 1107-1138, July.
    14. Hendry, David F. & Pagan, Adrian R. & Sargan, J.Denis, 1984. "Dynamic specification," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 18, pages 1023-1100, Elsevier.
    15. Pesaran, M H & Deaton, Angus S, 1978. "Testing Non-Nested Nonlinear Regression Models," Econometrica, Econometric Society, vol. 46(3), pages 677-694, May.
    16. D. S. Poskitt & A. R. Tremayne, 1981. "A Time Series Application Of The Use Of Monte Carlo Methods To Compare Statistical Tests," Journal of Time Series Analysis, Wiley Blackwell, vol. 2(4), pages 263-277, July.
    17. Hendry, David F & Mizon, Grayham E, 1978. "Serial Correlation as a Convenient Simplification, not a Nuisance: A Comment on a Study of the Demand for Money by the Bank of England," Economic Journal, Royal Economic Society, vol. 88(351), pages 549-563, September.
    18. P. C. B. Phillips, 1980. "Finite Sample Theory and the Distributions of Alternative Estimators of the Marginal Propensity to Consume," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(1), pages 183-224.
    19. Grayham E. Mizon & David F. Hendry, 1980. "An Empirical Application and Monte Carlo Analysis of Tests of Dynamic Specification," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 47(1), pages 21-45.
    20. Hendry, David F., 1982. "A reply to Professors Maasoumi and Phillips," Journal of Econometrics, Elsevier, vol. 19(2-3), pages 203-213, August.
    21. Pesaran, M. Hashem, 1987. "Global and Partial Non-Nested Hypotheses and Asymptotic Local Power," Econometric Theory, Cambridge University Press, vol. 3(1), pages 69-97, February.
    22. Hendry, David F., 1984. "Monte carlo experimentation in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 16, pages 937-976, Elsevier.
    23. Phoebus J. Dhrymes & E. Philip Howrey & Saul H. Hymans & Jan Kmenta & Edward E. Leamer & Richard E. Quandt & James B. Ramsey & Harold T. Shapiro & Victor Zarnowitz, 1972. "Criteria for Evaluation of Econometric Models," NBER Chapters, in: Annals of Economic and Social Measurement, Volume 1, number 3, pages 291-324, National Bureau of Economic Research, Inc.
    24. Jarque, Carlos M. & Bera, Anil K., 1980. "Efficient tests for normality, homoscedasticity and serial independence of regression residuals," Economics Letters, Elsevier, vol. 6(3), pages 255-259.
    25. Davidson, James E H, et al, 1978. "Econometric Modelling of the Aggregate Time-Series Relationship between Consumers' Expenditure and Income in the United Kingdom," Economic Journal, Royal Economic Society, vol. 88(352), pages 661-692, December.
    26. Hendry, David F, 1974. "Stochastic Specification in an Aggregate Demand Model of the United Kingdom," Econometrica, Econometric Society, vol. 42(3), pages 559-578, May.
    27. Jan F. Kiviet, 1986. "On the Rigour of Some Misspecification Tests for Modelling Dynamic Relationships," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(2), pages 241-261.
    28. Jan Kmenta & James B. Ramsey, 1980. "Evaluation of Econometric Models," NBER Books, National Bureau of Economic Research, Inc, number kmen80-1.
    29. Hausman, Jerry A, 1975. "An Instrumental Variable Approach to Full Information Estimators for Linear and Certain Nonlinear Econometric Models," Econometrica, Econometric Society, vol. 43(4), pages 727-738, July.
    30. Kadane, Joseph B, 1971. "Comparison of k-Class Estimators when the Disturbances are Small," Econometrica, Econometric Society, vol. 39(5), pages 723-737, September.
    31. James G. MacKinnon, 1983. "Model Specification Tests Against Non-Nested Alternatives," Working Paper 573, Economics Department, Queen's University.
    32. Anderson, T W, 1977. "Asymptotic Expansions of the Distributions of Estimates in Simultaneous Equations for Alternative Parameter Sequences," Econometrica, Econometric Society, vol. 45(2), pages 509-518, March.
    33. Hendry, David F., 1976. "The structure of simultaneous equations estimators," Journal of Econometrics, Elsevier, vol. 4(1), pages 51-88, February.
    34. Engle, Robert F, 1982. "Autoregressive Conditional Heteroscedasticity with Estimates of the Variance of United Kingdom Inflation," Econometrica, Econometric Society, vol. 50(4), pages 987-1007, July.
    35. P. Rothery, 1982. "The Use of Control Variates in Monte Carlo Estimation of Power," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 31(2), pages 125-129, June.
    36. MacKinnon, James G. & White, Halbert & Davidson, Russell, 1983. "Tests for model specification in the presence of alternative hypotheses : Some further results," Journal of Econometrics, Elsevier, vol. 21(1), pages 53-70, January.
    37. M. H. Pesaran, 1974. "On the General Problem of Model Selection," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 41(2), pages 153-171.
    38. Phillips, Peter C B, 1977. "Approximations to Some Finite Sample Distributions Associated with a First-Order Stochastic Difference Equation," Econometrica, Econometric Society, vol. 45(2), pages 463-485, March.
    39. Maxwell L. King & Michael McAleer, 1987. "Further Results on Testing AR (1) Against MA (1) Disturbances in the Linear Regression Model," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 54(4), pages 649-663.
    40. Campos, Julia, 1986. "Finite-sample properties of the instrumental-variables estimator for dynamic simultaneous-equation subsystems with ARMA disturbances," Journal of Econometrics, Elsevier, vol. 32(3), pages 333-366, August.
    41. Davidson, James E. H. & Hendry, David F., 1981. "Interpreting econometric evidence : The behaviour of consumers' expenditure in the UK," European Economic Review, Elsevier, vol. 16(1), pages 177-192.
    42. Godfrey, Leslie G, 1983. "Testing Non-Nested Models after Estimation by Instrumental Variables or Least Squares," Econometrica, Econometric Society, vol. 51(2), pages 355-365, March.
    43. Granger, C. W. J. & Newbold, P., 1974. "Spurious regressions in econometrics," Journal of Econometrics, Elsevier, vol. 2(2), pages 111-120, July.
    44. Godfrey, L. G. & Pesaran, M. H., 1983. "Tests of non-nested regression models: Small sample adjustments and Monte Carlo evidence," Journal of Econometrics, Elsevier, vol. 21(1), pages 133-154, January.
    45. repec:bla:econom:v:40:y:1973:i:158:p:210-17 is not listed on IDEAS
    46. Godfrey, Leslie G, 1978. "Testing against General Autoregressive and Moving Average Error Models When the Regressors Include Lagged Dependent Variables," Econometrica, Econometric Society, vol. 46(6), pages 1293-1301, November.
    47. B. Pereira, 1978. "Empirical comparisons of some tests of separate families of hypotheses," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 25(1), pages 219-234, December.
    48. Pesaran, M H, 1982. "Comparison of Local Power of Alternative Tests of Non-Nested Regression Models," Econometrica, Econometric Society, vol. 50(5), pages 1287-1305, September.
    49. Nicholls, D F & Pagan, A R, 1983. "Heteroscedasticity in Models with Lagged Dependent Variables," Econometrica, Econometric Society, vol. 51(4), pages 1233-1242, July.
    50. J. Campos, 1986. "Instrumental Variables Estimation of Dynamic Simultaneous Systems with ARMA Errors," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(1), pages 125-138.
    51. Hendry, David F. & Srba, Frank, 1980. "Autoreg: a computer program library for dynamic econometric models with autoregressive errors," Journal of Econometrics, Elsevier, vol. 12(1), pages 85-102, January.
    52. Robert Summers, 1959. "A Capital-Intensive Approach to the Small Sample Properties of Various Simultaneous Equation Estimators," Cowles Foundation Discussion Papers 64, Cowles Foundation for Research in Economics, Yale University.
    53. Hendry, David F & Srba, Frank, 1977. "The Properties of Autoregressive Instrumental Variables Estimators in Dynamic Systems," Econometrica, Econometric Society, vol. 45(4), pages 969-990, May.
    54. Klein, Lawrence R, 1969. "Estimation on Interdependent Systems in Macroeconometrics," Econometrica, Econometric Society, vol. 37(2), pages 171-192, April.
    55. Hendry, David F. & Harrison, Robin W., 1974. "Monte Carlo methodology and the small sample behaviour of ordinary and two-stage least squares," Journal of Econometrics, Elsevier, vol. 2(2), pages 151-174, July.
    56. Sowey, Eric R., 1973. "A classified bibliography of Monte Carlo studies in econometrics," Journal of Econometrics, Elsevier, vol. 1(4), pages 377-395, December.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Neil R. Ericsson, 1986. "Post-simulation Analysis of Monte Carlo Experiments: Interpreting Pesaran's (1974) Study of Non-nested Hypothesis Test Statistics," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 691-707.
    2. MacKinnon, James G, 1992. "Model Specification Tests and Artificial Regressions," Journal of Economic Literature, American Economic Association, vol. 30(1), pages 102-146, March.
    3. David F. Hendry & Peter C.B. Phillips, 2017. "John Denis Sargan at the London School of Economics," Cowles Foundation Discussion Papers 2082, Cowles Foundation for Research in Economics, Yale University.
    4. Luc Anselin, 1988. "Model Validation in Spatial Econometrics: A Review and Evaluation of Alternative Approaches," International Regional Science Review, , vol. 11(3), pages 279-316, December.
    5. Yock Y. Chong & David F. Hendry, 1986. "Econometric Evaluation of Linear Macro-Economic Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 53(4), pages 671-690.
    6. Adrian C. Darnell, 1994. "A Dictionary Of Econometrics," Books, Edward Elgar Publishing, number 118.
    7. Neil R. Ericsson, 2021. "Dynamic Econometrics in Action: A Biography of David F. Hendry," International Finance Discussion Papers 1311, Board of Governors of the Federal Reserve System (U.S.).
    8. McAleer, Michael, 1995. "The significance of testing empirical non-nested models," Journal of Econometrics, Elsevier, vol. 67(1), pages 149-171, May.
    9. Charles G. Renfro, 2009. "The Practice of Econometric Theory," Advanced Studies in Theoretical and Applied Econometrics, Springer, number 978-3-540-75571-5.
    10. Neil R. Ericsson & David F. Hendry, 1985. "Conditional econometric modelling : an application to new house prices in the United Kingdom," International Finance Discussion Papers 254, Board of Governors of the Federal Reserve System (U.S.).
    11. Julia Campos & Neil R. Ericsson & David F. Hendry, 2005. "General-to-specific modeling: an overview and selected bibliography," International Finance Discussion Papers 838, Board of Governors of the Federal Reserve System (U.S.).
    12. Hendry, David F. & Ericsson, Neil R., 1991. "Modeling the demand for narrow money in the United Kingdom and the United States," European Economic Review, Elsevier, vol. 35(4), pages 833-881, May.
    13. Mizon, Grayham E & Richard, Jean-Francois, 1986. "The Encompassing Principle and Its Application to Testing Non-nested Hypotheses," Econometrica, Econometric Society, vol. 54(3), pages 657-678, May.
    14. Hendry, David F., 1984. "Monte carlo experimentation in econometrics," Handbook of Econometrics, in: Z. Griliches† & M. D. Intriligator (ed.), Handbook of Econometrics, edition 1, volume 2, chapter 16, pages 937-976, Elsevier.
    15. David F. Hendry, 2013. "Econometric Modelling: The ‘Consumption Function’ In Retrospect," Scottish Journal of Political Economy, Scottish Economic Society, vol. 60(5), pages 495-522, November.
    16. Hendry, David F & Ericsson, Neil R, 1991. "An Econometric Analysis of U.K. Money Demand in 'Monetary Trends in the United States and the United Kingdom' by Milton Friedman and Anna Schwartz," American Economic Review, American Economic Association, vol. 81(1), pages 8-38, March.
    17. Ericsson, Neil R., 1992. "Parameter constancy, mean square forecast errors, and measuring forecast performance: An exposition, extensions, and illustration," Journal of Policy Modeling, Elsevier, vol. 14(4), pages 465-495, August.
    18. de Brouwer, Gordon & Ericsson, Neil R, 1998. "Modeling Inflation in Australia," Journal of Business & Economic Statistics, American Statistical Association, vol. 16(4), pages 433-449, October.
    19. David F. Hendry & Grayham E. Mizon, 2016. "Improving the teaching of econometrics," Cogent Economics & Finance, Taylor & Francis Journals, vol. 4(1), pages 1170096-117, December.
    20. McAleer, Michael, 1994. "Sherlock Holmes and the Search for Truth: A Diagnostic Tale," Journal of Economic Surveys, Wiley Blackwell, vol. 8(4), pages 317-370, December.

    More about this item

    Keywords

    Econometrics; Statistics;

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:fip:fedgif:317. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Ryan Wolfslayer ; Keisha Fournillier (email available below). General contact details of provider: https://edirc.repec.org/data/frbgvus.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.