IDEAS home Printed from https://ideas.repec.org/p/ubc/pmicro/vadim_marmer-2008-13.html
   My bibliography  Save this paper

Optimal Comparison of Misspecified Moment Restriction Models under a Chosen Measure of Fit

Author

Listed:
  • Marmer, Vadim
  • Otsu, Taisuke

Abstract

Suppose that the econometrician is interested in comparing two misspecified moment restriction models, where the comparison is performed in terms of some chosen measure of fit. This paper is concerned with describing an optimal test of the Vuong (1989) and Rivers and Vuong (2002) type null hypothesis that the two models are equivalent under the given measure of fit (the ranking may vary for different measures). We adopt the generalized Neyman-Pearson optimality criterion, which focuses on the decay rates of the type I and II error probabilities under fixed non-local alternatives, and derive an optimal but practically infeasible test. Then, as an illustration, by considering the model comparison hypothesis defined by the weighted Euclidean norm of moment restrictions, we propose a feasible approximate test statistic to the optimal one and study its asymptotic properties. Local power properties, one-sided test, and comparison under the generalized empirical likelihood-based measure of fit are also investigated. A simulation study illustrates that our approximate test is more powerful than the Rivers-Vuong test.

Suggested Citation

  • Marmer, Vadim & Otsu, Taisuke, 2008. "Optimal Comparison of Misspecified Moment Restriction Models under a Chosen Measure of Fit," Microeconomics.ca working papers vadim_marmer-2008-13, Vancouver School of Economics, revised 25 Jul 2011.
  • Handle: RePEc:ubc:pmicro:vadim_marmer-2008-13
    as

    Download full text from publisher

    File URL: http://microeconomics.ca/vadim_marmer/ELdisc27.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Christoffersen, Peter & Hahn, Jinyong & Inoue, Atsushi, 2001. "Testing and comparing Value-at-Risk measures," Journal of Empirical Finance, Elsevier, vol. 8(3), pages 325-342, July.
    2. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    3. Watson, Mark W, 1993. "Measures of Fit for Calibrated Models," Journal of Political Economy, University of Chicago Press, vol. 101(6), pages 1011-1041, December.
    4. Corradi, Valentina & Swanson, Norman R., 2007. "Evaluation of dynamic stochastic general equilibrium models based on distributional comparison of simulated and historical data," Journal of Econometrics, Elsevier, vol. 136(2), pages 699-723, February.
    5. Hansen, Lars Peter & Jagannathan, Ravi, 1997. "Assessing Specification Errors in Stochastic Discount Factor Models," Journal of Finance, American Finance Association, vol. 52(2), pages 557-590, June.
    6. Otsu, Taisuke & Whang, Yoon-Jae, 2011. "Testing For Nonnested Conditional Moment Restrictions Via Conditional Empirical Likelihood," Econometric Theory, Cambridge University Press, vol. 27(1), pages 114-153, February.
    7. Whitney K. Newey & Richard J. Smith, 2004. "Higher Order Properties of Gmm and Generalized Empirical Likelihood Estimators," Econometrica, Econometric Society, vol. 72(1), pages 219-255, January.
    8. Davidson, Russell & MacKinnon, James G, 1981. "Several Tests for Model Specification in the Presence of Alternative Hypotheses," Econometrica, Econometric Society, vol. 49(3), pages 781-793, May.
    9. Gourieroux, Christian & Holly, Alberto & Monfort, Alain, 1982. "Likelihood Ratio Test, Wald Test, and Kuhn-Tucker Test in Linear Models with Inequality Constraints on the Regression Parameters," Econometrica, Econometric Society, vol. 50(1), pages 63-80, January.
    10. Smith, Richard J, 1992. "Non-nested.Tests for Competing Models Estimated by Generalized Method of Moments," Econometrica, Econometric Society, vol. 60(4), pages 973-980, July.
    11. Gourieroux, C & Monfort, A & Renault, E, 1993. "Indirect Inference," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 8(S), pages 85-118, Suppl. De.
    12. Raymond Kan & Cesare Robotti & Jay Shanken, 2013. "Pricing Model Performance and the Two‐Pass Cross‐Sectional Regression Methodology," Journal of Finance, American Finance Association, vol. 68(6), pages 2617-2649, December.
    13. Guggenberger, Patrik & Smith, Richard J., 2005. "Generalized Empirical Likelihood Estimators And Tests Under Partial, Weak, And Strong Identification," Econometric Theory, Cambridge University Press, vol. 21(4), pages 667-709, August.
    14. Victor Aguirregabiria & Pedro Mira, 2002. "Swapping the Nested Fixed Point Algorithm: A Class of Estimators for Discrete Markov Decision Models," Econometrica, Econometric Society, vol. 70(4), pages 1519-1543, July.
    15. Singleton, Kenneth J., 1985. "Testing specifications of economic agents' intertemporal optimum problems in the presence of alternative models," Journal of Econometrics, Elsevier, vol. 30(1-2), pages 391-413.
    16. Leininger, Wolfgang, 1984. "A generalization of the 'maximum theorem'," Economics Letters, Elsevier, vol. 15(3-4), pages 309-313.
    17. Hall, Alastair R. & Inoue, Atsushi, 2003. "The large sample behaviour of the generalized method of moments estimator in misspecified models," Journal of Econometrics, Elsevier, vol. 114(2), pages 361-394, June.
    18. Raymond Kan & Cesare Robotti, 2009. "Model Comparison Using the Hansen-Jagannathan Distance," The Review of Financial Studies, Society for Financial Studies, vol. 22(9), pages 3449-3490, September.
    19. Smith, Richard J, 1997. "Alternative Semi-parametric Likelihood Approaches to Generalised Method of Moments Estimation," Economic Journal, Royal Economic Society, vol. 107(441), pages 503-519, March.
    20. Blundell,Richard & Newey,Whitney K. & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521871532, September.
    21. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    22. Frank Schorfheide, 2000. "Loss function-based evaluation of DSGE models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 15(6), pages 645-670.
    23. Maasoumi, Esfandiar & Phillips, Peter C. B., 1982. "On the behavior of inconsistent instrumental variable estimators," Journal of Econometrics, Elsevier, vol. 19(2-3), pages 183-201, August.
    24. Ramalho, Joaquim J. S. & Smith, Richard J., 2002. "Generalized empirical likelihood non-nested tests," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 99-125, March.
    25. Yuichi Kitamura, 2001. "Asymptotic Optimality of Empirical Likelihood for Testing Moment Restrictions," Econometrica, Econometric Society, vol. 69(6), pages 1661-1672, November.
    26. Hall, Alastair R. & Pelletier, Denis, 2011. "Nonnested Testing In Models Estimated Via Generalized Method Of Moments," Econometric Theory, Cambridge University Press, vol. 27(2), pages 443-456, April.
    27. Domowitz, Ian & White, Halbert, 1982. "Misspecified models with dependent observations," Journal of Econometrics, Elsevier, vol. 20(1), pages 35-58, October.
    28. Hendry, David F., 1979. "The behaviour of inconsistent instrumental variables estimators in dynamic systems with autocorrelated errors," Journal of Econometrics, Elsevier, vol. 9(3), pages 295-314, February.
    29. Blundell,Richard & Newey,Whitney & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521871549, September.
    30. Kitamura, Yuichi & Stutzer, Michael, 2002. "Connections between entropic and linear projections in asset pricing estimation," Journal of Econometrics, Elsevier, vol. 107(1-2), pages 159-174, March.
    31. Victor Aguirregabiria & Pedro Mira, 2007. "Sequential Estimation of Dynamic Discrete Games," Econometrica, Econometric Society, vol. 75(1), pages 1-53, January.
    32. Yuichi Kitamura & Andres Santos & Azeem M. Shaikh, 2012. "On the Asymptotic Optimality of Empirical Likelihood for Testing Moment Restrictions," Econometrica, Econometric Society, vol. 80(1), pages 413-423, January.
    33. Dridi, Ramdan & Guay, Alain & Renault, Eric, 2007. "Indirect inference and calibration of dynamic stochastic general equilibrium models," Journal of Econometrics, Elsevier, vol. 136(2), pages 397-430, February.
    34. Blundell,Richard & Newey,Whitney & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521692106, September.
    35. Kasahara, Hiroyuki & Shimotsu, Katsumi, 2008. "Pseudo-likelihood estimation and bootstrap inference for structural discrete Markov decision models," Journal of Econometrics, Elsevier, vol. 146(1), pages 92-106, September.
    36. Bates, Charles & White, Halbert, 1985. "A Unified Theory of Consistent Estimation for Parametric Models," Econometric Theory, Cambridge University Press, vol. 1(2), pages 151-178, August.
    37. Ghysels, Eric & Hall, Alastair, 1990. "Testing nonnested Euler conditions with quadrature-based methods of approximation," Journal of Econometrics, Elsevier, vol. 46(3), pages 273-308, December.
    38. Douglas Rivers & Quang Vuong, 2002. "Model selection tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 5(1), pages 1-39, June.
    39. Blundell,Richard & Newey,Whitney K. & Persson,Torsten (ed.), 2007. "Advances in Economics and Econometrics," Cambridge Books, Cambridge University Press, number 9780521692090, September.
    40. James G. MacKinnon, 1983. "Model Specification Tests Against Non-Nested Alternatives," Working Paper 573, Economics Department, Queen's University.
    41. White, Halbert, 1982. "Maximum Likelihood Estimation of Misspecified Models," Econometrica, Econometric Society, vol. 50(1), pages 1-25, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Fernández-Villaverde, J. & Rubio-Ramírez, J.F. & Schorfheide, F., 2016. "Solution and Estimation Methods for DSGE Models," Handbook of Macroeconomics, in: J. B. Taylor & Harald Uhlig (ed.), Handbook of Macroeconomics, edition 1, volume 2, chapter 0, pages 527-724, Elsevier.
    2. Lee, Seojeong, 2014. "Asymptotic refinements of a misspecification-robust bootstrap for generalized method of moments estimators," Journal of Econometrics, Elsevier, vol. 178(P3), pages 398-413.
    3. Jang, Tae-Seok, 2012. "Structural estimation of the New-Keynesian Model: a formal test of backward- and forward-looking expectations," MPRA Paper 40278, University Library of Munich, Germany.
    4. Jang, Tae-Seok, 2012. "Structural estimation of the New-Keynesian model: A formal test of backward- and forward-looking behavior," Economics Working Papers 2012-07, Christian-Albrechts-University of Kiel, Department of Economics.
    5. Jang, Tae-Seok, 2012. "Structural estimation of the New-Keynesian Model: a formal test of backward- and forward-looking expectations," MPRA Paper 39669, University Library of Munich, Germany.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. repec:bla:ecorec:v:91:y:2015:i::p:1-24 is not listed on IDEAS
    2. Otsu, Taisuke & Whang, Yoon-Jae, 2011. "Testing For Nonnested Conditional Moment Restrictions Via Conditional Empirical Likelihood," Econometric Theory, Cambridge University Press, vol. 27(1), pages 114-153, February.
    3. Antoine, Bertille & Dovonon, Prosper, 2021. "Robust estimation with exponentially tilted Hellinger distance," Journal of Econometrics, Elsevier, vol. 224(2), pages 330-344.
    4. Alastair R. Hall, 2015. "Econometricians Have Their Moments: GMM at 32," The Economic Record, The Economic Society of Australia, vol. 91(S1), pages 1-24, June.
    5. Hnatkovska, Viktoria & Marmer, Vadim & Tang, Yao, 2012. "Comparison of misspecified calibrated models: The minimum distance approach," Journal of Econometrics, Elsevier, vol. 169(1), pages 131-138.
    6. Nikolay Gospodinov & Raymond Kan & Cesare Robotti, 2018. "Asymptotic variance approximations for invariant estimators in uncertain asset-pricing models," Econometric Reviews, Taylor & Francis Journals, vol. 37(7), pages 695-718, August.
    7. Lavergne, Pascal, 2015. "Assessing the Approximate Validity of Moment Restrictions," TSE Working Papers 15-562, Toulouse School of Economics (TSE), revised May 2020.
    8. Otsu, Taisuke & Seo, Myung Hwan & Whang, Yoon-Jae, 2012. "Testing for non-nested conditional moment restrictions using unconditional empirical likelihood," Journal of Econometrics, Elsevier, vol. 167(2), pages 370-382.
    9. Sueishi, Naoya, 2013. "Identification problem of the exponential tilting estimator under misspecification," Economics Letters, Elsevier, vol. 118(3), pages 509-511.
    10. Jin, Fei & Lee, Lung-fei, 2019. "GEL estimation and tests of spatial autoregressive models," Journal of Econometrics, Elsevier, vol. 208(2), pages 585-612.
    11. Hahn, Jinyong & Newey, Whitney K. & Smith, Richard J., 2014. "Neglected heterogeneity in moment condition models," Journal of Econometrics, Elsevier, vol. 178(P1), pages 86-100.
    12. Yuichi Kitamura, 2006. "Empirical Likelihood Methods in Econometrics: Theory and Practice," CIRJE F-Series CIRJE-F-430, CIRJE, Faculty of Economics, University of Tokyo.
    13. Guggenberger, Patrik & Ramalho, Joaquim J.S. & Smith, Richard J., 2012. "GEL statistics under weak identification," Journal of Econometrics, Elsevier, vol. 170(2), pages 331-349.
    14. Susanne M. Schennach, 2007. "Point estimation with exponentially tilted empirical likelihood," Papers 0708.1874, arXiv.org.
    15. Jan F. Kiviet & Jerzy Niemczyk, 2014. "On the Limiting and Empirical Distributions of IV Estimators When Some of the Instruments are Actually Endogenous," Advances in Econometrics, in: Essays in Honor of Peter C. B. Phillips, volume 33, pages 425-490, Emerald Group Publishing Limited.
    16. Susanne M. Schennach & Daniel Wilhelm, 2017. "A Simple Parametric Model Selection Test," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1663-1674, October.
    17. Xuexin Wang, 2020. "A new class of tests for overidentifying restrictions in moment condition models," Econometric Reviews, Taylor & Francis Journals, vol. 39(5), pages 495-509, May.
    18. Chen, Xiaohong & Hong, Han & Shum, Matthew, 2007. "Nonparametric likelihood ratio model selection tests between parametric likelihood and moment condition models," Journal of Econometrics, Elsevier, vol. 141(1), pages 109-140, November.
    19. Lee, Seojeong, 2014. "Asymptotic refinements of a misspecification-robust bootstrap for generalized method of moments estimators," Journal of Econometrics, Elsevier, vol. 178(P3), pages 398-413.
    20. Otsu, Taisuke, 2011. "Moderate deviations of generalized method of moments and empirical likelihood estimators," Journal of Multivariate Analysis, Elsevier, vol. 102(8), pages 1203-1216, September.
    21. Prosper Dovonon, 2016. "Large Sample Properties of the Three-Step Euclidean Likelihood Estimators under Model Misspecification," Econometric Reviews, Taylor & Francis Journals, vol. 35(4), pages 465-514, April.

    More about this item

    Keywords

    Moment restriction; Model comparison; Misspecification; Generalized Neyman-Pearson optimality; Empirical likelihood; GMM;
    All these keywords.

    JEL classification:

    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General
    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General
    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:ubc:pmicro:vadim_marmer-2008-13. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Maureen Chin (email available below). General contact details of provider: http://www.economics.ubc.ca/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.