IDEAS home Printed from https://ideas.repec.org/p/cir/cirwor/2015s-27.html
   My bibliography  Save this paper

Invariant tests based on M-estimators, estimating functions, and the generalized method of moments

Author

Listed:
  • Jean-Marie Dufour
  • Alain Trognon
  • Purevdorj Tuvaandorj

Abstract

We study the invariance properties of various test criteria which have been proposed for hypothesis testing in the context of incompletely specified models, such as models which are formulated in terms of estimating functions (Godambe, 1960, Ann. Math. Stat.) or moment conditions and are estimated by generalized method of moments (GMM) procedures (Hansen, 1982, Econometrica), and models estimated by pseudo-likelihood (Gouri´eroux, Monfort and Trognon, 1984, Econometrica) and M-estimation methods. The invariance properties considered include invariance to (possibly nonlinear) hypothesis reformulations and reparameterizations. The test statistics examined include Wald-type, LR-type, LM-type, score-type, and C()−type criteria. Extending the approach used in Dagenais and Dufour (1991, Econometrica), we show first that all these test statistics except the Wald-type ones are invariant to equivalent hypothesis reformulations (under usual regularity conditions), but all five of them are not generally invariant to model reparameterizations, including measurement unit changes in nonlinear models. In other words, testing two equivalent hypotheses in the context of equivalent models may lead to completely different inferences. For example, this may occur after an apparently innocuous rescaling of some model variables. Then, in view of avoiding such undesirable properties, we study restrictions that can be imposed on the objective functions used for pseudo-likelihood (or M-estimation) as well as the structure of the test criteria used with estimating functions and GMM procedures to obtain invariant tests. In particular, we show that using linear exponential pseudo-likelihood functions allows one to obtain invariant scoretype and C()−type test criteria, while in the context of estimating function (or GMM) procedures it is possible to modify a LR-type statistic proposed by Newey and West (1987, Int. Econ. Rev.) to obtain a test statistic that is invariant to general reparameterizations. The invariance associated with linear exponential pseudo-likelihood functions is interpreted as a strong argument for using such pseudo-likelihood functions in empirical work.

Suggested Citation

  • Jean-Marie Dufour & Alain Trognon & Purevdorj Tuvaandorj, 2015. "Invariant tests based on M-estimators, estimating functions, and the generalized method of moments," CIRANO Working Papers 2015s-27, CIRANO.
    • Handle: RePEc:cir:cirwor:2015s-27
    as

    Download full text from publisher

    File URL: https://cirano.qc.ca/files/publications/2015s-27.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. Newey, Whitney K & West, Kenneth D, 1987. "Hypothesis Testing with Efficient Method of Moments Estimation," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 28(3), pages 777-787, October.
    3. Dufour, Jean-Marie & Jasiak, Joann, 2001. "Finite Sample Limited Information Inference Methods for Structural Equations and Models with Generated Regressors," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 42(3), pages 815-843, August.
    4. Dagenais, Marcel G. & Dufour, Jean-Marie, 1992. "On the lack of invariance of some asymptotic tests to rescaling," Economics Letters, Elsevier, vol. 38(3), pages 251-257, March.
    5. James D. Hamilton & Daniel F. Waggoner & Tao Zha, 2007. "Normalization in Econometrics," Econometric Reviews, Taylor & Francis Journals, vol. 26(2-4), pages 221-252.
    6. Gourieroux, Christian & Monfort, Alain & Trognon, Alain, 1984. "Pseudo Maximum Likelihood Methods: Theory," Econometrica, Econometric Society, vol. 52(3), pages 681-700, May.
    7. Critchley, Frank & Marriott, Paul & Salmon, Mark, 1996. "On the Differential Geometry of the Wald Test with Nonlinear Restrictions," Econometrica, Econometric Society, vol. 64(5), pages 1213-1222, September.
    8. Davidson, Russell & MacKinnon, James G., 1993. "Estimation and Inference in Econometrics," OUP Catalogue, Oxford University Press, number 9780195060119.
    9. Crepon, Bruno & Duguet, Emmanuel, 1997. "Research and development, competition and innovation pseudo-maximum likelihood and simulated maximum likelihood methods applied to count data models with heterogeneity," Journal of Econometrics, Elsevier, vol. 79(2), pages 355-378, August.
    10. Gourieroux, C. & Monfort, A., 1989. "A General Framework for Testing a Null Hypothesis in a “Mixed” Form," Econometric Theory, Cambridge University Press, vol. 5(1), pages 63-82, April.
    11. Craig Burnside, 2016. "Identification and Inference in Linear Stochastic Discount Factor Models with Excess Returns," Journal of Financial Econometrics, Oxford University Press, vol. 14(2), pages 295-330.
    12. Hall, Alastair R., 2004. "Generalized Method of Moments," OUP Catalogue, Oxford University Press, number 9780198775201.
    13. Gourieroux,Christian & Monfort,Alain, 1995. "Statistics and Econometric Models," Cambridge Books, Cambridge University Press, number 9780521405515, September.
    14. Richard J Smith, 1987. "Alternative Asymptotically Optimal Tests and Their Application to Dynamic Specification," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 54(4), pages 665-680.
    15. Lafontaine, Francine & White, Kenneth J., 1986. "Obtaining any Wald statistic you want," Economics Letters, Elsevier, vol. 21(1), pages 35-40.
    16. Dagenais, Marcel G & Dufour, Jean-Marie, 1991. "Invariance, Nonlinear Models, and Asymptotic Tests," Econometrica, Econometric Society, vol. 59(6), pages 1601-1615, November.
    17. Hansen, Bruce E, 1992. "Consistent Covariance Matrix Estimation for Dependent Heterogeneous Processes," Econometrica, Econometric Society, vol. 60(4), pages 967-972, July.
    18. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    19. Newey, Whitney K. & McFadden, Daniel, 1986. "Large sample estimation and hypothesis testing," Handbook of Econometrics, in: R. F. Engle & D. McFadden (ed.), Handbook of Econometrics, edition 1, volume 4, chapter 36, pages 2111-2245, Elsevier.
    20. Marriott,Paul & Salmon,Mark (ed.), 2000. "Applications of Differential Geometry to Econometrics," Cambridge Books, Cambridge University Press, number 9780521651165, September.
    21. Phillips, Peter C B & Park, Joon Y, 1988. "On the Formulation of Wald Tests of Nonlinear Restrictions," Econometrica, Econometric Society, vol. 56(5), pages 1065-1083, September.
    22. Andrews, Donald W K & Monahan, J Christopher, 1992. "An Improved Heteroskedasticity and Autocorrelation Consistent Covariance Matrix Estimator," Econometrica, Econometric Society, vol. 60(4), pages 953-966, July.
    23. Unknown, 1986. "Letters," Choices: The Magazine of Food, Farm, and Resource Issues, Agricultural and Applied Economics Association, vol. 1(4), pages 1-9.
    24. Gourieroux,Christian & Monfort,Alain, 1995. "Statistics and Econometric Models 2 volume set," Cambridge Books, Cambridge University Press, number 9780521478373, July.
    25. Gregory, Allan W & Veall, Michael R, 1985. "Formulating Wald Tests of Nonlinear Restrictions," Econometrica, Econometric Society, vol. 53(6), pages 1465-1468, November.
    26. Jean-Marie Dufour, 1997. "Some Impossibility Theorems in Econometrics with Applications to Structural and Dynamic Models," Econometrica, Econometric Society, vol. 65(6), pages 1365-1388, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Pascale VALERY (HEC-Montreal) & Jean-Marie Dufour (University of Montreal), 2004. "A simple estimation method and finite-sample inference for a stochastic volatility model," Econometric Society 2004 North American Summer Meetings 153, Econometric Society.
    2. Oliver Hines & Stijn Vansteelandt & Karla Diaz-Ordaz, 2021. "Robust Inference for Mediated Effects in Partially Linear Models," Psychometrika, Springer;The Psychometric Society, vol. 86(2), pages 595-618, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dastoor, Naorayex, 2009. "The perceived framework of a classical statistic: Is the non-invariance of a Wald statistic much ado about null thing?," Working Papers 2009-25, University of Alberta, Department of Economics.
    2. Naorayex K Dastoor, 2008. "A simple explanation for the non-invariance of a Wald statistic to a reformulation of a null hypothesis," Economics Bulletin, AccessEcon, vol. 3(62), pages 1-10.
    3. repec:ebl:ecbull:v:3:y:2008:i:62:p:1-10 is not listed on IDEAS
    4. Brown, Kenneth & Cribari-Neto, Francisco, 1992. "On Hypothesis Testing: A Selective Look at the Lagrange Multiplier, Likelihood Ratio and Wald Tests," Brazilian Review of Econometrics, Sociedade Brasileira de Econometria - SBE, vol. 12(2), November.
    5. Kemp, Gordon C. R., 2001. "Invariance and the Wald test," Journal of Econometrics, Elsevier, vol. 104(2), pages 209-217, September.
    6. Lung-fei Lee & Jihai Yu, 2012. "The C(α)-type gradient test for spatial dependence in spatial autoregressive models," Letters in Spatial and Resource Sciences, Springer, vol. 5(3), pages 119-135, October.
    7. Joel L. Horowitz, 1996. "Bootstrap Methods in Econometrics: Theory and Numerical Performance," Econometrics 9602009, University Library of Munich, Germany, revised 05 Mar 1996.
    8. Becker, Ralf, 1998. "Die verallgemeinerte Momentenmethode: Darstellung und Anwendung," Arbeitspapiere des Instituts für Statistik und Ökonometrie 16, Johannes Gutenberg-Universität Mainz, Institut für Statistik und Ökonometrie.
    9. Dufour, Jean-Marie, 2001. "Logique et tests d’hypothèses," L'Actualité Economique, Société Canadienne de Science Economique, vol. 77(2), pages 171-190, juin.
    10. DUFOUR, Jean-Marie, 2001. "Logique et tests d'hypotheses: reflexions sur les problemes mal poses en econometrie," Cahiers de recherche 2001-15, Universite de Montreal, Departement de sciences economiques.
    11. Dovonon, Prosper & Hall, Alastair R. & Kleibergen, Frank, 2020. "Inference in second-order identified models," Journal of Econometrics, Elsevier, vol. 218(2), pages 346-372.
    12. Paulo M. D. C. Parente & Richard J. Smith, 2021. "Quasi‐maximum likelihood and the kernel block bootstrap for nonlinear dynamic models," Journal of Time Series Analysis, Wiley Blackwell, vol. 42(4), pages 377-405, July.
    13. Goh, Kim-Leng & King, Maxwell L., 1996. "Modified Wald tests for non-linear restrictions: A cautionary tale," Economics Letters, Elsevier, vol. 53(2), pages 133-138, November.
    14. Dufour, Jean-Marie & Pelletier, Denis & Renault, Eric, 2006. "Short run and long run causality in time series: inference," Journal of Econometrics, Elsevier, vol. 132(2), pages 337-362, June.
    15. Frank Kleibergen, 2004. "Expansions of GMM statistics that indicate their properties under weak and/or many instruments and the bootstrap," Econometric Society 2004 North American Summer Meetings 408, Econometric Society.
    16. Peñaranda, Francisco & Sentana, Enrique, 2012. "Spanning tests in return and stochastic discount factor mean–variance frontiers: A unifying approach," Journal of Econometrics, Elsevier, vol. 170(2), pages 303-324.
    17. Gouriéroux, Christian & Monfort, Alain & Zakoian, Jean-Michel, 2017. "Pseudo-Maximum Likelihood and Lie Groups of Linear Transformations," MPRA Paper 79623, University Library of Munich, Germany.
    18. Jean-Marie Dufour, 2003. "Identification, weak instruments, and statistical inference in econometrics," Canadian Journal of Economics, Canadian Economics Association, vol. 36(4), pages 767-808, November.
    19. Prosper Dovonon & Alastair Hall & Frank Kleibergen, 2018. "Inference in Second-Order Identified Models," CIRANO Working Papers 2018s-36, CIRANO.
    20. Smith, Richard J., 2005. "Automatic Positive Semidefinite Hac Covariance Matrix And Gmm Estimation," Econometric Theory, Cambridge University Press, vol. 21(1), pages 158-170, February.
    21. Richard Smith, 2005. "Weak instruments and empirical likelihood: a discussion of the papers by DWK Andrews and JH Stock and Y Kitamura," CeMMAP working papers CWP13/05, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.

    More about this item

    Keywords

    Testing; invariance; hypothesis reformulation; reparameterization; measurement unit; estimating function; generalized method of moment (GMM); pseudo-likelihood; M-estimator; Linear exponential model; Nonlinear model; Wald test; Likelihood ratio test; score test; lagrange multiplier test; C(∝) test.;
    All these keywords.

    JEL classification:

    • C3 - Mathematical and Quantitative Methods - - Multiple or Simultaneous Equation Models; Multiple Variables
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:cir:cirwor:2015s-27. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Webmaster (email available below). General contact details of provider: https://edirc.repec.org/data/ciranca.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.