IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v235y2023i1p105-132.html
   My bibliography  Save this article

A corrected Clarke test for model selection and beyond

Author

Listed:
  • Brück, Florian
  • Fermanian, Jean-David
  • Min, Aleksey

Abstract

We introduce a large family of model selection tests based on the expectation of an arbitrary, possibly non-smooth, parametric criterion function of the data. The considered methodology is illustrated for several econometric problems, including linear and quantile regression. It covers the case of strictly locally non-nested models and some overlapping models. The asymptotic theory of the proposed test statistic is stated. A general exchangeable bootstrap scheme allows the evaluation of its limiting law as well as its asymptotic variance. Our framework includes the tests for non-nested model selection of Vuong (1989) and Clarke (2007) as particular cases. We show that the statistic of the latter test is not Binomial distributed as originally stated and we provide its corrected limiting law. In a simulation study, we empirically verify the distributional approximation of our test statistic in a finite sample and examine the empirical level and power of the corresponding model selection tests in various settings. Finally, an analysis of a financial dataset illustrates the proposed model selection procedure at work.

Suggested Citation

  • Brück, Florian & Fermanian, Jean-David & Min, Aleksey, 2023. "A corrected Clarke test for model selection and beyond," Journal of Econometrics, Elsevier, vol. 235(1), pages 105-132.
  • Handle: RePEc:eee:econom:v:235:y:2023:i:1:p:105-132
    DOI: 10.1016/j.jeconom.2021.12.013
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407622000446
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2021.12.013?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Stephen V. Cameron & James J. Heckman, 1998. "Life Cycle Schooling and Dynamic Selection Bias: Models and Evidence for Five Cohorts of American Males," Journal of Political Economy, University of Chicago Press, vol. 106(2), pages 262-333, April.
    2. Joel L. Horowitz, 1998. "Bootstrap Methods for Median Regression Models," Econometrica, Econometric Society, vol. 66(6), pages 1327-1352, November.
    3. repec:cup:cbooks:9781107034662 is not listed on IDEAS
    4. Andrews, Donald W K, 1994. "Asymptotics for Semiparametric Econometric Models via Stochastic Equicontinuity," Econometrica, Econometric Society, vol. 62(1), pages 43-72, January.
    5. Li, Tong, 2009. "Simulation based selection of competing structural econometric models," Journal of Econometrics, Elsevier, vol. 148(2), pages 114-123, February.
    6. Ricardo J. Caballero & Eduardo M. R. A. Engel, 1999. "Explaining Investment Dynamics in U.S. Manufacturing: A Generalized (S,s) Approach," Econometrica, Econometric Society, vol. 67(4), pages 783-826, July.
    7. Susanne M. Schennach & Daniel Wilhelm, 2017. "A Simple Parametric Model Selection Test," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(520), pages 1663-1674, October.
    8. Harrison, Glenn W. & Martínez-Correa, Jimmy & Swarthout, J. Todd, 2015. "Reduction of compound lotteries with objective probabilities: Theory and evidence," Journal of Economic Behavior & Organization, Elsevier, vol. 119(C), pages 32-55.
    9. Lavergne, Pascal & Vuong, Quang H, 1996. "Nonparametric Selection of Regressors: The Nonnested Case," Econometrica, Econometric Society, vol. 64(1), pages 207-219, January.
    10. Vinzenz Erhardt & Claudia Czado, 2012. "Modeling dependent yearly claim totals including zero claims in private health insurance," Scandinavian Actuarial Journal, Taylor & Francis Journals, vol. 2012(2), pages 106-129.
    11. Chen, Xiaohong & Hong, Han & Shum, Matthew, 2007. "Nonparametric likelihood ratio model selection tests between parametric likelihood and moment condition models," Journal of Econometrics, Elsevier, vol. 141(1), pages 109-140, November.
    12. Markwat, Thijs & Kole, Erik & van Dijk, Dick, 2009. "Contagion as a domino effect in global stock markets," Journal of Banking & Finance, Elsevier, vol. 33(11), pages 1996-2012, November.
    13. Xiaohong Chen & Oliver Linton & Ingrid Van Keilegom, 2003. "Estimation of Semiparametric Models when the Criterion Function Is Not Smooth," Econometrica, Econometric Society, vol. 71(5), pages 1591-1608, September.
    14. Czajkowski, Mikolaj & Buszko-Briggs, Malgorzata & Hanley, Nick, 2009. "Valuing changes in forest biodiversity," Ecological Economics, Elsevier, vol. 68(12), pages 2910-2917, October.
    15. Ichimura, Hidehiko & Lee, Sokbae, 2010. "Characterization of the asymptotic distribution of semiparametric M-estimators," Journal of Econometrics, Elsevier, vol. 159(2), pages 252-266, December.
    16. Anastasios Panagiotelis & Claudia Czado & Harry Joe, 2012. "Pair Copula Constructions for Multivariate Discrete Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(499), pages 1063-1072, September.
    17. White,Halbert, 1996. "Estimation, Inference and Specification Analysis," Cambridge Books, Cambridge University Press, number 9780521574464.
    18. Brooks,Chris, 2014. "Introductory Econometrics for Finance," Cambridge Books, Cambridge University Press, number 9781107661455, December.
    19. Monfort, Alain, 1996. "A Reappraisal of Misspecified Econometric Models," Econometric Theory, Cambridge University Press, vol. 12(4), pages 597-619, October.
    20. Newey, Whitney K., 1984. "A method of moments interpretation of sequential estimators," Economics Letters, Elsevier, vol. 14(2-3), pages 201-206.
    21. Whang, Yoon-Jae, 2006. "Smoothed Empirical Likelihood Methods For Quantile Regression Models," Econometric Theory, Cambridge University Press, vol. 22(2), pages 173-205, April.
    22. Jeffrey M Wooldridge, 2010. "Econometric Analysis of Cross Section and Panel Data," MIT Press Books, The MIT Press, edition 2, volume 1, number 0262232588, April.
    23. Kosuke Imai & Dustin Tingley, 2012. "A Statistical Method for Empirical Testing of Competing Theories," American Journal of Political Science, John Wiley & Sons, vol. 56(1), pages 218-236, January.
    24. Vuong, Quang H, 1989. "Likelihood Ratio Tests for Model Selection and Non-nested Hypotheses," Econometrica, Econometric Society, vol. 57(2), pages 307-333, March.
    25. Pakes, Ariel & Pollard, David, 1989. "Simulation and the Asymptotics of Optimization Estimators," Econometrica, Econometric Society, vol. 57(5), pages 1027-1057, September.
    26. Koenker,Roger, 2005. "Quantile Regression," Cambridge Books, Cambridge University Press, number 9780521845731.
    27. Yu‐Chin Hsu & Xiaoxia Shi, 2017. "Model‐selection tests for conditional moment restriction models," Econometrics Journal, Royal Economic Society, vol. 20(1), pages 52-85, February.
    28. Zhipeng Liao & Xiaoxia Shi, 2020. "A nondegenerate Vuong test and post selection confidence intervals for semi/nonparametric models," Quantitative Economics, Econometric Society, vol. 11(3), pages 983-1017, July.
    29. P. Lavergne & Q.H. Vuong, 1996. "Nonparametric selection of regressors : the nonnested case [[Sélection non paramétrique de régresseurs : le cas de régressions non emboîtées]]," Post-Print hal-02689500, HAL.
    30. repec:hal:journl:peer-00741628 is not listed on IDEAS
    31. Angelidis, Timotheos & Benos, Alexandros & Degiannakis, Stavros, 2004. "The Use of GARCH Models in VaR Estimation," MPRA Paper 96332, University Library of Munich, Germany.
    32. Vaart,A. W. van der, 2000. "Asymptotic Statistics," Cambridge Books, Cambridge University Press, number 9780521784504, September.
    33. Hong, Han & Preston, Bruce, 2012. "Bayesian averaging, prediction and nonnested model selection," Journal of Econometrics, Elsevier, vol. 167(2), pages 358-369.
    34. Lanny W. Martin & Georg Vanberg, 2014. "Parties and Policymaking in Multiparty Governments: The Legislative Median, Ministerial Autonomy, and the Coalition Compromise," American Journal of Political Science, John Wiley & Sons, vol. 58(4), pages 979-996, October.
    35. Murphy, Kevin M & Topel, Robert H, 2002. "Estimation and Inference in Two-Step Econometric Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 88-97, January.
    36. Xiaoxia Shi, 2015. "A nondegenerate Vuong test," Quantitative Economics, Econometric Society, vol. 6(1), pages 85-121, March.
    37. Koliai, Lyes, 2016. "Extreme risk modeling: An EVT–pair-copulas approach for financial stress tests," Journal of Banking & Finance, Elsevier, vol. 70(C), pages 1-22.
    38. Liliane Bonnal & Denis Fougère & Anne Sérandon, 1997. "Evaluating the Impact of French Employment Policies on Individual Labour Market Histories," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 64(4), pages 683-713.
    39. Stephen V. Cameron & James J. Heckman, 1998. "Life Cycle Schooling and Dynamic Selection Bias: Models and Evidence for Five Cohorts," NBER Working Papers 6385, National Bureau of Economic Research, Inc.
    40. Chad Kendall & Tommaso Nannicini & Francesco Trebbi, 2015. "How Do Voters Respond to Information? Evidence from a Randomized Campaign," American Economic Review, American Economic Association, vol. 105(1), pages 322-353, January.
    41. Yaw Nyarko & Andrew Schotter, 2002. "An Experimental Study of Belief Learning Using Elicited Beliefs," Econometrica, Econometric Society, vol. 70(3), pages 971-1005, May.
    42. Agarwal, Vineet & Taffler, Richard, 2008. "Comparing the performance of market-based and accounting-based bankruptcy prediction models," Journal of Banking & Finance, Elsevier, vol. 32(8), pages 1541-1551, August.
    43. Shi, Xiaoxia, 2015. "Model selection tests for moment inequality models," Journal of Econometrics, Elsevier, vol. 187(1), pages 1-17.
    44. Clarke, Kevin A., 2007. "A Simple Distribution-Free Test for Nonnested Model Selection," Political Analysis, Cambridge University Press, vol. 15(3), pages 347-363, July.
    45. Fafchamps, Marcel, 1993. "Sequential Labor Decisions under Uncertainty: An Estimable Household Model of West-African Farmers," Econometrica, Econometric Society, vol. 61(5), pages 1173-1197, September.
    46. John D. Hey & Luca Panaccione, 2018. "Dynamic decision making: what do people do?," World Scientific Book Chapters, in: Experiments in Economics Decision Making and Markets, chapter 10, pages 235-273, World Scientific Publishing Co. Pte. Ltd..
    47. Alexander Karaivanov & Robert M. Townsend, 2014. "Dynamic Financial Constraints: Distinguishing Mechanism Design From Exogenously Incomplete Regimes," Econometrica, Econometric Society, vol. 82(3), pages 887-959, May.
    48. Newey, Whitney K & Powell, James L, 1987. "Asymmetric Least Squares Estimation and Testing," Econometrica, Econometric Society, vol. 55(4), pages 819-847, July.
    49. Douglas Rivers & Quang Vuong, 2002. "Model selection tests for nonlinear dynamic models," Econometrics Journal, Royal Economic Society, vol. 5(1), pages 1-39, June.
    50. Sawa, Takamitsu, 1978. "Information Criteria for Discriminating among Alternative Regression Models," Econometrica, Econometric Society, vol. 46(6), pages 1273-1291, November.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhipeng Liao & Xiaoxia Shi, 2020. "A nondegenerate Vuong test and post selection confidence intervals for semi/nonparametric models," Quantitative Economics, Econometric Society, vol. 11(3), pages 983-1017, July.
    2. Francesco Bravo, 2022. "Misspecified semiparametric model selection with weakly dependent observations," Journal of Time Series Analysis, Wiley Blackwell, vol. 43(4), pages 558-586, July.
    3. Liu, Tuo & Lee, Lung-fei, 2019. "A likelihood ratio test for spatial model selection," Journal of Econometrics, Elsevier, vol. 213(2), pages 434-458.
    4. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    5. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    6. Parente, Paulo M.D.C. & Smith, Richard J., 2011. "Gel Methods For Nonsmooth Moment Indicators," Econometric Theory, Cambridge University Press, vol. 27(1), pages 74-113, February.
    7. Mammen, Enno & Rothe, Christoph & Schienle, Melanie, 2016. "Semiparametric Estimation With Generated Covariates," Econometric Theory, Cambridge University Press, vol. 32(5), pages 1140-1177, October.
    8. Xiaoxia Shi, 2015. "A nondegenerate Vuong test," Quantitative Economics, Econometric Society, vol. 6(1), pages 85-121, March.
    9. Lee, Seojeong, 2014. "Asymptotic refinements of a misspecification-robust bootstrap for generalized method of moments estimators," Journal of Econometrics, Elsevier, vol. 178(P3), pages 398-413.
    10. Hidehiko Ichimura & Whitney K. Newey, 2022. "The influence function of semiparametric estimators," Quantitative Economics, Econometric Society, vol. 13(1), pages 29-61, January.
    11. repec:hum:wpaper:sfb649dp2014-043 is not listed on IDEAS
    12. Victor Chernozhukov & Juan Carlos Escanciano & Hidehiko Ichimura & Whitney K. Newey & James M. Robins, 2022. "Locally Robust Semiparametric Estimation," Econometrica, Econometric Society, vol. 90(4), pages 1501-1535, July.
    13. Jesús Fernández-Villaverde & Juan F. Rubio-Ramírez, 2007. "Estimating Macroeconomic Models: A Likelihood Approach," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 74(4), pages 1059-1087.
    14. Cui, Xiaomeng & Gafarov, Bulat & Ghanem, Dalia & Kuffner, Todd, 2024. "On model selection criteria for climate change impact studies," Journal of Econometrics, Elsevier, vol. 239(1).
    15. Fan, Yanqin & Liu, Ruixuan, 2016. "A direct approach to inference in nonparametric and semiparametric quantile models," Journal of Econometrics, Elsevier, vol. 191(1), pages 196-216.
    16. Nathan Canen & Kristopher Ramsay, 2024. "Quantifying theory in politics: Identification, interpretation, and the role of structural methods," Journal of Theoretical Politics, , vol. 36(4), pages 301-327, October.
    17. Santiago Pereda-Fernández, 2021. "Copula-Based Random Effects Models for Clustered Data," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 39(2), pages 575-588, March.
    18. Ichimura, Hidehiko & Todd, Petra E., 2007. "Implementing Nonparametric and Semiparametric Estimators," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 74, Elsevier.
    19. de Castro, Luciano & Galvao, Antonio F. & Noussair, Charles N. & Qiao, Liang, 2022. "Do people maximize quantiles?," Games and Economic Behavior, Elsevier, vol. 132(C), pages 22-40.
    20. Komunjer, Ivana, 2005. "Quasi-maximum likelihood estimation for conditional quantiles," Journal of Econometrics, Elsevier, vol. 128(1), pages 137-164, September.
    21. Xu, Ke-Li, 2018. "A semi-nonparametric estimator of regression discontinuity design with discrete duration outcomes," Journal of Econometrics, Elsevier, vol. 206(1), pages 258-278.

    More about this item

    Keywords

    Asymptotic law; Bootstrap; Clarke test; Kullback–Leibler information criterion; Model selection;
    All these keywords.

    JEL classification:

    • C52 - Mathematical and Quantitative Methods - - Econometric Modeling - - - Model Evaluation, Validation, and Selection
    • C12 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Hypothesis Testing: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:235:y:2023:i:1:p:105-132. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.