IDEAS home Printed from https://ideas.repec.org/a/eee/econom/v194y2016i1p187-202.html
   My bibliography  Save this article

Consistent model specification tests based on k-nearest-neighbor estimation method

Author

Listed:
  • Li, Hongjun
  • Li, Qi
  • Liu, Ruixuan

Abstract

We propose a simple consistent test for a parametric regression functional form based on k-nearest-neighbor (k-nn) method. We derive the null distribution of the test statistic and show that the test achieves the minimax rate optimality against smooth alternatives. A wild bootstrap method is used to better approximate the null distribution of the test statistic. We also propose a k-nn statistic which tests for omitted variables nonparametrically. Simulations and an empirical application using US economics new Ph.D. job market matching data show that the k-nn method is more appropriate than the kernel method to analyze unevenly distributed data.

Suggested Citation

  • Li, Hongjun & Li, Qi & Liu, Ruixuan, 2016. "Consistent model specification tests based on k-nearest-neighbor estimation method," Journal of Econometrics, Elsevier, vol. 194(1), pages 187-202.
  • Handle: RePEc:eee:econom:v:194:y:2016:i:1:p:187-202
    DOI: 10.1016/j.jeconom.2016.03.004
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0304407616301075
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.jeconom.2016.03.004?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Neumeyer, N. & Van Keilegom, I., 2010. "Estimating the error distribution in nonparametric multiple regression with applications to model testing," LIDAM Reprints ISBA 2010006, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    2. P. M. Robinson, 1989. "Hypothesis Testing in Semiparametric and Nonparametric Models for Econometric Time Series," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 56(4), pages 511-534.
    3. Gao, Jiti & Gijbels, Irène, 2008. "Bandwidth Selection in Nonparametric Kernel Testing," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1584-1594.
    4. Wenceslao González-Manteiga & Rosa Crujeiras, 2013. "Rejoinder on: An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 442-447, September.
    5. Desheng Ouyang & Dong Li & Qi Li, 2006. "Cross-validation and non-parametric k nearest-neighbour estimation," Econometrics Journal, Royal Economic Society, vol. 9(3), pages 448-471, November.
    6. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    7. Wooldridge, Jeffrey M., 1992. "A Test for Functional Form Against Nonparametric Alternatives," Econometric Theory, Cambridge University Press, vol. 8(4), pages 452-475, December.
    8. Lavergne, Pascal & Vuong, Quang H, 1996. "Nonparametric Selection of Regressors: The Nonnested Case," Econometrica, Econometric Society, vol. 64(1), pages 207-219, January.
    9. Herman J. Bierens & Werner Ploberger, 1997. "Asymptotic Theory of Integrated Conditional Moment Tests," Econometrica, Econometric Society, vol. 65(5), pages 1129-1152, September.
    10. Donald W. K. Andrews, 1997. "A Conditional Kolmogorov Test," Econometrica, Econometric Society, vol. 65(5), pages 1097-1128, September.
    11. Escanciano, Juan Carlos & Jacho-Chávez, David T. & Lewbel, Arthur, 2014. "Uniform convergence of weighted sums of non and semiparametric residuals for estimation and testing," Journal of Econometrics, Elsevier, vol. 178(P3), pages 426-443.
    12. Robinson, P M, 1987. "Asymptotically Efficient Estimation in the Presence of Heteroskedasticity of Unknown Form," Econometrica, Econometric Society, vol. 55(4), pages 875-891, July.
    13. Newey, Whitney K, 1990. "Efficient Instrumental Variables Estimation of Nonlinear Models," Econometrica, Econometric Society, vol. 58(4), pages 809-837, July.
    14. Jun, Sung Jae & Pinkse, Joris, 2009. "Efficient Semiparametric Seemingly Unrelated Quantile Regression Estimation," Econometric Theory, Cambridge University Press, vol. 25(5), pages 1392-1414, October.
    15. Fan, Yanqin & Li, Qi, 1996. "Consistent Model Specification Tests: Omitted Variables and Semiparametric Functional Forms," Econometrica, Econometric Society, vol. 64(4), pages 865-890, July.
    16. Yanqin Fan & Ruixuan Liu, 2015. "Symmetrized Multivariate k -NN Estimators," Econometric Reviews, Taylor & Francis Journals, vol. 34(6-10), pages 828-848, December.
    17. Bierens, Herman J, 1990. "A Consistent Conditional Moment Test of Functional Form," Econometrica, Econometric Society, vol. 58(6), pages 1443-1458, November.
    18. Gan, Li & Li, Qi, 2016. "Efficiency of thin and thick markets," Journal of Econometrics, Elsevier, vol. 192(1), pages 40-54.
    19. Fan, Yanqin & Li, Qi, 2000. "Consistent Model Specification Tests," Econometric Theory, Cambridge University Press, vol. 16(6), pages 1016-1041, December.
    20. Abadie, Alberto & Imbens, Guido W., 2011. "Bias-Corrected Matching Estimators for Average Treatment Effects," Journal of Business & Economic Statistics, American Statistical Association, vol. 29(1), pages 1-11.
    21. Guerre, Emmanuel & Lavergne, Pascal, 2002. "Optimal Minimax Rates For Nonparametric Specification Testing In Regression Models," Econometric Theory, Cambridge University Press, vol. 18(5), pages 1139-1171, October.
    22. P. Lavergne & Q.H. Vuong, 1996. "Nonparametric selection of regressors : the nonnested case [[Sélection non paramétrique de régresseurs : le cas de régressions non emboîtées]]," Post-Print hal-02689500, HAL.
    23. Liangjun Su & Yundong Tu & Aman Ullah, 2015. "Testing Additive Separability of Error Term in Nonparametric Structural Models," Econometric Reviews, Taylor & Francis Journals, vol. 34(6-10), pages 1057-1088, December.
    24. Horowitz, Joel L & Spokoiny, Vladimir G, 2001. "An Adaptive, Rate-Optimal Test of a Parametric Mean-Regression Model against a Nonparametric Alternative," Econometrica, Econometric Society, vol. 69(3), pages 599-631, May.
    25. Jun, Sung Jae & Pinkse, Joris, 2012. "Testing Under Weak Identification With Conditional Moment Restrictions," Econometric Theory, Cambridge University Press, vol. 28(6), pages 1229-1282, December.
    26. Lu, Xun & White, Halbert, 2014. "Testing for separability in structural equations," Journal of Econometrics, Elsevier, vol. 182(1), pages 14-26.
    27. Delgado, Miguel A., 1992. "Semiparametric Generalized Least Squares in the Multivariate Nonlinear Regression Model," Econometric Theory, Cambridge University Press, vol. 8(2), pages 203-222, June.
    28. Neumeyer, Natalie & Van Keilegom, Ingrid, 2010. "Estimating the error distribution in nonparametric multiple regression with applications to model testing," Journal of Multivariate Analysis, Elsevier, vol. 101(5), pages 1067-1078, May.
    29. Lavergne, Pascal & Vuong, Quang, 2000. "Nonparametric Significance Testing," Econometric Theory, Cambridge University Press, vol. 16(4), pages 576-601, August.
    30. Su, Liangjun & Lu, Xun, 2013. "Nonparametric dynamic panel data models: Kernel estimation and specification testing," Journal of Econometrics, Elsevier, vol. 176(2), pages 112-133.
    31. Hong, Yongmiao & White, Halbert, 1995. "Consistent Specification Testing via Nonparametric Series Regression," Econometrica, Econometric Society, vol. 63(5), pages 1133-1159, September.
    32. Gao, Jiti & King, Maxwell & Lu, Zudi & Tjøstheim, Dag, 2009. "Nonparametric Specification Testing For Nonlinear Time Series With Nonstationarity," Econometric Theory, Cambridge University Press, vol. 25(6), pages 1869-1892, December.
    33. Lewbel, Arthur, 1995. "Consistent nonparametric hypothesis tests with an application to Slutsky symmetry," Journal of Econometrics, Elsevier, vol. 67(2), pages 379-401, June.
    34. Hsiao, Cheng & Li, Qi & Racine, Jeffrey S., 2007. "A consistent model specification test with mixed discrete and continuous data," Journal of Econometrics, Elsevier, vol. 140(2), pages 802-826, October.
    35. Casas, Isabel & Gao, Jiti, 2008. "Econometric estimation in long-range dependent volatility models: Theory and practice," Journal of Econometrics, Elsevier, vol. 147(1), pages 72-83, November.
    36. Miguel A. Delgado & Thanasis Stengos, 1994. "Semiparametric Specification Testing of Non-nested Econometric Models," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 61(2), pages 291-303.
    37. Li, Q. & Wang, Suojin, 1998. "A simple consistent bootstrap test for a parametric regression function," Journal of Econometrics, Elsevier, vol. 87(1), pages 145-165, August.
    38. Bierens, Herman J., 1982. "Consistent model specification tests," Journal of Econometrics, Elsevier, vol. 20(1), pages 105-134, October.
    39. Lavergne, Pascal & Patilea, Valentin, 2008. "Breaking the curse of dimensionality in nonparametric testing," Journal of Econometrics, Elsevier, vol. 143(1), pages 103-122, March.
    40. Su, Liangjun & Jin, Sainan & Zhang, Yonghui, 2015. "Specification test for panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 186(1), pages 222-244.
    41. Wenceslao González-Manteiga & Rosa Crujeiras, 2013. "An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 361-411, September.
    42. Sun, Yun & Li, Qi, 2006. "An alternative series based consistent model specification test," Economics Letters, Elsevier, vol. 93(1), pages 37-44, October.
    43. Su, Liangjun & Ullah, Aman, 2013. "A Nonparametric Goodness-Of-Fit-Based Test For Conditional Heteroskedasticity," Econometric Theory, Cambridge University Press, vol. 29(1), pages 187-212, February.
    44. P. M. Robinson, 1991. "Consistent Nonparametric Entropy-Based Testing," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 58(3), pages 437-453.
    45. Li, Qi & Hsiao, Cheng & Zinn, Joel, 2003. "Consistent specification tests for semiparametric/nonparametric models based on series estimation methods," Journal of Econometrics, Elsevier, vol. 112(2), pages 295-325, February.
    46. Lewbel, Arthur & Lu, Xun & Su, Liangjun, 2015. "Specification testing for transformation models with an application to generalized accelerated failure-time models," Journal of Econometrics, Elsevier, vol. 184(1), pages 81-96.
    47. Jun, Sung Jae & Pinkse, Joris, 2009. "Semiparametric tests of conditional moment restrictions under weak or partial identification," Journal of Econometrics, Elsevier, vol. 152(1), pages 3-18, September.
    48. Horowitz, Joel L., 2012. "Specification testing in nonparametric instrumental variable estimation," Journal of Econometrics, Elsevier, vol. 167(2), pages 383-396.
    49. Breunig, Christoph, 2015. "Goodness-of-fit tests based on series estimators in nonparametric instrumental regression," Journal of Econometrics, Elsevier, vol. 184(2), pages 328-346.
    50. Chu, Ba & Jacho-Chávez, David T., 2012. "k-NEAREST NEIGHBOR ESTIMATION OF INVERSE-DENSITY-WEIGHTED EXPECTATIONS WITH DEPENDENT DATA," Econometric Theory, Cambridge University Press, vol. 28(4), pages 769-803, August.
    51. John Xu Zheng, 1996. "A consistent test of functional form via nonparametric estimation techniques," Journal of Econometrics, Elsevier, vol. 75(2), pages 263-289, December.
    52. Lin, Zhongjian & Li, Qi & Sun, Yiguo, 2014. "A consistent nonparametric test of parametric regression functional form in fixed effects panel data models," Journal of Econometrics, Elsevier, vol. 178(P1), pages 167-179.
    53. Li, Dong & Li, Qi, 2010. "Nonparametric/semiparametric estimation and testing of econometric models with data dependent smoothing parameters," Journal of Econometrics, Elsevier, vol. 157(1), pages 179-190, July.
    54. James J. Heckman & Hidehiko Ichimura & Petra Todd, 1998. "Matching As An Econometric Evaluation Estimator," The Review of Economic Studies, Review of Economic Studies Ltd, vol. 65(2), pages 261-294.
    55. David Jacho-Chávez, 2008. "k nearest-neighbor estimation of inverse density weighted expectations," Economics Bulletin, AccessEcon, vol. 3(48), pages 1-6.
    56. Alberto Abadie & Guido W. Imbens, 2006. "Large Sample Properties of Matching Estimators for Average Treatment Effects," Econometrica, Econometric Society, vol. 74(1), pages 235-267, January.
    57. Yatchew, Adonis John, 1992. "Nonparametric Regression Tests Based on Least Squares," Econometric Theory, Cambridge University Press, vol. 8(4), pages 435-451, December.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Kohtaro Hitomi & Masamune Iwasawa & Yoshihiko Nishiyama, 2023. "Optimal minimax rates of specification testing with data-driven bandwidth," Econometric Reviews, Taylor & Francis Journals, vol. 42(6), pages 487-512, June.
    2. Wang, Wenju & Wang, Qiao, 2019. "Consistent specification test for partially linear models with the k-nearest-neighbor method," Economics Letters, Elsevier, vol. 177(C), pages 89-93.
    3. Kohtaro Hitomi & Masamune Iwasawa & Yoshihiko Nishiyama, 2018. "Rate Optimal Specification Test When the Number of Instruments is Large," KIER Working Papers 986, Kyoto University, Institute of Economic Research.
    4. Nengxiang Ling & Germán Aneiros & Philippe Vieu, 2020. "kNN estimation in functional partial linear modeling," Statistical Papers, Springer, vol. 61(1), pages 423-444, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Qi Li & Jeffrey Scott Racine, 2006. "Nonparametric Econometrics: Theory and Practice," Economics Books, Princeton University Press, edition 1, volume 1, number 8355.
    2. Yanqin Fan & Qi Li, 2002. "A Consistent Model Specification Test Based On The Kernel Sum Of Squares Of Residuals," Econometric Reviews, Taylor & Francis Journals, vol. 21(3), pages 337-352.
    3. Masamune Iwasawa, 2015. "A Joint Specification Test for Response Probabilities in Unordered Multinomial Choice Models," Econometrics, MDPI, vol. 3(3), pages 1-31, September.
    4. Li, Qi & Hsiao, Cheng & Zinn, Joel, 2003. "Consistent specification tests for semiparametric/nonparametric models based on series estimation methods," Journal of Econometrics, Elsevier, vol. 112(2), pages 295-325, February.
    5. Li, Qi, 1999. "Consistent model specification tests for time series econometric models," Journal of Econometrics, Elsevier, vol. 92(1), pages 101-147, September.
    6. Su, Liangjun & Jin, Sainan & Zhang, Yonghui, 2015. "Specification test for panel data models with interactive fixed effects," Journal of Econometrics, Elsevier, vol. 186(1), pages 222-244.
    7. Li, Q. & Wang, Suojin, 1998. "A simple consistent bootstrap test for a parametric regression function," Journal of Econometrics, Elsevier, vol. 87(1), pages 145-165, August.
    8. Hsiao, Cheng & Li, Qi & Racine, Jeffrey S., 2007. "A consistent model specification test with mixed discrete and continuous data," Journal of Econometrics, Elsevier, vol. 140(2), pages 802-826, October.
    9. Gao, Jiti, 2007. "Nonlinear time series: semiparametric and nonparametric methods," MPRA Paper 39563, University Library of Munich, Germany, revised 01 Sep 2007.
    10. Wenceslao González-Manteiga & Rosa Crujeiras, 2013. "An updated review of Goodness-of-Fit tests for regression models," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 22(3), pages 361-411, September.
    11. Lavergne, Pascal & Patilea, Valentin, 2008. "Breaking the curse of dimensionality in nonparametric testing," Journal of Econometrics, Elsevier, vol. 143(1), pages 103-122, March.
    12. Ait-Sahalia, Yacine & Bickel, Peter J. & Stoker, Thomas M., 2001. "Goodness-of-fit tests for kernel regression with an application to option implied volatilities," Journal of Econometrics, Elsevier, vol. 105(2), pages 363-412, December.
    13. Hall, Peter & Yatchew, Adonis, 2005. "Unified approach to testing functional hypotheses in semiparametric contexts," Journal of Econometrics, Elsevier, vol. 127(2), pages 225-252, August.
    14. Chen, Xiaohong, 2007. "Large Sample Sieve Estimation of Semi-Nonparametric Models," Handbook of Econometrics, in: J.J. Heckman & E.E. Leamer (ed.), Handbook of Econometrics, edition 1, volume 6, chapter 76, Elsevier.
    15. Gao, Jiti & King, Maxwell, 2003. "Estimation and model specification testing in nonparametric and semiparametric econometric models," MPRA Paper 11989, University Library of Munich, Germany, revised Feb 2006.
    16. Liangjun Su & Yundong Tu & Aman Ullah, 2015. "Testing Additive Separability of Error Term in Nonparametric Structural Models," Econometric Reviews, Taylor & Francis Journals, vol. 34(6-10), pages 1057-1088, December.
    17. Whang, Yoon-Jae, 2001. "Consistent specification testing for conditional moment restrictions," Economics Letters, Elsevier, vol. 71(3), pages 299-306, June.
    18. Wang, Luya, 2022. "Adaptive testing using data-driven method selecting smoothing parameters," Economics Letters, Elsevier, vol. 215(C).
    19. Juan Carlos Escanciano, 2004. "Model Checks Using Residual Marked Empirical Processes," Faculty Working Papers 13/04, School of Economics and Business Administration, University of Navarra.
    20. Horowitz, Joel L. & Spokoiny, Vladimir G., 1999. "An Adaptive, Rate-Optimal Test of a Parametric Model Against a Nonparametric Alternative," Working Papers 99-02, University of Iowa, Department of Economics.

    More about this item

    Keywords

    k-nearest-neighbor method; Consistent test; Bootstrap; Empirical application;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:econom:v:194:y:2016:i:1:p:187-202. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/jeconom .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.