IDEAS home Printed from https://ideas.repec.org/p/tin/wpaper/20060058.html
   My bibliography  Save this paper

Semiparametric Regression with Kernel Error Model

Author

Listed:
  • Ao Yuan

    (Howard University)

  • Jan G. De Gooijer

    (Faculty of Economics and Econometrics, Universiteit van Amsterdam)

Abstract

We propose and study a class of regression models, in which the mean function is specified parametrically as in the existing regression methods, but the residual distribution is modeled nonparametrically by a kernel estimator, without imposing any assumption on its distribution. This specification is different from the existing semiparametric regression models. The asymptotic properties of such likelihood and the maximum likelihood estimate (MLE) under this semiparametric model are studied. We show that under some regularity conditions, the MLE under this model is consistent (as compared to the possibly pseudo consistency of the parameter estimation under the existing parametric regression model), and is asymptotically normal with rate sqrt{n} and efficient. The nonparametric pseudo-likelihood ratio has the Wilks property as the true likelihood ratio does. Simulated examples are presented to evaluate the accuracy of the proposed semiparametric MLE method.

Suggested Citation

  • Ao Yuan & Jan G. De Gooijer, 2006. "Semiparametric Regression with Kernel Error Model," Tinbergen Institute Discussion Papers 06-058/4, Tinbergen Institute.
    • Handle: RePEc:tin:wpaper:20060058
    as

    Download full text from publisher

    File URL: https://papers.tinbergen.nl/06058.pdf
    Download Restriction: no
    ---><---

    Other versions of this item:

    References listed on IDEAS

    as
    1. Newey, Whitney K., 1988. "Adaptive estimation of regression models via moment restrictions," Journal of Econometrics, Elsevier, vol. 38(3), pages 301-339, July.
    2. Peter Hall & Sally Morton, 1993. "On the estimation of entropy," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 45(1), pages 69-88, March.
    3. McDonald, James B. & Newey, Whitney K., 1988. "Partially Adaptive Estimation of Regression Models via the Generalized T Distribution," Econometric Theory, Cambridge University Press, vol. 4(3), pages 428-457, December.
    4. Andrews, Donald W K, 1994. "Asymptotics for Semiparametric Econometric Models via Stochastic Equicontinuity," Econometrica, Econometric Society, vol. 62(1), pages 43-72, January.
    5. Harry Joe, 1989. "Estimation of entropy and other functionals of a multivariate density," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 41(4), pages 683-697, December.
    6. J. Pfanzagl, 1969. "On the measurability and consistency of minimum contrast estimates," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 14(1), pages 249-272, December.
    7. Hall, Peter, 1986. "On powerful distributional tests based on sample spacings," Journal of Multivariate Analysis, Elsevier, vol. 19(2), pages 201-224, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xibin Zhang & Maxwell L. King, 2011. "Bayesian semiparametric GARCH models," Monash Econometrics and Business Statistics Working Papers 24/11, Monash University, Department of Econometrics and Business Statistics.
    2. Xibin Zhang & Maxwell L. King, 2013. "Gaussian kernel GARCH models," Monash Econometrics and Business Statistics Working Papers 19/13, Monash University, Department of Econometrics and Business Statistics.
    3. Wang, Qin & Yao, Weixin, 2012. "An adaptive estimation of MAVE," Journal of Multivariate Analysis, Elsevier, vol. 104(1), pages 88-100, February.
    4. Yao, Weixin, 2013. "A note on EM algorithm for mixture models," Statistics & Probability Letters, Elsevier, vol. 83(2), pages 519-526.
    5. Xibin Zhang & Maxwell L. King & Han Lin Shang, 2016. "Bayesian Bandwidth Selection for a Nonparametric Regression Model with Mixed Types of Regressors," Econometrics, MDPI, vol. 4(2), pages 1-27, April.
    6. Zhang, Xibin & King, Maxwell L. & Shang, Han Lin, 2014. "A sampling algorithm for bandwidth estimation in a nonparametric regression model with a flexible error density," Computational Statistics & Data Analysis, Elsevier, vol. 78(C), pages 218-234.
    7. McCloud, Nadine & Parmeter, Christopher F., 2020. "Determining the Number of Effective Parameters in Kernel Density Estimation," Computational Statistics & Data Analysis, Elsevier, vol. 143(C).
    8. Xibin Zhang & Maxwell L. King & Han Lin Shang, 2011. "Bayesian estimation of bandwidths for a nonparametric regression model with a flexible error density," Monash Econometrics and Business Statistics Working Papers 10/11, Monash University, Department of Econometrics and Business Statistics.
    9. Guohua Feng & Chuan Wang & Xibin Zhang, 2019. "Estimation of inefficiency in stochastic frontier models: a Bayesian kernel approach," Journal of Productivity Analysis, Springer, vol. 51(1), pages 1-19, February.
    10. Chen, Yixin & Wang, Qin & Yao, Weixin, 2015. "Adaptive estimation for varying coefficient models," Journal of Multivariate Analysis, Elsevier, vol. 137(C), pages 17-31.
    11. Jan G. De Gooijer & Ao Yuan, 2008. "MDL Mean Function Selection in Semiparametric Kernel Regression Models," Tinbergen Institute Discussion Papers 08-046/4, Tinbergen Institute.
    12. Zhang, Jun & Lin, Bingqing & Zhou, Yan, 2021. "Kernel density estimation for partial linear multivariate responses models," Journal of Multivariate Analysis, Elsevier, vol. 185(C).
    13. Chee, Chew-Seng & Seo, Byungtae, 2020. "Semiparametric estimation for linear regression with symmetric errors," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    14. De Gooijer, Jan G. & Reichardt, Hugo, 2021. "A multi-step kernel–based regression estimator that adapts to error distributions of unknown form," LSE Research Online Documents on Economics 115083, London School of Economics and Political Science, LSE Library.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ao Yuan, 2009. "Semiparametric inference with kernel likelihood," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 21(2), pages 207-228.
    2. Gupta, A, 2015. "Nonparametric specification testing via the trinity of tests," Economics Discussion Papers 15619, University of Essex, Department of Economics.
    3. Jan G. De Gooijer & Ao Yuan, 2008. "MDL Mean Function Selection in Semiparametric Kernel Regression Models," Tinbergen Institute Discussion Papers 08-046/4, Tinbergen Institute.
    4. Gupta, Abhimanyu, 2018. "Nonparametric specification testing via the trinity of tests," Journal of Econometrics, Elsevier, vol. 203(1), pages 169-185.
    5. repec:esx:essedp:774 is not listed on IDEAS
    6. Fong, Wai Mun, 1997. "Robust beta estimation: Some empirical evidence," Review of Financial Economics, Elsevier, vol. 6(2), pages 167-186.
    7. Masayuki Hirukawa & Mari Sakudo, 2016. "Testing Symmetry of Unknown Densities via Smoothing with the Generalized Gamma Kernels," Econometrics, MDPI, vol. 4(2), pages 1-27, June.
    8. Marcelo Fernandes & Eduardo Mendes & Olivier Scaillet, 2015. "Testing for symmetry and conditional symmetry using asymmetric kernels," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 67(4), pages 649-671, August.
    9. Haoying Wang, 2018. "Pricing used books on Amazon.com: a spatial approach to price dispersion," Spatial Economic Analysis, Taylor & Francis Journals, vol. 13(1), pages 99-117, January.
    10. Yiguo Sun & Thanasis Stengos, 2008. "The absolute health income hypothesis revisited: a semiparametric quantile regression approach," Empirical Economics, Springer, vol. 35(2), pages 395-412, September.
    11. Ximing Wu & Thanasis Stengos, 2005. "Partially adaptive estimation via the maximum entropy densities," Econometrics Journal, Royal Economic Society, vol. 8(3), pages 352-366, December.
    12. Arslan, Olcay, 2004. "Family of multivariate generalized t distributions," Journal of Multivariate Analysis, Elsevier, vol. 89(2), pages 329-337, May.
    13. Ashis K. Gangopadhyay & Robert disario & Dipak K. Dey, 1997. "A nonparametric approach to k-sample inference based on entropy-super-," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 8(3), pages 237-252, September.
    14. McDonald, James B. & Xu, Yexiao J., 1995. "A generalization of the beta distribution with applications," Journal of Econometrics, Elsevier, vol. 69(2), pages 427-428, October.
    15. Kenneth West & Ka-fu Wong & Stanislav Anatolyev, 2009. "Instrumental Variables Estimation of Heteroskedastic Linear Models Using All Lags of Instruments," Econometric Reviews, Taylor & Francis Journals, vol. 28(5), pages 441-467.
    16. Kojadinovic, Ivan, 2005. "Relevance measures for subset variable selection in regression problems based on k-additive mutual information," Computational Statistics & Data Analysis, Elsevier, vol. 49(4), pages 1205-1227, June.
    17. Hino, Hideitsu & Koshijima, Kensuke & Murata, Noboru, 2015. "Non-parametric entropy estimators based on simple linear regression," Computational Statistics & Data Analysis, Elsevier, vol. 89(C), pages 72-84.
    18. Hansen, James V. & McDonald, James B. & Turley, Robert S., 2006. "Partially adaptive robust estimation of regression models and applications," European Journal of Operational Research, Elsevier, vol. 170(1), pages 132-143, April.
    19. James S. Allison & Charl Pretorius, 2017. "A Monte Carlo evaluation of the performance of two new tests for symmetry," Computational Statistics, Springer, vol. 32(4), pages 1323-1338, December.
    20. Peter M Robinson, 2007. "Efficient Estimation of the SemiparametricSpatial Autoregressive Model," STICERD - Econometrics Paper Series 515, Suntory and Toyota International Centres for Economics and Related Disciplines, LSE.
    21. James Mcdonald & Richard Michelfelder & Panayiotis Theodossiou, 2010. "Robust estimation with flexible parametric distributions: estimation of utility stock betas," Quantitative Finance, Taylor & Francis Journals, vol. 10(4), pages 375-387.

    More about this item

    Keywords

    information bound; kernel density estimator; maximum likelihood estimate; nonlinear regression; semiparametric model; U-statistic; Wilks property;
    All these keywords.

    JEL classification:

    • C14 - Mathematical and Quantitative Methods - - Econometric and Statistical Methods and Methodology: General - - - Semiparametric and Nonparametric Methods: General

    NEP fields

    This paper has been announced in the following NEP Reports:

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:tin:wpaper:20060058. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Tinbergen Office +31 (0)10-4088900 (email available below). General contact details of provider: https://edirc.repec.org/data/tinbenl.html .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.