IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v137y2015icp17-31.html
   My bibliography  Save this article

Adaptive estimation for varying coefficient models

Author

Listed:
  • Chen, Yixin
  • Wang, Qin
  • Yao, Weixin

Abstract

In this article, a novel adaptive estimation is proposed for varying coefficient models. Unlike the traditional least squares based methods, the proposed approach can adapt to different error distributions. An efficient EM algorithm is provided to implement the proposed estimation. The asymptotic properties of the resulting estimator are established. Both simulation studies and real data examples are used to illustrate the finite sample performance of the new estimation procedure. The numerical results show that the gain of the new procedure over the least squares estimation can be quite substantial for non-Gaussian errors.

Suggested Citation

  • Chen, Yixin & Wang, Qin & Yao, Weixin, 2015. "Adaptive estimation for varying coefficient models," Journal of Multivariate Analysis, Elsevier, vol. 137(C), pages 17-31.
    • Handle: RePEc:eee:jmvana:v:137:y:2015:i:c:p:17-31
    DOI: 10.1016/j.jmva.2015.01.017
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X15000305
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2015.01.017?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Linton, Oliver & Xiao, Zhijie, 2007. "A Nonparametric Regression Estimator That Adapts To Error Distribution Of Unknown Form," Econometric Theory, Cambridge University Press, vol. 23(3), pages 371-413, June.
    2. Drost, Feike C. & Klaassen, Chris A. J., 1997. "Efficient estimation in semiparametric GARCH models," Journal of Econometrics, Elsevier, vol. 81(1), pages 193-221, November.
    3. Wang, Hansheng & Xia, Yingcun, 2009. "Shrinkage Estimation of the Varying Coefficient Model," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 747-757.
    4. Zhang, Wenyang & Lee, Sik-Yum, 2000. "Variable Bandwidth Selection in Varying-Coefficient Models," Journal of Multivariate Analysis, Elsevier, vol. 74(1), pages 116-134, July.
    5. Chiang C-T. & Rice J. A & Wu C. O, 2001. "Smoothing Spline Estimation for Varying Coefficient Models With Repeatedly Measured Dependent Variables," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 605-619, June.
    6. Jianhua Z. Huang & Haipeng Shen, 2004. "Functional Coefficient Regression Models for Non‐linear Time Series: A Polynomial Spline Approach," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 31(4), pages 515-534, December.
    7. Yingcun Xia & Howell Tong & W. K. Li & Li‐Xing Zhu, 2002. "An adaptive estimation of dimension reduction space," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 64(3), pages 363-410, August.
    8. Gilley, Otis W. & Pace, R. Kelley, 1996. "On the Harrison and Rubinfeld Data," Journal of Environmental Economics and Management, Elsevier, vol. 31(3), pages 403-405, November.
    9. Yao, Weixin, 2013. "A note on EM algorithm for mixture models," Statistics & Probability Letters, Elsevier, vol. 83(2), pages 519-526.
    10. Jianhua Z. Huang, 2002. "Varying-coefficient models and basis function approximations for the analysis of repeated measurements," Biometrika, Biometrika Trust, vol. 89(1), pages 111-128, March.
    11. Wang, Qin & Yao, Weixin, 2012. "An adaptive estimation of MAVE," Journal of Multivariate Analysis, Elsevier, vol. 104(1), pages 88-100, February.
    12. Ao Yuan, 2009. "Semiparametric inference with kernel likelihood," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 21(2), pages 207-228.
    13. Hodgson, Douglas J., 1998. "Adaptive estimation of cointegrating regressions with ARMA errors," Journal of Econometrics, Elsevier, vol. 85(2), pages 231-267, August.
    14. Steigerwald, Douglas G., 1992. "Adaptive estimation in time series regression models," Journal of Econometrics, Elsevier, vol. 54(1-3), pages 251-275.
    15. Ao Yuan & Jan G. De Gooijer, 2007. "Semiparametric Regression with Kernel Error Model," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 34(4), pages 841-869, December.
    16. Wang, Lan & Kai, Bo & Li, Runze, 2009. "Local Rank Inference for Varying Coefficient Models," Journal of the American Statistical Association, American Statistical Association, vol. 104(488), pages 1631-1645.
    17. R. L. Eubank & Chunfeng Huang & Y. Muñoz Maldonado & Naisyin Wang & Suojin Wang & R. J. Buchanan, 2004. "Smoothing spline estimation in varying‐coefficient models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 653-667, August.
    18. J. Fan & M. Farmen & I. Gijbels, 1998. "Local maximum likelihood estimation and inference," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(3), pages 591-608.
    19. J. Fan & J.‐T. Zhang, 2000. "Two‐step estimation of functional linear models with applications to longitudinal data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(2), pages 303-322.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Jing & Wang, Qin & Mays, D'Arcy, 2021. "Robust MAVE through nonconvex penalized regression," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).
    2. Linton, Oliver & Xiao, Zhijie, 2019. "Efficient estimation of nonparametric regression in the presence of dynamic heteroskedasticity," Journal of Econometrics, Elsevier, vol. 213(2), pages 608-631.
    3. Fang Lu & Jing Yang & Xuewen Lu, 2022. "One-step oracle procedure for semi-parametric spatial autoregressive model and its empirical application to Boston housing price data," Empirical Economics, Springer, vol. 62(6), pages 2645-2671, June.
    4. De Gooijer, Jan G. & Reichardt, Hugo, 2021. "A multi-step kernel–based regression estimator that adapts to error distributions of unknown form," LSE Research Online Documents on Economics 115083, London School of Economics and Political Science, LSE Library.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Qin & Yao, Weixin, 2012. "An adaptive estimation of MAVE," Journal of Multivariate Analysis, Elsevier, vol. 104(1), pages 88-100, February.
    2. Lian, Heng, 2015. "Quantile regression for dynamic partially linear varying coefficient time series models," Journal of Multivariate Analysis, Elsevier, vol. 141(C), pages 49-66.
    3. Tang Qingguo & Cheng Longsheng, 2008. "M-estimation and B-spline approximation for varying coefficient models with longitudinal data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 20(7), pages 611-625.
    4. Qiu, Jia & Li, Degao & You, Jinhong, 2015. "SCAD-penalized regression for varying-coefficient models with autoregressive errors," Journal of Multivariate Analysis, Elsevier, vol. 137(C), pages 100-118.
    5. Jun Jin & Tiefeng Ma & Jiajia Dai, 2021. "New efficient spline estimation for varying-coefficient models with two-step knot number selection," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(5), pages 693-712, July.
    6. Long Feng & Changliang Zou & Zhaojun Wang & Xianwu Wei & Bin Chen, 2015. "Robust spline-based variable selection in varying coefficient model," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 78(1), pages 85-118, January.
    7. Kong, Dehan & Bondell, Howard D. & Wu, Yichao, 2015. "Domain selection for the varying coefficient model via local polynomial regression," Computational Statistics & Data Analysis, Elsevier, vol. 83(C), pages 236-250.
    8. Zhaoping Hong & Yuao Hu & Heng Lian, 2013. "Variable selection for high-dimensional varying coefficient partially linear models via nonconcave penalty," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 76(7), pages 887-908, October.
    9. Byeong U. Park & Enno Mammen & Young K. Lee & Eun Ryung Lee, 2015. "Varying Coefficient Regression Models: A Review and New Developments," International Statistical Review, International Statistical Institute, vol. 83(1), pages 36-64, April.
    10. Linton, Oliver & Xiao, Zhijie, 2019. "Efficient estimation of nonparametric regression in the presence of dynamic heteroskedasticity," Journal of Econometrics, Elsevier, vol. 213(2), pages 608-631.
    11. Olga Klopp & Marianna Pensky, 2013. "Sparse High-dimensional Varying Coefficient Model : Non-asymptotic Minimax Study," Working Papers 2013-30, Center for Research in Economics and Statistics.
    12. Tang Qingguo & Cheng Longsheng, 2012. "Componentwise B-spline estimation for varying coefficient models with longitudinal data," Statistical Papers, Springer, vol. 53(3), pages 629-652, August.
    13. Tang, Yanlin & Wang, Huixia Judy & Zhu, Zhongyi, 2013. "Variable selection in quantile varying coefficient models with longitudinal data," Computational Statistics & Data Analysis, Elsevier, vol. 57(1), pages 435-449.
    14. Ye, Mao & Lu, Zhao-Hua & Li, Yimei & Song, Xinyuan, 2019. "Finite mixture of varying coefficient model: Estimation and component selection," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 452-474.
    15. Wang, Qihua & Zhang, Riquan, 2009. "Statistical estimation in varying coefficient models with surrogate data and validation sampling," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2389-2405, November.
    16. Zhang, Wenyang & Li, Degui & Xia, Yingcun, 2015. "Estimation in generalised varying-coefficient models with unspecified link functions," Journal of Econometrics, Elsevier, vol. 187(1), pages 238-255.
    17. Senturk, Damla & Nguyen, Danh V., 2006. "Estimation in covariate-adjusted regression," Computational Statistics & Data Analysis, Elsevier, vol. 50(11), pages 3294-3310, July.
    18. Yiqiang Lu & Riquan Zhang, 2009. "Smoothing spline estimation of generalised varying-coefficient mixed model," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 21(7), pages 815-825.
    19. Liu, Hefei & Song, Xinyuan & Zhang, Baoxue, 2022. "Varying-coefficient hidden Markov models with zero-effect regions," Computational Statistics & Data Analysis, Elsevier, vol. 173(C).
    20. De Gooijer, Jan G. & Reichardt, Hugo, 2021. "A multi-step kernel–based regression estimator that adapts to error distributions of unknown form," LSE Research Online Documents on Economics 115083, London School of Economics and Political Science, LSE Library.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:137:y:2015:i:c:p:17-31. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.