IDEAS home Printed from https://ideas.repec.org/a/spr/aistmt/v66y2014i1p165-191.html
   My bibliography  Save this article

Robust and efficient variable selection for semiparametric partially linear varying coefficient model based on modal regression

Author

Listed:
  • Weihua Zhao
  • Riquan Zhang
  • Jicai Liu
  • Yazhao Lv

Abstract

Semiparametric partially linear varying coefficient models (SPLVCM) are frequently used in statistical modeling. With high-dimensional covariates both in parametric and nonparametric part for SPLVCM, sparse modeling is often considered in practice. In this paper, we propose a new estimation and variable selection procedure based on modal regression, where the nonparametric functions are approximated by $$B$$ B -spline basis. The outstanding merit of the proposed variable selection procedure is that it can achieve both robustness and efficiency by introducing an additional tuning parameter (i.e., bandwidth $$h$$ h ). Its oracle property is also established for both the parametric and nonparametric part. Moreover, we give the data-driven bandwidth selection method and propose an EM-type algorithm for the proposed method. Monte Carlo simulation study and real data example are conducted to examine the finite sample performance of the proposed method. Both the simulation results and real data analysis confirm that the newly proposed method works very well. Copyright The Institute of Statistical Mathematics, Tokyo 2014

Suggested Citation

  • Weihua Zhao & Riquan Zhang & Jicai Liu & Yazhao Lv, 2014. "Robust and efficient variable selection for semiparametric partially linear varying coefficient model based on modal regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(1), pages 165-191, February.
    • Handle: RePEc:spr:aistmt:v:66:y:2014:i:1:p:165-191
    DOI: 10.1007/s10463-013-0410-4
    as

    Download full text from publisher

    File URL: http://hdl.handle.net/10.1007/s10463-013-0410-4
    Download Restriction: Access to full text is restricted to subscribers.
    File URL: https://libkey.io/10.1007/s10463-013-0410-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lee, Myoung-jae, 1989. "Mode regression," Journal of Econometrics, Elsevier, vol. 42(3), pages 337-349, November.
    2. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    3. Wang, Lifeng & Li, Hongzhe & Huang, Jianhua Z., 2008. "Variable Selection in Nonparametric Varying-Coefficient Models for Analysis of Repeated Measurements," Journal of the American Statistical Association, American Statistical Association, vol. 103(484), pages 1556-1569.
    4. Zhao, Peixin & Xue, Liugen, 2009. "Variable selection for semiparametric varying coefficient partially linear models," Statistics & Probability Letters, Elsevier, vol. 79(20), pages 2148-2157, October.
    5. Weixin Yao & Bruce Lindsay & Runze Li, 2012. "Local modal regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(3), pages 647-663.
    6. Jianqing Fan & Wenyang Zhang, 2000. "Simultaneous Confidence Bands and Hypothesis Testing in Varying‐coefficient Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 27(4), pages 715-731, December.
    7. Zhang, Wenyang & Lee, Sik-Yum & Song, Xinyuan, 2002. "Local Polynomial Fitting in Semivarying Coefficient Model," Journal of Multivariate Analysis, Elsevier, vol. 82(1), pages 166-188, July.
    8. Li, Jialiang & Zhang, Wenyang, 2011. "A Semiparametric Threshold Model for Censored Longitudinal Data Analysis," Journal of the American Statistical Association, American Statistical Association, vol. 106(494), pages 685-696.
    9. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    10. Cai, Zongwu & Xiao, Zhijie, 2012. "Semiparametric quantile regression estimation in dynamic models with partially varying coefficients," Journal of Econometrics, Elsevier, vol. 167(2), pages 413-425.
    11. Li, Qi, et al, 2002. "Semiparametric Smooth Coefficient Models," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(3), pages 412-422, July.
    12. Lam, Clifford & Fan, Jianqing, 2008. "Profile-kernel likelihood inference with diverging number of parameters," LSE Research Online Documents on Economics 31548, London School of Economics and Political Science, LSE Library.
    13. Yingcun Xia, 2004. "Efficient estimation for semivarying-coefficient models," Biometrika, Biometrika Trust, vol. 91(3), pages 661-681, September.
    14. Cheng, Ming-Yen & Zhang, Wenyang & Chen, Lu-Hung, 2009. "Statistical Estimation in Generalized Multiparameter Likelihood Models," Journal of the American Statistical Association, American Statistical Association, vol. 104(487), pages 1179-1191.
    15. Jianhua Z. Huang, 2002. "Varying-coefficient models and basis function approximations for the analysis of repeated measurements," Biometrika, Biometrika Trust, vol. 89(1), pages 111-128, March.
    16. Hui Zou & Trevor Hastie, 2005. "Addendum: Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(5), pages 768-768, November.
    17. Hui Zou & Trevor Hastie, 2005. "Regularization and variable selection via the elastic net," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(2), pages 301-320, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Xuejun Ma & Yue Du & Jingli Wang, 2022. "Model detection and variable selection for mode varying coefficient model," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(2), pages 321-341, June.
    2. Kangning Wang & Lu Lin, 2019. "Robust and efficient estimator for simultaneous model structure identification and variable selection in generalized partial linear varying coefficient models with longitudinal data," Statistical Papers, Springer, vol. 60(5), pages 1649-1676, October.
    3. Qingyang Liu & Xianzheng Huang & Haiming Zhou, 2024. "The Flexible Gumbel Distribution: A New Model for Inference about the Mode," Stats, MDPI, vol. 7(1), pages 1-16, March.
    4. Zhaoliang Wang & Liugen Xue & Gaorong Li & Fei Lu, 2019. "Spline estimator for ultra-high dimensional partially linear varying coefficient models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(3), pages 657-677, June.
    5. Wang, Kangning & Li, Shaomin & Sun, Xiaofei & Lin, Lu, 2019. "Modal regression statistical inference for longitudinal data semivarying coefficient models: Generalized estimating equations, empirical likelihood and variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 257-276.
    6. Wang, Kangning & Li, Shaomin, 2021. "Robust distributed modal regression for massive data," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).
    7. Lv, Zhike & Zhu, Huiming & Yu, Keming, 2014. "Robust variable selection for nonlinear models with diverging number of parameters," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 90-97.
    8. Li, Yujie & Li, Gaorong & Lian, Heng & Tong, Tiejun, 2017. "Profile forward regression screening for ultra-high dimensional semiparametric varying coefficient partially linear models," Journal of Multivariate Analysis, Elsevier, vol. 155(C), pages 133-150.
    9. Yang, Jing & Tian, Guoliang & Lu, Fang & Lu, Xuewen, 2020. "Single-index modal regression via outer product gradients," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    10. Ullah, Aman & Wang, Tao & Yao, Weixin, 2023. "Semiparametric partially linear varying coefficient modal regression," Journal of Econometrics, Elsevier, vol. 235(2), pages 1001-1026.
    11. Kangning Wang & Xiaofei Sun, 2020. "Efficient parameter estimation and variable selection in partial linear varying coefficient quantile regression model with longitudinal data," Statistical Papers, Springer, vol. 61(3), pages 967-995, June.
    12. Shaomin Li & Kangning Wang & Yong Xu, 2023. "Robust estimation for nonrandomly distributed data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(3), pages 493-509, June.
    13. Jie Zeng & Weihu Cheng & Guozhi Hu, 2023. "Optimal Model Averaging Estimation for the Varying-Coefficient Partially Linear Models with Missing Responses," Mathematics, MDPI, vol. 11(8), pages 1-21, April.
    14. Kangning Wang, 2018. "Variable selection for spatial semivarying coefficient models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(2), pages 323-351, April.
    15. Hu Yang & Ning Li & Jing Yang, 2020. "A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates," Statistical Papers, Springer, vol. 61(5), pages 1911-1937, October.
    16. Yang, Jing & Yang, Hu, 2016. "A robust penalized estimation for identification in semiparametric additive models," Statistics & Probability Letters, Elsevier, vol. 110(C), pages 268-277.
    17. Mingqiu Wang & Peixin Zhao & Xiaoning Kang, 2020. "Structure identification for varying coefficient models with measurement errors based on kernel smoothing," Statistical Papers, Springer, vol. 61(5), pages 1841-1857, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Zhao, Weihua & Zhang, Riquan & Liu, Jicai & Hu, Hongchang, 2015. "Robust adaptive estimation for semivarying coefficient models," Statistics & Probability Letters, Elsevier, vol. 97(C), pages 132-141.
    2. Zhang, Ting, 2015. "Semiparametric model building for regression models with time-varying parameters," Journal of Econometrics, Elsevier, vol. 187(1), pages 189-200.
    3. Hidetoshi Matsui & Toshihiro Misumi, 2015. "Variable selection for varying-coefficient models with the sparse regularization," Computational Statistics, Springer, vol. 30(1), pages 43-55, March.
    4. Zhao, Peixin & Xue, Liugen, 2010. "Variable selection for semiparametric varying coefficient partially linear errors-in-variables models," Journal of Multivariate Analysis, Elsevier, vol. 101(8), pages 1872-1883, September.
    5. Zhao, Weihua & Jiang, Xuejun & Lian, Heng, 2018. "A principal varying-coefficient model for quantile regression: Joint variable selection and dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 127(C), pages 269-280.
    6. Xue-Jun Ma & Jing-Xiao Zhang, 2016. "A new variable selection approach for varying coefficient models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 79(1), pages 59-72, January.
    7. Byeong U. Park & Enno Mammen & Young K. Lee & Eun Ryung Lee, 2015. "Varying Coefficient Regression Models: A Review and New Developments," International Statistical Review, International Statistical Institute, vol. 83(1), pages 36-64, April.
    8. Zhao, Weihua & Lian, Heng, 2017. "Quantile index coefficient model with variable selection," Journal of Multivariate Analysis, Elsevier, vol. 154(C), pages 40-58.
    9. Tian, Ruiqin & Xue, Liugen & Liu, Chunling, 2014. "Penalized quadratic inference functions for semiparametric varying coefficient partially linear models with longitudinal data," Journal of Multivariate Analysis, Elsevier, vol. 132(C), pages 94-110.
    10. Li, Yujie & Li, Gaorong & Lian, Heng & Tong, Tiejun, 2017. "Profile forward regression screening for ultra-high dimensional semiparametric varying coefficient partially linear models," Journal of Multivariate Analysis, Elsevier, vol. 155(C), pages 133-150.
    11. Zhang, Wenyang & Li, Degui & Xia, Yingcun, 2015. "Estimation in generalised varying-coefficient models with unspecified link functions," Journal of Econometrics, Elsevier, vol. 187(1), pages 238-255.
    12. Lian, Heng, 2012. "Shrinkage estimation for identification of linear components in additive models," Statistics & Probability Letters, Elsevier, vol. 82(2), pages 225-231.
    13. Heng Lian & Xin Chen & Jian-Yi Yang, 2012. "Identification of Partially Linear Structure in Additive Models with an Application to Gene Expression Prediction from Sequences," Biometrics, The International Biometric Society, vol. 68(2), pages 437-445, June.
    14. Jun Jin & Tiefeng Ma & Jiajia Dai, 2021. "New efficient spline estimation for varying-coefficient models with two-step knot number selection," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(5), pages 693-712, July.
    15. Yanfang Zhang & Chuanhua Wei & Xiaolin Liu, 2022. "Group Logistic Regression Models with l p,q Regularization," Mathematics, MDPI, vol. 10(13), pages 1-15, June.
    16. Weihua Zhao & Weiping Zhang & Heng Lian, 2020. "Marginal quantile regression for varying coefficient models with longitudinal data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(1), pages 213-234, February.
    17. Long Feng & Changliang Zou & Zhaojun Wang & Xianwu Wei & Bin Chen, 2015. "Robust spline-based variable selection in varying coefficient model," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 78(1), pages 85-118, January.
    18. Xuejun Ma & Yue Du & Jingli Wang, 2022. "Model detection and variable selection for mode varying coefficient model," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(2), pages 321-341, June.
    19. Zhaoping Hong & Yuao Hu & Heng Lian, 2013. "Variable selection for high-dimensional varying coefficient partially linear models via nonconcave penalty," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 76(7), pages 887-908, October.
    20. Yue, Mu & Li, Jialiang & Cheng, Ming-Yen, 2019. "Two-step sparse boosting for high-dimensional longitudinal data with varying coefficients," Computational Statistics & Data Analysis, Elsevier, vol. 131(C), pages 222-234.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:aistmt:v:66:y:2014:i:1:p:165-191. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.