IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v11y2023i3p734-d1053736.html
   My bibliography  Save this article

Optimal Model Averaging for Semiparametric Partially Linear Models with Censored Data

Author

Listed:
  • Guozhi Hu

    (School of Mathematics and Statistics, Hefei Normal University, Hefei 230601, China)

  • Weihu Cheng

    (Faculty of Science, Beijing University of Technology, Beijing 100124, China)

  • Jie Zeng

    (School of Mathematics and Statistics, Hefei Normal University, Hefei 230601, China)

Abstract

In the past few decades, model averaging has received extensive attention, and has been regarded as a feasible alternative to model selection. However, this work is mainly based on parametric model framework and complete dataset. This paper develops a frequentist model-averaging estimation for semiparametric partially linear models with censored responses. The nonparametric function is approximated by B-spline, and the weights in model-averaging estimator are picked up via minimizing a leave-one-out cross-validation criterion. The resulting model-averaging estimator is proved to be asymptotically optimal in the sense of achieving the lowest possible squared error. A simulation study demonstrates that the method in this paper is superior to traditional model-selection and model-averaging methods. Finally, as an illustration, the proposed procedure is further applied to analyze two real datasets.

Suggested Citation

  • Guozhi Hu & Weihu Cheng & Jie Zeng, 2023. "Optimal Model Averaging for Semiparametric Partially Linear Models with Censored Data," Mathematics, MDPI, vol. 11(3), pages 1-21, February.
  • Handle: RePEc:gam:jmathe:v:11:y:2023:i:3:p:734-:d:1053736
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/11/3/734/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/11/3/734/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Peng, Jingfu & Yang, Yuhong, 2022. "On improvability of model selection by model averaging," Journal of Econometrics, Elsevier, vol. 229(2), pages 246-262.
    2. Yuting Wei & Qihua Wang & Wei Liu, 2021. "Model averaging for linear models with responses missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(3), pages 535-553, June.
    3. Wang, Huixia Judy & Wang, Lan, 2009. "Locally Weighted Censored Quantile Regression," Journal of the American Statistical Association, American Statistical Association, vol. 104(487), pages 1117-1128.
    4. Gao, Yan & Zhang, Xinyu & Wang, Shouyang & Zou, Guohua, 2016. "Model averaging based on leave-subject-out cross-validation," Journal of Econometrics, Elsevier, vol. 192(1), pages 139-151.
    5. Wei, Yuting & Wang, Qihua, 2021. "Cross-validation-based model averaging in linear models with response missing at random," Statistics & Probability Letters, Elsevier, vol. 171(C).
    6. Qingfeng Liu & Ryo Okui & Arihiro Yoshimura, 2016. "Generalized Least Squares Model Averaging," Econometric Reviews, Taylor & Francis Journals, vol. 35(8-10), pages 1692-1752, December.
    7. Shi, Jian & Lau, Tai-Shing, 2000. "Empirical Likelihood for Partially Linear Models," Journal of Multivariate Analysis, Elsevier, vol. 72(1), pages 132-148, January.
    8. Zeng, Donglin & Lin, D.Y., 2007. "Efficient Estimation for the Accelerated Failure Time Model," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1387-1396, December.
    9. Hjort, Nils Lid & Claeskens, Gerda, 2006. "Focused Information Criteria and Model Averaging for the Cox Hazard Regression Model," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1449-1464, December.
    10. Diebold, Francis X & Mariano, Roberto S, 2002. "Comparing Predictive Accuracy," Journal of Business & Economic Statistics, American Statistical Association, vol. 20(1), pages 134-144, January.
    11. Jianqing Fan & Yunbei Ma & Wei Dai, 2014. "Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Varying Coefficient Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1270-1284, September.
    12. Xinyu Zhang & Jeng-Min Chiou & Yanyuan Ma, 2018. "Functional prediction through averaging estimated functional linear regression models," Biometrika, Biometrika Trust, vol. 105(4), pages 945-962.
    13. Li, Qi, 2000. "Efficient Estimation of Additive Partially Linear Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(4), pages 1073-1092, November.
    14. Raheem, S.M. Enayetur & Ahmed, S. Ejaz & Doksum, Kjell A., 2012. "Absolute penalty and shrinkage estimation in partially linear models," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 874-891.
    15. Xiaochao Xia, 2021. "Model averaging prediction for nonparametric varying-coefficient models with B-spline smoothing," Statistical Papers, Springer, vol. 62(6), pages 2885-2905, December.
    16. Hardle, Wolfgang & LIang, Hua & Gao, Jiti, 2000. "Partially linear models," MPRA Paper 39562, University Library of Munich, Germany, revised 01 Sep 2000.
    17. Tomohiro Ando & Ker-Chau Li, 2014. "A Model-Averaging Approach for High-Dimensional Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(505), pages 254-265, March.
    18. Lu, Xun & Su, Liangjun, 2015. "Jackknife model averaging for quantile regressions," Journal of Econometrics, Elsevier, vol. 188(1), pages 40-58.
    19. Zhang, Xinyu & Wan, Alan T.K. & Zou, Guohua, 2013. "Model averaging by jackknife criterion in models with dependent data," Journal of Econometrics, Elsevier, vol. 174(2), pages 82-94.
    20. Xinyu Zhang & Yanyuan Ma & Raymond J. Carroll, 2019. "MALMEM: model averaging in linear measurement error models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 81(4), pages 763-779, September.
    21. Wan, Alan T.K. & Zhang, Xinyu & Zou, Guohua, 2010. "Least squares model averaging by Mallows criterion," Journal of Econometrics, Elsevier, vol. 156(2), pages 277-283, June.
    22. Ni, Xiao & Zhang, Hao Helen & Zhang, Daowen, 2009. "Automatic model selection for partially linear models," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2100-2111, October.
    23. Yan, Xiaodong & Wang, Hongni & Wang, Wei & Xie, Jinhan & Ren, Yanyan & Wang, Xinjun, 2021. "Optimal model averaging forecasting in high-dimensional survival analysis," International Journal of Forecasting, Elsevier, vol. 37(3), pages 1147-1155.
    24. Claeskens,Gerda & Hjort,Nils Lid, 2008. "Model Selection and Model Averaging," Cambridge Books, Cambridge University Press, number 9780521852258, September.
    25. Rong Zhu & Alan T. K. Wan & Xinyu Zhang & Guohua Zou, 2019. "A Mallows-Type Model Averaging Estimator for the Varying-Coefficient Partially Linear Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 882-892, April.
    26. Jiang Du & Zhongzhan Zhang & Tianfa Xie, 2017. "Focused information criterion and model averaging in censored quantile regression," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 80(5), pages 547-570, July.
    27. Bruce E. Hansen, 2007. "Least Squares Model Averaging," Econometrica, Econometric Society, vol. 75(4), pages 1175-1189, July.
    28. Guozhi Hu & Weihu Cheng & Jie Zeng, 2020. "Model averaging by jackknife criterion for varying-coefficient partially linear models," Communications in Statistics - Theory and Methods, Taylor & Francis Journals, vol. 49(11), pages 2671-2689, June.
    29. Zhang, Qingzhao & Duan, Xiaogang & Ma, Shuangge, 2017. "Focused information criterion and model averaging with generalized rank regression," Statistics & Probability Letters, Elsevier, vol. 122(C), pages 11-19.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Xiaochao Xia, 2021. "Model averaging prediction for nonparametric varying-coefficient models with B-spline smoothing," Statistical Papers, Springer, vol. 62(6), pages 2885-2905, December.
    2. Jie Zeng & Weihu Cheng & Guozhi Hu, 2023. "Optimal Model Averaging Estimation for the Varying-Coefficient Partially Linear Models with Missing Responses," Mathematics, MDPI, vol. 11(8), pages 1-21, April.
    3. Rongjie Jiang & Liming Wang & Yang Bai, 2021. "Optimal model averaging estimator for semi-functional partially linear models," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 84(2), pages 167-194, February.
    4. Jingwen Tu & Hu Yang & Chaohui Guo & Jing Lv, 2021. "Model averaging marginal regression for high dimensional conditional quantile prediction," Statistical Papers, Springer, vol. 62(6), pages 2661-2689, December.
    5. Zhang, Xinyu & Liu, Chu-An, 2023. "Model averaging prediction by K-fold cross-validation," Journal of Econometrics, Elsevier, vol. 235(1), pages 280-301.
    6. Haili Zhang & Guohua Zou, 2020. "Cross-Validation Model Averaging for Generalized Functional Linear Model," Econometrics, MDPI, vol. 8(1), pages 1-35, February.
    7. Liao, Jun & Zou, Guohua, 2020. "Corrected Mallows criterion for model averaging," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    8. Xianwen Sun & Lixin Zhang, 2024. "Jackknife model averaging for mixed-data kernel-weighted spline quantile regressions," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 87(7), pages 805-842, October.
    9. Sun, Yuying & Hong, Yongmiao & Lee, Tae-Hwy & Wang, Shouyang & Zhang, Xinyu, 2021. "Time-varying model averaging," Journal of Econometrics, Elsevier, vol. 222(2), pages 974-992.
    10. Wenchao Xu & Xinyu Zhang, 2024. "On Asymptotic Optimality of Least Squares Model Averaging When True Model Is Included," Papers 2411.09258, arXiv.org.
    11. Chen, Yi-Ting & Liu, Chu-An, 2023. "Model averaging for asymptotically optimal combined forecasts," Journal of Econometrics, Elsevier, vol. 235(2), pages 592-607.
    12. Christian Brownlees & Vladislav Morozov, 2022. "Unit Averaging for Heterogeneous Panels," Papers 2210.14205, arXiv.org, revised May 2024.
    13. Yuting Wei & Qihua Wang & Wei Liu, 2021. "Model averaging for linear models with responses missing at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(3), pages 535-553, June.
    14. Haowen Bao & Zongwu Cai & Yuying Sun & Shouyang Wang, 2023. "Penalized Model Averaging for High Dimensional Quantile Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202302, University of Kansas, Department of Economics, revised Jan 2023.
    15. Shangwei Zhao & Jun Liao & Dalei Yu, 2020. "Model averaging estimator in ridge regression and its large sample properties," Statistical Papers, Springer, vol. 61(4), pages 1719-1739, August.
    16. Zhang, Xiaomeng & Zhang, Xinyu, 2023. "Optimal model averaging based on forward-validation," Journal of Econometrics, Elsevier, vol. 237(2).
    17. Yang Feng & Qingfeng Liu, 2020. "Nested Model Averaging on Solution Path for High-dimensional Linear Regression," Papers 2005.08057, arXiv.org.
    18. Jia Chen & Degui Li & Oliver Linton & Zudi Lu, 2015. "Semiparametric model averaging of ultra-high dimensional time series," CeMMAP working papers CWP62/15, Centre for Microdata Methods and Practice, Institute for Fiscal Studies.
    19. Zhao, Shangwei & Zhou, Jianhong & Li, Hongjun, 2016. "Model averaging with high-dimensional dependent data," Economics Letters, Elsevier, vol. 148(C), pages 68-71.
    20. Liao, Jun & Wan, Alan T.K. & He, Shuyuan & Zou, Guohua, 2022. "Optimal model averaging for multivariate regression models," Journal of Multivariate Analysis, Elsevier, vol. 189(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:11:y:2023:i:3:p:734-:d:1053736. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.