IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v10y2022i24p4767-d1004252.html
   My bibliography  Save this article

Application of the ADMM Algorithm for a High-Dimensional Partially Linear Model

Author

Listed:
  • Aifen Feng

    (School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang 471023, China
    These authors contributed equally to this work.)

  • Xiaogai Chang

    (School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang 471023, China
    These authors contributed equally to this work.)

  • Youlin Shang

    (School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang 471023, China)

  • Jingya Fan

    (School of Mathematics and Statistics, Henan University of Science and Technology, Luoyang 471023, China)

Abstract

This paper focuses on a high-dimensional semi-parametric regression model in which a partially linear model is used for the parametric part and the B-spline basis function approach is used to estimate the unknown function for the non-parametric part. Within the framework of this model, the constrained least squares estimation is investigated, and the alternating-direction multiplier method (ADMM) is used to solve the model. The convergence is proved under certain conditions. Finally, numerical simulations are performed and applied to workers’ wage data from CPS85. The results show that the ADMM algorithm is very effective in solving high-dimensional partially linear models.

Suggested Citation

  • Aifen Feng & Xiaogai Chang & Youlin Shang & Jingya Fan, 2022. "Application of the ADMM Algorithm for a High-Dimensional Partially Linear Model," Mathematics, MDPI, vol. 10(24), pages 1-13, December.
    • Handle: RePEc:gam:jmathe:v:10:y:2022:i:24:p:4767-:d:1004252
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/10/24/4767/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/10/24/4767/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Eric Auerbach, 2022. "Identification and Estimation of a Partially Linear Regression Model Using Network Data," Econometrica, Econometric Society, vol. 90(1), pages 347-365, January.
    2. Wang, Xiuli & Zhao, Shengli & Wang, Mingqiu, 2017. "Restricted profile estimation for partially linear models with large-dimensional covariates," Statistics & Probability Letters, Elsevier, vol. 128(C), pages 71-76.
    3. Li, Qi, 2000. "Efficient Estimation of Additive Partially Linear Models," International Economic Review, Department of Economics, University of Pennsylvania and Osaka University Institute of Social and Economic Research Association, vol. 41(4), pages 1073-1092, November.
    4. Hardle, Wolfgang & LIang, Hua & Gao, Jiti, 2000. "Partially linear models," MPRA Paper 39562, University Library of Munich, Germany, revised 01 Sep 2000.
    5. Ni, Xiao & Zhang, Hao Helen & Zhang, Daowen, 2009. "Automatic model selection for partially linear models," Journal of Multivariate Analysis, Elsevier, vol. 100(9), pages 2100-2111, October.
    6. Hong-Xia Xu & Zhen-Long Chen & Jiang-Feng Wang & Guo-Liang Fan, 2019. "Quantile regression and variable selection for partially linear model with randomly truncated data," Statistical Papers, Springer, vol. 60(4), pages 1137-1160, August.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Aifen Feng & Xiaogai Chang & Jingya Fan & Zhengfen Jin, 2023. "Application of LADMM and As-LADMM for a High-Dimensional Partially Linear Model," Mathematics, MDPI, vol. 11(19), pages 1-14, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aifen Feng & Xiaogai Chang & Jingya Fan & Zhengfen Jin, 2023. "Application of LADMM and As-LADMM for a High-Dimensional Partially Linear Model," Mathematics, MDPI, vol. 11(19), pages 1-14, October.
    2. Hu Yang & Ning Li & Jing Yang, 2020. "A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates," Statistical Papers, Springer, vol. 61(5), pages 1911-1937, October.
    3. Germán Aneiros & Philippe Vieu, 2015. "Partial linear modelling with multi-functional covariates," Computational Statistics, Springer, vol. 30(3), pages 647-671, September.
    4. Guozhi Hu & Weihu Cheng & Jie Zeng, 2023. "Optimal Model Averaging for Semiparametric Partially Linear Models with Censored Data," Mathematics, MDPI, vol. 11(3), pages 1-21, February.
    5. Yang, Lijian & Park, Byeong U. & Xue, Lan & Hardle, Wolfgang, 2006. "Estimation and Testing for Varying Coefficients in Additive Models With Marginal Integration," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1212-1227, September.
    6. Kim, Kun Ho & Chao, Shih-Kang & Härdle, Wolfgang Karl, 2020. "Simultaneous Inference of the Partially Linear Model with a Multivariate Unknown Function," IRTG 1792 Discussion Papers 2020-008, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    7. Dette, Holger & Marchlewski, Mareen, 2007. "A test for the parametric form of the variance function in apartial linear regression model," Technical Reports 2007,26, Technische Universität Dortmund, Sonderforschungsbereich 475: Komplexitätsreduktion in multivariaten Datenstrukturen.
    8. Ferraccioli, Federico & Sangalli, Laura M. & Finos, Livio, 2022. "Some first inferential tools for spatial regression with differential regularization," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    9. Cui, Xia & Lu, Ying & Peng, Heng, 2017. "Estimation of partially linear regression models under the partial consistency property," Computational Statistics & Data Analysis, Elsevier, vol. 115(C), pages 103-121.
    10. Akdeniz Duran, Esra & Härdle, Wolfgang Karl & Osipenko, Maria, 2012. "Difference based ridge and Liu type estimators in semiparametric regression models," Journal of Multivariate Analysis, Elsevier, vol. 105(1), pages 164-175.
    11. Yuejin Zhou & Yebin Cheng & Wenlin Dai & Tiejun Tong, 2018. "Optimal difference-based estimation for partially linear models," Computational Statistics, Springer, vol. 33(2), pages 863-885, June.
    12. Zhu, Xuehu & Wang, Tao & Zhao, Junlong & Zhu, Lixing, 2017. "Inference for biased transformation models," Computational Statistics & Data Analysis, Elsevier, vol. 109(C), pages 105-120.
    13. Kim, Namhyun & W. Saart, Patrick, 2021. "Estimation in partially linear semiparametric models with parametric and/or nonparametric endogeneity," Cardiff Economics Working Papers E2021/9, Cardiff University, Cardiff Business School, Economics Section.
    14. Lu Lin & Lili Liu & Xia Cui & Kangning Wang, 2021. "A generalized semiparametric regression and its efficient estimation," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(1), pages 1-24, March.
    15. B. Ettinger & S. Perotto & L. M. Sangalli, 2016. "Spatial regression models over two-dimensional manifolds," Biometrika, Biometrika Trust, vol. 103(1), pages 71-88.
    16. Lian, Heng & Liang, Hua, 2016. "Separation of linear and index covariates in partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 143(C), pages 56-70.
    17. Huang, Zhensheng & Pang, Zhen & Hu, Tao, 2013. "Testing structural change in partially linear single-index models with error-prone linear covariates," Computational Statistics & Data Analysis, Elsevier, vol. 59(C), pages 121-133.
    18. Xin Lu & Brent A. Johnson, 2015. "Direct estimation of the mean outcome on treatment when treatment assignment and discontinuation compete," Biometrika, Biometrika Trust, vol. 102(4), pages 797-807.
    19. Mou, Xichen & Wang, Dewei, 2024. "Additive partially linear model for pooled biomonitoring data," Computational Statistics & Data Analysis, Elsevier, vol. 190(C).
    20. Zhang, Jun & Feng, Zhenghui & Peng, Heng, 2018. "Estimation and hypothesis test for partial linear multiplicative models," Computational Statistics & Data Analysis, Elsevier, vol. 128(C), pages 87-103.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:10:y:2022:i:24:p:4767-:d:1004252. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.