IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v188y2023ics0167947323001354.html
   My bibliography  Save this article

Semi-profiled distributed estimation for high-dimensional partially linear model

Author

Listed:
  • Bao, Yajie
  • Ren, Haojie

Abstract

As a leading example in the semiparametric model, the partially linear model is prominent in modeling complex data. The challenges associated with designing an efficient estimation algorithm in the distributed environment are not yet well addressed. The existing works require a constraint on the number of local machines to guarantee the optimality of the global estimator. In addition, a multi-round profiled estimator will lead to huge communication complexity. To further reduce communication costs, a novel semi-profiled estimation procedure is proposed, which provides an iterative skeleton to reduce estimation error. A new multi-round distributed algorithm based on the centralized semi-profiled estimator is developed, which can estimate the parametric and nonparametric simultaneously. The theoretical results indicate that the corresponding convergence rates can achieve the optimal orders within a constant number of communication rounds. The advantages of the proposed estimation method are demonstrated via numerical experiments on synthetic and real data.

Suggested Citation

  • Bao, Yajie & Ren, Haojie, 2023. "Semi-profiled distributed estimation for high-dimensional partially linear model," Computational Statistics & Data Analysis, Elsevier, vol. 188(C).
    • Handle: RePEc:eee:csdana:v:188:y:2023:i:c:s0167947323001354
    DOI: 10.1016/j.csda.2023.107824
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947323001354
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2023.107824?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Robinson, Peter M, 1988. "Root- N-Consistent Semiparametric Regression," Econometrica, Econometric Society, vol. 56(4), pages 931-954, July.
    2. Jianqing Fan & Yunbei Ma & Wei Dai, 2014. "Nonparametric Independence Screening in Sparse Ultra-High-Dimensional Varying Coefficient Models," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(507), pages 1270-1284, September.
    3. Liang, Hua & Li, Runze, 2009. "Variable Selection for Partially Linear Models With Measurement Errors," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 234-248.
    4. Michael I. Jordan & Jason D. Lee & Yun Yang, 2019. "Communication-Efficient Distributed Statistical Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 668-681, April.
    5. Xi Chen & Jason D. Lee & He Li & Yun Yang, 2022. "Distributed Estimation for Principal Component Analysis: An Enlarged Eigenspace Analysis," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 117(540), pages 1775-1786, October.
    6. Wang, Yue & Zhou, Yan & Li, Rui & Lian, Heng, 2022. "Sparse high-dimensional semi-nonparametric quantile regression in a reproducing kernel Hilbert space," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Xiuli & Zhao, Shengli & Wang, Mingqiu, 2017. "Restricted profile estimation for partially linear models with large-dimensional covariates," Statistics & Probability Letters, Elsevier, vol. 128(C), pages 71-76.
    2. Jun Zhang & Zhenghui Feng & Peirong Xu & Hua Liang, 2017. "Generalized varying coefficient partially linear measurement errors models," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 69(1), pages 97-120, February.
    3. Wang, Jia & Cai, Xizhen & Li, Runze, 2021. "Variable selection for partially linear models via Bayesian subset modeling with diffusing prior," Journal of Multivariate Analysis, Elsevier, vol. 183(C).
    4. Feng Li & Lu Lin & Yuxia Su, 2013. "Variable selection and parameter estimation for partially linear models via Dantzig selector," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 76(2), pages 225-238, February.
    5. Zhao, Yan-Yong & Zhang, Yuchun & Liu, Yuan & Ismail, Noriszura, 2024. "Distributed debiased estimation of high-dimensional partially linear models with jumps," Computational Statistics & Data Analysis, Elsevier, vol. 191(C).
    6. repec:spo:wpmain:info:hdl:2441/7182 is not listed on IDEAS
    7. Ai, Chunrong & Chen, Xiaohong, 2007. "Estimation of possibly misspecified semiparametric conditional moment restriction models with different conditioning variables," Journal of Econometrics, Elsevier, vol. 141(1), pages 5-43, November.
    8. Jinhyun Lee, 2013. "A Consistent Nonparametric Bootstrap Test of Exogeneity," Discussion Paper Series, School of Economics and Finance 201316, School of Economics and Finance, University of St Andrews.
    9. Roberto Martino & Phu Nguyen-Van, 2014. "Labour market regulation and fiscal parameters: A structural model for European regions," Working Papers of BETA 2014-19, Bureau d'Economie Théorique et Appliquée, UDS, Strasbourg.
    10. De Loecker, Jan & Konings, Jozef, 2003. "Creative Destruction and Productivity Growth in an Emerging Economy: Evidence from Slovenian Manufacturing," IZA Discussion Papers 971, Institute of Labor Economics (IZA).
    11. Eugene Choo & Shannon Seitz & Aloysius Siow, 2008. "The Collective Marriage Matching Model: Identification, Estimation and Testing," Working Papers tecipa-340, University of Toronto, Department of Economics.
    12. Goldstein, Itay & Jiang, Hao & Ng, David T., 2017. "Investor flows and fragility in corporate bond funds," Journal of Financial Economics, Elsevier, vol. 126(3), pages 592-613.
    13. Kirill Borusyak & Peter Hull & Xavier Jaravel, 2023. "Design-Based Identification with Formula Instruments: A Review," NBER Working Papers 31393, National Bureau of Economic Research, Inc.
    14. Chen, Qi & Goldstein, Itay & Jiang, Wei, 2010. "Payoff complementarities and financial fragility: Evidence from mutual fund outflows," Journal of Financial Economics, Elsevier, vol. 97(2), pages 239-262, August.
    15. Vidal-Sanz, Jose M., 1999. "On universal unbiasedness of delta estimators," DES - Working Papers. Statistics and Econometrics. WS 6322, Universidad Carlos III de Madrid. Departamento de Estadística.
    16. Polemis, Michael & Tselekounis, Markos, 2019. "Does deregulation drive innovation intensity? Lessons learned from the OECD telecommunications sector," MPRA Paper 92770, University Library of Munich, Germany.
    17. Patrick Saart & Jiti Gao & Nam Hyun Kim, 2014. "Semiparametric methods in nonlinear time series analysis: a selective review," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(1), pages 141-169, March.
    18. Flückiger, Matthias & Ludwig, Markus, 2015. "Economic shocks in the fisheries sector and maritime piracy," Journal of Development Economics, Elsevier, vol. 114(C), pages 107-125.
    19. Wongsa-art, Pipat & Kim, Namhyun & Xia, Yingcun & Moscone, Francesco, 2024. "Varying coefficient panel data models and methods under correlated error components: Application to disparities in mental health services in England," Regional Science and Urban Economics, Elsevier, vol. 106(C).
    20. Alena Bicakova & Stepan Jurajda, 2014. "The Quiet Revolution and the Family: Gender Composition of Tertiary Education and Early Fertility Patterns," CERGE-EI Working Papers wp504, The Center for Economic Research and Graduate Education - Economics Institute, Prague.
    21. Marco Helbich & Wolfgang Brunauer & Eric Vaz & Peter Nijkamp, 2014. "Spatial Heterogeneity in Hedonic House Price Models: The Case of Austria," Urban Studies, Urban Studies Journal Limited, vol. 51(2), pages 390-411, February.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:188:y:2023:i:c:s0167947323001354. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.