IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v160y2021ics0167947321000591.html
   My bibliography  Save this article

Robust distributed modal regression for massive data

Author

Listed:
  • Wang, Kangning
  • Li, Shaomin

Abstract

Modal regression is a good alternative of the mean regression and likelihood based methods, because of its robustness and high efficiency. A robust communication-efficient distributed modal regression for the distributed massive data is proposed in this paper. Specifically, the global modal regression objective function is approximated by a surrogate one at the first machine, which relates to the local datasets only through gradients. Then the resulting estimator can be obtained at the first machine and other machines only need to calculate the gradients, which can significantly reduce the communication cost. Under mild conditions, the asymptotical properties are established, which show that the proposed estimator is statistically as efficient as the global modal regression estimator. What is more, as a specific application, a penalized robust communication-efficient distributed modal regression variable selection procedure is developed. Simulation results and real data analysis are also included to validate our method.

Suggested Citation

  • Wang, Kangning & Li, Shaomin, 2021. "Robust distributed modal regression for massive data," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).
    • Handle: RePEc:eee:csdana:v:160:y:2021:i:c:s0167947321000591
    DOI: 10.1016/j.csda.2021.107225
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947321000591
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2021.107225?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Zou, Hui, 2006. "The Adaptive Lasso and Its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 1418-1429, December.
    2. Wang, Kangning & Li, Shaomin & Sun, Xiaofei & Lin, Lu, 2019. "Modal regression statistical inference for longitudinal data semivarying coefficient models: Generalized estimating equations, empirical likelihood and variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 257-276.
    3. Weixin Yao & Bruce Lindsay & Runze Li, 2012. "Local modal regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(3), pages 647-663.
    4. Weihua Zhao & Riquan Zhang & Jicai Liu & Yazhao Lv, 2014. "Robust and efficient variable selection for semiparametric partially linear varying coefficient model based on modal regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(1), pages 165-191, February.
    5. Michael I. Jordan & Jason D. Lee & Yun Yang, 2019. "Communication-Efficient Distributed Statistical Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 668-681, April.
    6. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    7. Weixin Yao & Longhai Li, 2014. "A New Regression Model: Modal Linear Regression," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(3), pages 656-671, September.
    8. Koenker, Roger W & Bassett, Gilbert, Jr, 1978. "Regression Quantiles," Econometrica, Econometric Society, vol. 46(1), pages 33-50, January.
    9. Qifa Xu & Chao Cai & Cuixia Jiang & Fang Sun & Xue Huang, 2020. "Block average quantile regression for massive dataset," Statistical Papers, Springer, vol. 61(1), pages 141-165, February.
    10. Liu, Jicai & Zhang, Riquan & Zhao, Weihua & Lv, Yazhao, 2013. "A robust and efficient estimation method for single index models," Journal of Multivariate Analysis, Elsevier, vol. 122(C), pages 226-238.
    11. Ming Yuan & Yi Lin, 2007. "On the non‐negative garrotte estimator," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(2), pages 143-161, April.
    12. Riquan Zhang & Weihua Zhao & Jicai Liu, 2013. "Robust estimation and variable selection for semiparametric partially linear varying coefficient model based on modal regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 25(2), pages 523-544, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Mohammed Algarni & Mashhour A. Alazwari & Mohammad Reza Safaei, 2021. "Optimization of Nano-Additive Characteristics to Improve the Efficiency of a Shell and Tube Thermal Energy Storage System Using a Hybrid Procedure: DOE, ANN, MCDM, MOO, and CFD Modeling," Mathematics, MDPI, vol. 9(24), pages 1-30, December.
    2. Mohammed Balubaid & Mohammad Amir Sattari & Osman Taylan & Ahmed A. Bakhsh & Ehsan Nazemi, 2021. "Applications of Discrete Wavelet Transform for Feature Extraction to Increase the Accuracy of Monitoring Systems of Liquid Petroleum Products," Mathematics, MDPI, vol. 9(24), pages 1-14, December.
    3. Shaomin Li & Kangning Wang & Yong Xu, 2023. "Robust estimation for nonrandomly distributed data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(3), pages 493-509, June.
    4. Abdulaziz S. Alkabaa & Osman Taylan & Mustafa Tahsin Yilmaz & Ehsan Nazemi & El Mostafa Kalmoun, 2022. "An Investigation on Spiking Neural Networks Based on the Izhikevich Neuronal Model: Spiking Processing and Hardware Approach," Mathematics, MDPI, vol. 10(4), pages 1-21, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Kangning & Li, Shaomin & Sun, Xiaofei & Lin, Lu, 2019. "Modal regression statistical inference for longitudinal data semivarying coefficient models: Generalized estimating equations, empirical likelihood and variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 133(C), pages 257-276.
    2. Kangning Wang & Lu Lin, 2019. "Robust and efficient estimator for simultaneous model structure identification and variable selection in generalized partial linear varying coefficient models with longitudinal data," Statistical Papers, Springer, vol. 60(5), pages 1649-1676, October.
    3. Yang, Jing & Tian, Guoliang & Lu, Fang & Lu, Xuewen, 2020. "Single-index modal regression via outer product gradients," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    4. Hu Yang & Ning Li & Jing Yang, 2020. "A robust and efficient estimation and variable selection method for partially linear models with large-dimensional covariates," Statistical Papers, Springer, vol. 61(5), pages 1911-1937, October.
    5. Shaomin Li & Kangning Wang & Yong Xu, 2023. "Robust estimation for nonrandomly distributed data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 75(3), pages 493-509, June.
    6. Lv, Zhike & Zhu, Huiming & Yu, Keming, 2014. "Robust variable selection for nonlinear models with diverging number of parameters," Statistics & Probability Letters, Elsevier, vol. 91(C), pages 90-97.
    7. Yang, Hu & Yang, Jing, 2014. "A robust and efficient estimation and variable selection method for partially linear single-index models," Journal of Multivariate Analysis, Elsevier, vol. 129(C), pages 227-242.
    8. Ullah, Aman & Wang, Tao & Yao, Weixin, 2023. "Semiparametric partially linear varying coefficient modal regression," Journal of Econometrics, Elsevier, vol. 235(2), pages 1001-1026.
    9. Xuejun Ma & Yue Du & Jingli Wang, 2022. "Model detection and variable selection for mode varying coefficient model," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 31(2), pages 321-341, June.
    10. Zhao, Weihua & Zhang, Riquan & Liu, Jicai & Hu, Hongchang, 2015. "Robust adaptive estimation for semivarying coefficient models," Statistics & Probability Letters, Elsevier, vol. 97(C), pages 132-141.
    11. Lv, Jing & Yang, Hu & Guo, Chaohui, 2015. "An efficient and robust variable selection method for longitudinal generalized linear models," Computational Statistics & Data Analysis, Elsevier, vol. 82(C), pages 74-88.
    12. Yunlu Jiang & Guo-Liang Tian & Yu Fei, 2019. "A robust and efficient estimation method for partially nonlinear models via a new MM algorithm," Statistical Papers, Springer, vol. 60(6), pages 2063-2085, December.
    13. Zhao, Weihua & Lian, Heng, 2017. "Quantile index coefficient model with variable selection," Journal of Multivariate Analysis, Elsevier, vol. 154(C), pages 40-58.
    14. Kangning Wang & Xiaofei Sun, 2020. "Efficient parameter estimation and variable selection in partial linear varying coefficient quantile regression model with longitudinal data," Statistical Papers, Springer, vol. 61(3), pages 967-995, June.
    15. Jiang, Rong & Qian, Weimin & Zhou, Zhangong, 2012. "Variable selection and coefficient estimation via composite quantile regression with randomly censored data," Statistics & Probability Letters, Elsevier, vol. 82(2), pages 308-317.
    16. Yu-Zhu Tian & Man-Lai Tang & Wai-Sum Chan & Mao-Zai Tian, 2021. "Bayesian bridge-randomized penalized quantile regression for ordinal longitudinal data, with application to firm’s bond ratings," Computational Statistics, Springer, vol. 36(2), pages 1289-1319, June.
    17. Wang Chamont & Gevertz Jana L., 2016. "Finding causative genes from high-dimensional data: an appraisal of statistical and machine learning approaches," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 15(4), pages 321-347, August.
    18. Torri, Gabriele & Giacometti, Rosella & Tichý, Tomáš, 2021. "Network tail risk estimation in the European banking system," Journal of Economic Dynamics and Control, Elsevier, vol. 127(C).
    19. Haowen Bao & Zongwu Cai & Yuying Sun & Shouyang Wang, 2023. "Penalized Model Averaging for High Dimensional Quantile Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202302, University of Kansas, Department of Economics, revised Jan 2023.
    20. Yang, Jing & Yang, Hu, 2016. "A robust penalized estimation for identification in semiparametric additive models," Statistics & Probability Letters, Elsevier, vol. 110(C), pages 268-277.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:160:y:2021:i:c:s0167947321000591. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.