IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v13y2025i5p837-d1603908.html
   My bibliography  Save this article

A Selective Overview of Quantile Regression for Large-Scale Data

Author

Listed:
  • Shanshan Wang

    (School of Economics and Management, Beihang University, Beijing 100191, China
    MOE Key Laboratory of Complex System Analysis and Management Decision, Beihang University, Beijing 100191, China)

  • Wei Cao

    (School of Economics and Management, Beihang University, Beijing 100191, China)

  • Xiaoxue Hu

    (School of Economics and Management, Beihang University, Beijing 100191, China)

  • Hanyu Zhong

    (School of Economics and Management, Beihang University, Beijing 100191, China)

  • Weixi Sun

    (School of Economics and Management, Beihang University, Beijing 100191, China
    Sino-French Engineering School, Beihang University, Beijing 100191, China)

Abstract

Large-scale data, characterized by heterogeneity due to heteroskedastic variance or inhomogeneous covariate effects, arises in diverse fields of scientific research and technological development. Quantile regression (QR) is a valuable tool for detecting heteroskedasticity, and numerous QR statistical methods for large-scale data have been rapidly developed. This paper provides a selective review of recent advances in QR theory, methods, and implementations, particularly in the context of massive and streaming data. We focus on three key strategies for large-scale QR analysis: (1) distributed computing, (2) subsampling methods, and (3) online updating. The main contribution of this paper is a comprehensive review of existing work and advancements in these areas, addressing challenges such as managing the non-smooth QR loss function, developing distributed and online updating formulations, and conducting statistical inference. Finally, we highlight several issues that require further study.

Suggested Citation

  • Shanshan Wang & Wei Cao & Xiaoxue Hu & Hanyu Zhong & Weixi Sun, 2025. "A Selective Overview of Quantile Regression for Large-Scale Data," Mathematics, MDPI, vol. 13(5), pages 1-30, March.
    • Handle: RePEc:gam:jmathe:v:13:y:2025:i:5:p:837-:d:1603908
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/13/5/837/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/2227-7390/13/5/837/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Joel L. Horowitz, 1998. "Bootstrap Methods for Median Regression Models," Econometrica, Econometric Society, vol. 66(6), pages 1327-1352, November.
    2. Ye Fan & Nan Lin & Liqun Yu, 2024. "Distributed quantile regression for longitudinal big data," Computational Statistics, Springer, vol. 39(2), pages 751-779, April.
    3. Runze Li & Dennis K.J. Lin & Bing Li, 2013. "Statistical inference in massive data sets," Applied Stochastic Models in Business and Industry, John Wiley & Sons, vol. 29(5), pages 399-409, September.
    4. He, Xuming & Pan, Xiaoou & Tan, Kean Ming & Zhou, Wen-Xin, 2023. "Smoothed quantile regression with large-scale inference," Journal of Econometrics, Elsevier, vol. 232(2), pages 367-388.
    5. Michael I. Jordan & Jason D. Lee & Yun Yang, 2019. "Communication-Efficient Distributed Statistical Inference," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(526), pages 668-681, April.
    6. Fan J. & Li R., 2001. "Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 1348-1360, December.
    7. Rong Jiang & Keming Yu, 2024. "Unconditional Quantile Regression for Streaming Datasets," Journal of Business & Economic Statistics, Taylor & Francis Journals, vol. 42(4), pages 1143-1154, October.
    8. Jianfeng Wei & Jian Yang & Xuewen Cheng & Jie Ding & Shengquan Li, 2023. "Adaptive Regression Analysis of Heterogeneous Data Streams via Models with Dynamic Effects," Mathematics, MDPI, vol. 11(24), pages 1-18, December.
    9. Baur, Dirk G., 2013. "The structure and degree of dependence: A quantile regression approach," Journal of Banking & Finance, Elsevier, vol. 37(3), pages 786-798.
    10. Chen, Lanjue & Zhou, Yong, 2020. "Quantile regression in big data: A divide and conquer based strategy," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    11. Qifa Xu & Chao Cai & Cuixia Jiang & Fang Sun & Xue Huang, 2020. "Block average quantile regression for massive dataset," Statistical Papers, Springer, vol. 61(1), pages 141-165, February.
    12. Haiying Wang & Yanyuan Ma, 2021. "Optimal subsampling for quantile regression in big data," Biometrika, Biometrika Trust, vol. 108(1), pages 99-112.
    13. Xuetong Li & Yuan Gao & Hong Chang & Danyang Huang & Yingying Ma & Rui Pan & Haobo Qi & Feifei Wang & Shuyuan Wu & Ke Xu & Jing Zhou & Xuening Zhu & Yingqiu Zhu & Hansheng Wang, 2024. "A selective review on statistical methods for massive data computation: distributed computing, subsampling, and minibatch techniques," Statistical Theory and Related Fields, Taylor & Francis Journals, vol. 8(3), pages 163-185, July.
    14. HaiYing Wang & Min Yang & John Stufken, 2019. "Information-Based Optimal Subdata Selection for Big Data Linear Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 393-405, January.
    15. HaiYing Wang & Rong Zhu & Ping Ma, 2018. "Optimal Subsampling for Large Sample Logistic Regression," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 113(522), pages 829-844, April.
    16. Yu, Keming & Moyeed, Rana A., 2001. "Bayesian quantile regression," Statistics & Probability Letters, Elsevier, vol. 54(4), pages 437-447, October.
    17. T. J. Cole, 1988. "Fitting Smoothed Centile Curves to Reference Data," Journal of the Royal Statistical Society Series A, Royal Statistical Society, vol. 151(3), pages 385-406, May.
    18. Xingcai Zhou & Zhaoyang Jing & Chao Huang, 2024. "Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression," Mathematics, MDPI, vol. 12(5), pages 1-53, February.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Feifei Wang & Danyang Huang & Tianchen Gao & Shuyuan Wu & Hansheng Wang, 2022. "Sequential one‐step estimator by sub‐sampling for customer churn analysis with massive data sets," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1753-1786, November.
    2. Wang, Kangning & Li, Shaomin, 2021. "Robust distributed modal regression for massive data," Computational Statistics & Data Analysis, Elsevier, vol. 160(C).
    3. Jun Yu & HaiYing Wang, 2022. "Subdata selection algorithm for linear model discrimination," Statistical Papers, Springer, vol. 63(6), pages 1883-1906, December.
    4. Lu Lin & Feng Li, 2023. "Global debiased DC estimations for biased estimators via pro forma regression," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(2), pages 726-758, June.
    5. Ziyang Wang & HaiYing Wang & Nalini Ravishanker, 2023. "Subsampling in Longitudinal Models," Methodology and Computing in Applied Probability, Springer, vol. 25(1), pages 1-29, March.
    6. Deng, Jiayi & Huang, Danyang & Ding, Yi & Zhu, Yingqiu & Jing, Bingyi & Zhang, Bo, 2024. "Subsampling spectral clustering for stochastic block models in large-scale networks," Computational Statistics & Data Analysis, Elsevier, vol. 189(C).
    7. Zhang, Haixiang & Wang, HaiYing, 2021. "Distributed subdata selection for big data via sampling-based approach," Computational Statistics & Data Analysis, Elsevier, vol. 153(C).
    8. Baolin Chen & Shanshan Song & Yong Zhou, 2024. "Estimation and testing of expectile regression with efficient subsampling for massive data," Statistical Papers, Springer, vol. 65(9), pages 5593-5613, December.
    9. Wang, Kangning & Li, Shaomin & Zhang, Benle, 2021. "Robust communication-efficient distributed composite quantile regression and variable selection for massive data," Computational Statistics & Data Analysis, Elsevier, vol. 161(C).
    10. Xiaohui Yuan & Yong Li & Xiaogang Dong & Tianqing Liu, 2022. "Optimal subsampling for composite quantile regression in big data," Statistical Papers, Springer, vol. 63(5), pages 1649-1676, October.
    11. Huy N. Chau & J. Lars Kirkby & Dang H. Nguyen & Duy Nguyen & Nhu N. Nguyen & Thai Nguyen, 2024. "On the Inversion‐Free Newton's Method and Its Applications," International Statistical Review, International Statistical Institute, vol. 92(2), pages 284-321, August.
    12. Jun Yu & Jiaqi Liu & HaiYing Wang, 2023. "Information-based optimal subdata selection for non-linear models," Statistical Papers, Springer, vol. 64(4), pages 1069-1093, August.
    13. Tianzhen Wang & Haixiang Zhang, 2022. "Optimal subsampling for multiplicative regression with massive data," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 76(4), pages 418-449, November.
    14. Lulu Zuo & Haixiang Zhang & HaiYing Wang & Liuquan Sun, 2021. "Optimal subsample selection for massive logistic regression with distributed data," Computational Statistics, Springer, vol. 36(4), pages 2535-2562, December.
    15. Jun Jin & Chenyan Hao & Yewen Chen, 2025. "Composite quantile regression for a distributed system with non-randomly distributed data," Statistical Papers, Springer, vol. 66(1), pages 1-30, January.
    16. Yu-Zhu Tian & Man-Lai Tang & Wai-Sum Chan & Mao-Zai Tian, 2021. "Bayesian bridge-randomized penalized quantile regression for ordinal longitudinal data, with application to firm’s bond ratings," Computational Statistics, Springer, vol. 36(2), pages 1289-1319, June.
    17. Haowen Bao & Zongwu Cai & Yuying Sun & Shouyang Wang, 2023. "Penalized Model Averaging for High Dimensional Quantile Regressions," WORKING PAPERS SERIES IN THEORETICAL AND APPLIED ECONOMICS 202302, University of Kansas, Department of Economics, revised Jan 2023.
    18. Su, Miaomiao & Wang, Ruoyu & Wang, Qihua, 2022. "A two-stage optimal subsampling estimation for missing data problems with large-scale data," Computational Statistics & Data Analysis, Elsevier, vol. 173(C).
    19. Xianwen Ding & Zhihuang Yang, 2024. "Adaptive Bi-Level Variable Selection for Quantile Regression Models with a Diverging Number of Covariates," Mathematics, MDPI, vol. 12(20), pages 1-23, October.
    20. Xing Li & Yujing Shao & Lei Wang, 2024. "Optimal subsampling for $$L_p$$ L p -quantile regression via decorrelated score," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 33(4), pages 1084-1104, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:13:y:2025:i:5:p:837-:d:1603908. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.