IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v158y2021ics0167947321000189.html
   My bibliography  Save this article

Computation of projection regression depth and its induced median

Author

Listed:
  • Zuo, Yijun

Abstract

Notions of depth in regression have been introduced and studied in the literature. The most famous example is Regression Depth (RD), which is a direct extension of location depth to regression. The projection regression depth (PRD) is the extension of another prevailing location depth, the projection depth, to regression. The computation issues of the RD have been discussed in the literature. The computation issues of the PRD and its induced median (maximum depth estimator) in a regression setting, never considered before, are addressed. For a given β∈Rp exact algorithms for the PRD with cost O(n2logn) (p=2) and O(N(n,p)(p3+nlogn+np1.5+npNIter)) (p>2) and approximate algorithms for the PRD and its induced median with cost respectively O(Nvnp) and O(RpNβ(p2+nNvNIter)) are proposed. Here N(n,p) is a number defined based on the total number of (p−1) dimensional hyperplanes formed by points induced from sample points and the β; Nv is the total number of unit directions v utilized; Nβ is the total number of candidate regression parameters β employed; NIter is the total number of iterations carried out in an optimization algorithm; R is the total number of replications. Furthermore, as the second major contribution, three PRD induced estimators, which can be computed up to 30 times faster than that of the PRD induced median while maintaining a similar level of accuracy are introduced. Examples and simulation studies reveal that the depth median induced from the PRD is favorable in terms of robustness and efficiency, compared to the maximum depth estimator induced from the RD, which is the current leading regression median.

Suggested Citation

  • Zuo, Yijun, 2021. "Computation of projection regression depth and its induced median," Computational Statistics & Data Analysis, Elsevier, vol. 158(C).
    • Handle: RePEc:eee:csdana:v:158:y:2021:i:c:s0167947321000189
    DOI: 10.1016/j.csda.2021.107184
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947321000189
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2021.107184?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Van Aelst, Stefan & Rousseeuw, Peter J., 2000. "Robustness of Deepest Regression," Journal of Multivariate Analysis, Elsevier, vol. 73(1), pages 82-106, April.
    2. Mizera, Ivan & Volauf, Milos, 2002. "Continuity of Halfspace Depth Contours and Maximum Depth Estimators: Diagnostics of Depth-Related Methods," Journal of Multivariate Analysis, Elsevier, vol. 83(2), pages 365-388, November.
    3. Mosler, Karl & Lange, Tatjana & Bazovkin, Pavel, 2009. "Computing zonoid trimmed regions of dimension d>2," Computational Statistics & Data Analysis, Elsevier, vol. 53(7), pages 2500-2510, May.
    4. Zuo, Yijun & Lai, Shaoyong, 2011. "Exact computation of bivariate projection depth and the Stahel-Donoho estimator," Computational Statistics & Data Analysis, Elsevier, vol. 55(3), pages 1173-1179, March.
    5. Davy Paindaveine & Miroslav Šiman, 2012. "Computing multiple-output regression quantile regions from projection quantiles," Computational Statistics, Springer, vol. 27(1), pages 29-49, March.
    6. Van Aelst, Stefan & Rousseeuw, Peter J. & Hubert, Mia & Struyf, Anja, 2002. "The Deepest Regression Method," Journal of Multivariate Analysis, Elsevier, vol. 81(1), pages 138-166, April.
    7. Mingxin Wu & Yijun Zuo, 2008. "Trimmed and winsorized standard deviations based on a scaled deviation," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 20(4), pages 319-335.
    8. Cuesta-Albertos, J.A. & Nieto-Reyes, A., 2008. "The random Tukey depth," Computational Statistics & Data Analysis, Elsevier, vol. 52(11), pages 4979-4988, July.
    9. Paindaveine, Davy & Šiman, Miroslav, 2012. "Computing multiple-output regression quantile regions," Computational Statistics & Data Analysis, Elsevier, vol. 56(4), pages 840-853.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Dyckerhoff, Rainer & Mozharovskyi, Pavlo, 2016. "Exact computation of the halfspace depth," Computational Statistics & Data Analysis, Elsevier, vol. 98(C), pages 19-30.
    2. Yijun Zuo, 2020. "Depth Induced Regression Medians and Uniqueness," Stats, MDPI, vol. 3(2), pages 1-13, April.
    3. Mia Hubert & Peter Rousseeuw & Pieter Segaert, 2015. "Multivariate functional outlier detection," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 24(2), pages 177-202, July.
    4. Victor Chernozhukov & Alfred Galichon & Marc Hallin & Marc Henry, 2014. "Monge-Kantorovich Depth, Quantiles, Ranks, and Signs," Papers 1412.8434, arXiv.org, revised Sep 2015.
    5. Victor Chernozhukov & Alfred Galichon & Marc Hallin & Marc Henry, 2014. "Monge-Kantorovich Depth, Quantiles, Ranks, and Signs," Papers 1412.8434, arXiv.org, revised Sep 2015.
    6. repec:hal:spmain:info:hdl:2441/3qnaslliat80pbqa8t90240unj is not listed on IDEAS
    7. repec:spo:wpmain:info:hdl:2441/64itsev5509q8aa5mrbhi0g0b6 is not listed on IDEAS
    8. Tian, Yahui & Gel, Yulia R., 2019. "Fusing data depth with complex networks: Community detection with prior information," Computational Statistics & Data Analysis, Elsevier, vol. 139(C), pages 99-116.
    9. Liu, Xiaohui & Zuo, Yijun & Wang, Zhizhong, 2013. "Exactly computing bivariate projection depth contours and median," Computational Statistics & Data Analysis, Elsevier, vol. 60(C), pages 1-11.
    10. repec:hal:spmain:info:hdl:2441/64itsev5509q8aa5mrbhi0g0b6 is not listed on IDEAS
    11. Zuo, Yijun, 2024. "Non-asymptotic robustness analysis of regression depth median," Journal of Multivariate Analysis, Elsevier, vol. 199(C).
    12. Debruyne, M. & Hubert, M. & Portnoy, S. & Vanden Branden, K., 2008. "Censored depth quantiles," Computational Statistics & Data Analysis, Elsevier, vol. 52(3), pages 1604-1614, January.
    13. Xiaohui Liu & Karl Mosler & Pavlo Mozharovskyi, 2017. "Fast computation of Tukey trimmed regions and median in dimension p > 2," Working Papers 2017-71, Center for Research in Economics and Statistics.
    14. Yijun Zuo, 2021. "Robustness of the deepest projection regression functional," Statistical Papers, Springer, vol. 62(3), pages 1167-1193, June.
    15. Kneib, Thomas & Silbersdorff, Alexander & Säfken, Benjamin, 2023. "Rage Against the Mean – A Review of Distributional Regression Approaches," Econometrics and Statistics, Elsevier, vol. 26(C), pages 99-123.
    16. Hamel, Andreas H. & Kostner, Daniel, 2022. "Computation of quantile sets for bivariate ordered data," Computational Statistics & Data Analysis, Elsevier, vol. 169(C).
    17. Mia Hubert & Peter Rousseeuw & Pieter Segaert, 2017. "Multivariate and functional classification using depth and distance," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 11(3), pages 445-466, September.
    18. Xiaohui Liu, 2017. "Fast implementation of the Tukey depth," Computational Statistics, Springer, vol. 32(4), pages 1395-1410, December.
    19. Montes-Rojas, Gabriel, 2017. "Reduced form vector directional quantiles," Journal of Multivariate Analysis, Elsevier, vol. 158(C), pages 20-30.
    20. Petrella, Lea & Raponi, Valentina, 2019. "Joint estimation of conditional quantiles in multivariate linear regression models with an application to financial distress," Journal of Multivariate Analysis, Elsevier, vol. 173(C), pages 70-84.
    21. Müller, Christine H., 2005. "Depth estimators and tests based on the likelihood principle with application to regression," Journal of Multivariate Analysis, Elsevier, vol. 95(1), pages 153-181, July.
    22. Pavel Boček & Miroslav Šiman, 2017. "On weighted and locally polynomial directional quantile regression," Computational Statistics, Springer, vol. 32(3), pages 929-946, September.
    23. Marc Hallin & Miroslav Šiman, 2016. "Multiple-Output Quantile Regression," Working Papers ECARES ECARES 2016-03, ULB -- Universite Libre de Bruxelles.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:158:y:2021:i:c:s0167947321000189. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.