IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v187y2023ics0167947323001299.html
   My bibliography  Save this article

Principal weighted least square support vector machine: An online dimension-reduction tool for binary classification

Author

Listed:
  • Jang, Hyun Jung
  • Shin, Seung Jun
  • Artemiou, Andreas

Abstract

As relevant technologies advance, streamed data are frequently encountered in various applications, and the need for scalable algorithms becomes urgent. In this article, we propose the principal weighted least square support vector machine (PWLSSVM) as a novel tool for SDR in binary classification where most SDR methods suffer since they assume continuous Y. We further show that the PWLSSVM can be employed for the online SDR for the streamed data. Namely, the PWLSSVM estimator can be directly updated from the new data without having old data. We explore the asymptotic properties of the PWLSSVM estimator and demonstrate its promising performance in terms of both estimation accuracy and computational efficiency for both simulated and real data.

Suggested Citation

  • Jang, Hyun Jung & Shin, Seung Jun & Artemiou, Andreas, 2023. "Principal weighted least square support vector machine: An online dimension-reduction tool for binary classification," Computational Statistics & Data Analysis, Elsevier, vol. 187(C).
    • Handle: RePEc:eee:csdana:v:187:y:2023:i:c:s0167947323001299
    DOI: 10.1016/j.csda.2023.107818
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947323001299
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2023.107818?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Seung Jun Shin & Yichao Wu & Hao Helen Zhang & Yufeng Liu, 2014. "Probability-enhanced sufficient dimension reduction for binary classification," Biometrics, The International Biometric Society, vol. 70(3), pages 546-555, September.
    2. Lexin Li, 2007. "Sparse sufficient dimension reduction," Biometrika, Biometrika Trust, vol. 94(3), pages 603-613.
    3. Marron, J.S. & Todd, Michael J. & Ahn, Jeongyoun, 2007. "Distance-Weighted Discrimination," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1267-1271, December.
    4. Shin, Seung Jun & Artemiou, Andreas, 2017. "Penalized principal logistic regression for sparse sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 111(C), pages 48-58.
    5. Yin, Xiangrong & Li, Bing & Cook, R. Dennis, 2008. "Successive direction extraction for estimating the central subspace in a multiple-index regression," Journal of Multivariate Analysis, Elsevier, vol. 99(8), pages 1733-1757, September.
    6. R. Dennis Cook & Liqiang Ni, 2006. "Using intraslice covariances for improved estimation of the central subspace in regression," Biometrika, Biometrika Trust, vol. 93(1), pages 65-74, March.
    7. Li, Bing & Wang, Shaoli, 2007. "On Directional Regression for Dimension Reduction," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 997-1008, September.
    8. Bura, E. & Pfeiffer, R., 2008. "On the distribution of the left singular vectors of a random matrix and its applications," Statistics & Probability Letters, Elsevier, vol. 78(15), pages 2275-2280, October.
    9. Seung Jun Shin & Yichao Wu & Hao Helen Zhang & Yufeng Liu, 2017. "Principal weighted support vector machines for sufficient dimension reduction in binary classification," Biometrika, Biometrika Trust, vol. 104(1), pages 67-81.
    10. Zhu, Li-Ping & Zhu, Li-Xing & Feng, Zheng-Hui, 2010. "Dimension Reduction in Regressions Through Cumulative Slicing Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 105(492), pages 1455-1466.
    11. Magnus, J.R. & Neudecker, H., 1979. "The commutation matrix : Some properties and applications," Other publications TiSEM d0b1e779-7795-4676-ac98-1, Tilburg University, School of Economics and Management.
    12. Pollard, David, 1991. "Asymptotics for Least Absolute Deviation Regression Estimators," Econometric Theory, Cambridge University Press, vol. 7(2), pages 186-199, June.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Hayley Randall & Andreas Artemiou & Xingye Qiao, 2021. "Sufficient dimension reduction based on distance‐weighted discrimination," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(4), pages 1186-1211, December.
    2. Wei Luo, 2022. "On efficient dimension reduction with respect to the interaction between two response variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 269-294, April.
    3. Qin Wang & Yuan Xue, 2023. "A structured covariance ensemble for sufficient dimension reduction," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 17(3), pages 777-800, September.
    4. Pircalabelu, Eugen & Artemiou, Andreas, 2020. "The LassoPSVM approach for sufficient dimension reduction using principal projections," LIDAM Discussion Papers ISBA 2020008, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    5. Wang, Qin & Xue, Yuan, 2021. "An ensemble of inverse moment estimators for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 161(C).
    6. Fang, Fang & Yu, Zhou, 2020. "Model averaging assisted sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    7. Pircalabelu, Eugen & Artemiou, Andreas, 2021. "Graph informed sliced inverse regression," Computational Statistics & Data Analysis, Elsevier, vol. 164(C).
    8. Zeng, Bilin & Yu, Zhou & Wen, Xuerong Meggie, 2015. "A note on cumulative mean estimation," Statistics & Probability Letters, Elsevier, vol. 96(C), pages 322-327.
    9. Yu, Zhou & Zhu, Lixing & Wen, Xuerong Meggie, 2012. "On model-free conditional coordinate tests for regressions," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 61-72.
    10. Li, Junlan & Wang, Tao, 2021. "Dimension reduction in binary response regression: A joint modeling approach," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    11. Stephen Babos & Andreas Artemiou, 2021. "Cumulative Median Estimation for Sufficient Dimension Reduction," Stats, MDPI, vol. 4(1), pages 1-8, February.
    12. Wang, Pei & Yin, Xiangrong & Yuan, Qingcong & Kryscio, Richard, 2021. "Feature filter for estimating central mean subspace and its sparse solution," Computational Statistics & Data Analysis, Elsevier, vol. 163(C).
    13. Lian, Heng & Li, Gaorong, 2014. "Series expansion for functional sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 124(C), pages 150-165.
    14. Shin, Seung Jun & Artemiou, Andreas, 2017. "Penalized principal logistic regression for sparse sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 111(C), pages 48-58.
    15. Fang Yao & Yichao Wu & Jialin Zou, 2016. "Probability-enhanced effective dimension reduction for classifying sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(1), pages 1-22, March.
    16. Seung Jun Shin & Yichao Wu & Hao Helen Zhang & Yufeng Liu, 2017. "Principal weighted support vector machines for sufficient dimension reduction in binary classification," Biometrika, Biometrika Trust, vol. 104(1), pages 67-81.
    17. Eliana Christou, 2020. "Robust dimension reduction using sliced inverse median regression," Statistical Papers, Springer, vol. 61(5), pages 1799-1818, October.
    18. Zifang Guo & Lexin Li & Wenbin Lu & Bing Li, 2015. "Groupwise Dimension Reduction via Envelope Method," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1515-1527, December.
    19. Zhou Yu & Yuexiao Dong & Li-Xing Zhu, 2016. "Trace Pursuit: A General Framework for Model-Free Variable Selection," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 813-821, April.
    20. Xie, Chuanlong & Zhu, Lixing, 2020. "Generalized kernel-based inverse regression methods for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 150(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:187:y:2023:i:c:s0167947323001299. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.