IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v156y2021ics016794732030222x.html
   My bibliography  Save this article

Dimension reduction in binary response regression: A joint modeling approach

Author

Listed:
  • Li, Junlan
  • Wang, Tao

Abstract

Categorical responses cause no conceptual complications for dimension reduction in regression, but the performance of some methods may suffer in this context and hence supervised dimension reduction in practice must recognize the nature of the response. Using a continuous latent variable to represent an unobserved response underlying the binary response, a joint model is proposed for dimension reduction in binary regression. The minimal sufficient linear reduction is obtained, and an efficient expectation maximization algorithm is developed for carrying out maximum likelihood estimation. Simulated examples and an application to a dataset concerning the identification of handwritten digits are presented to compare the performance of the proposed method with that of existing methods.

Suggested Citation

  • Li, Junlan & Wang, Tao, 2021. "Dimension reduction in binary response regression: A joint modeling approach," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    • Handle: RePEc:eee:csdana:v:156:y:2021:i:c:s016794732030222x
    DOI: 10.1016/j.csda.2020.107131
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S016794732030222X
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2020.107131?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cook, R. Dennis & Forzani, Liliana, 2009. "Likelihood-Based Sufficient Dimension Reduction," Journal of the American Statistical Association, American Statistical Association, vol. 104(485), pages 197-208.
    2. Efstathia Bura & Sabrina Duarte & Liliana Forzani, 2016. "Sufficient Reductions in Regressions With Exponential Family Inverse Predictors," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(515), pages 1313-1329, July.
    3. Seung Jun Shin & Yichao Wu & Hao Helen Zhang & Yufeng Liu, 2014. "Probability-enhanced sufficient dimension reduction for binary classification," Biometrics, The International Biometric Society, vol. 70(3), pages 546-555, September.
    4. Li, Bing & Wang, Shaoli, 2007. "On Directional Regression for Dimension Reduction," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 997-1008, September.
    5. Efstathia Bura & R. Dennis Cook, 2001. "Estimating the structural dimension of regressions via parametric inverse regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 393-410.
    6. Forzani, Liliana & García Arancibia, Rodrigo & Llop, Pamela & Tomassi, Diego, 2018. "Supervised dimension reduction for ordinal predictors," Computational Statistics & Data Analysis, Elsevier, vol. 125(C), pages 136-155.
    7. Seung Jun Shin & Yichao Wu & Hao Helen Zhang & Yufeng Liu, 2017. "Principal weighted support vector machines for sufficient dimension reduction in binary classification," Biometrika, Biometrika Trust, vol. 104(1), pages 67-81.
    8. Tao Wang & Can Yang & Hongyu Zhao, 2019. "Prediction analysis for microbiome sequencing data," Biometrics, The International Biometric Society, vol. 75(3), pages 875-884, September.
    9. Efstathia Bura & Liliana Forzani, 2015. "Sufficient Reductions in Regressions With Elliptically Contoured Inverse Predictors," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(509), pages 420-434, March.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Sabrina Duarte & Liliana Forzani & Pamela Llop & Rodrigo García Arancibia & Diego Tomassi, 2023. "Socioeconomic Index for Income and Poverty Prediction: A Sufficient Dimension Reduction Approach," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 69(2), pages 318-346, June.
    2. Kapla, Daniel & Fertl, Lukas & Bura, Efstathia, 2022. "Fusing sufficient dimension reduction with neural networks," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    3. Andrea Bergesio & María Eugenia Szretter Noste & Víctor J. Yohai, 2021. "A robust proposal of estimation for the sufficient dimension reduction problem," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(3), pages 758-783, September.
    4. Forzani, Liliana & García Arancibia, Rodrigo & Llop, Pamela & Tomassi, Diego, 2018. "Supervised dimension reduction for ordinal predictors," Computational Statistics & Data Analysis, Elsevier, vol. 125(C), pages 136-155.
    5. Forzani, Liliana & Rodriguez, Daniela & Smucler, Ezequiel & Sued, Mariela, 2019. "Sufficient dimension reduction and prediction in regression: Asymptotic results," Journal of Multivariate Analysis, Elsevier, vol. 171(C), pages 339-349.
    6. Scrucca, Luca, 2011. "Model-based SIR for dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 55(11), pages 3010-3026, November.
    7. Szretter Noste, María Eugenia, 2019. "Using DAGs to identify the sufficient dimension reduction in the Principal Fitted Components model," Statistics & Probability Letters, Elsevier, vol. 145(C), pages 317-320.
    8. Lu Li & Kai Tan & Xuerong Meggie Wen & Zhou Yu, 2023. "Variable-dependent partial dimension reduction," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(2), pages 521-541, June.
    9. Alessandro Barbarino & Efstathia Bura, 2017. "A Unified Framework for Dimension Reduction in Forecasting," Finance and Economics Discussion Series 2017-004, Board of Governors of the Federal Reserve System (U.S.).
    10. repec:jss:jstsof:39:i03 is not listed on IDEAS
    11. Jang, Hyun Jung & Shin, Seung Jun & Artemiou, Andreas, 2023. "Principal weighted least square support vector machine: An online dimension-reduction tool for binary classification," Computational Statistics & Data Analysis, Elsevier, vol. 187(C).
    12. Wei Luo, 2022. "On efficient dimension reduction with respect to the interaction between two response variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 269-294, April.
    13. Qin Wang & Yuan Xue, 2023. "A structured covariance ensemble for sufficient dimension reduction," Advances in Data Analysis and Classification, Springer;German Classification Society - Gesellschaft für Klassifikation (GfKl);Japanese Classification Society (JCS);Classification and Data Analysis Group of the Italian Statistical Society (CLADAG);International Federation of Classification Societies (IFCS), vol. 17(3), pages 777-800, September.
    14. Xu Guo & Tao Wang & Lixing Zhu, 2016. "Model checking for parametric single-index models: a dimension reduction model-adaptive approach," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(5), pages 1013-1035, November.
    15. Wang, Pei & Yin, Xiangrong & Yuan, Qingcong & Kryscio, Richard, 2021. "Feature filter for estimating central mean subspace and its sparse solution," Computational Statistics & Data Analysis, Elsevier, vol. 163(C).
    16. Sheng, Wenhui & Yin, Xiangrong, 2013. "Direction estimation in single-index models via distance covariance," Journal of Multivariate Analysis, Elsevier, vol. 122(C), pages 148-161.
    17. Alessandro Barbarino & Efstathia Bura, 2015. "Forecasting with Sufficient Dimension Reductions," Finance and Economics Discussion Series 2015-74, Board of Governors of the Federal Reserve System (U.S.).
    18. Diego Tomassi & Liliana Forzani & Efstathia Bura & Ruth Pfeiffer, 2017. "Sufficient dimension reduction for censored predictors," Biometrics, The International Biometric Society, vol. 73(1), pages 220-231, March.
    19. Hayley Randall & Andreas Artemiou & Xingye Qiao, 2021. "Sufficient dimension reduction based on distance‐weighted discrimination," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 48(4), pages 1186-1211, December.
    20. Wang, Qin & Xue, Yuan, 2021. "An ensemble of inverse moment estimators for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 161(C).
    21. Li‐Ping Zhu & Li‐Xing Zhu, 2009. "On distribution‐weighted partial least squares with diverging number of highly correlated predictors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 525-548, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:156:y:2021:i:c:s016794732030222x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.