IDEAS home Printed from https://ideas.repec.org/a/spr/alstar/v108y2024i4d10.1007_s10182-023-00491-x.html
   My bibliography  Save this article

A note on sufficient dimension reduction with post dimension reduction statistical inference

Author

Listed:
  • Kyongwon Kim

    (Ewha Womans University)

Abstract

Sufficient dimension reduction is a widely used tool to extract core information hidden in high-dimensional data for classifying, clustering, and predicting response variables. Various dimension reduction methods and their applications have been introduced in the past decades. Data analysis using sufficient dimension reduction involves two steps: dimension reduction and model estimation. However, when we implement the two-step modeling process, we consider the estimated sufficient predictor as a true predictor variable and proceed to the model development step, which includes statistical inference such as estimating confidence intervals and performing hypothesis tests. However, the outcome obtained using this method is by no means complete because it contains errors only from the model estimation step. Therefore, post dimension reduction inference is an important topic because it is essential to consider errors from sufficient dimension reduction. In this paper, we review the fundamentals of sufficient dimension reduction methods. Then, we introduce an intuitive and heuristic approach for the recently developed post dimension reduction statistical inference.

Suggested Citation

  • Kyongwon Kim, 2024. "A note on sufficient dimension reduction with post dimension reduction statistical inference," AStA Advances in Statistical Analysis, Springer;German Statistical Society, vol. 108(4), pages 733-753, December.
    • Handle: RePEc:spr:alstar:v:108:y:2024:i:4:d:10.1007_s10182-023-00491-x
    DOI: 10.1007/s10182-023-00491-x
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s10182-023-00491-x
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s10182-023-00491-x?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Park, Yujin & Kim, Kyongwon & Yoo, Jae Keun, 2022. "On cross-distance selection algorithm for hybrid sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 176(C).
    2. Lexin Li, 2007. "Sparse sufficient dimension reduction," Biometrika, Biometrika Trust, vol. 94(3), pages 603-613.
    3. Qian Lin & Zhigen Zhao & Jun S. Liu, 2019. "Sparse Sliced Inverse Regression via Lasso," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(528), pages 1726-1739, October.
    4. Yanyuan Ma & Liping Zhu, 2012. "A Semiparametric Approach to Dimension Reduction," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 168-179, March.
    5. Li, Bing & Wang, Shaoli, 2007. "On Directional Regression for Dimension Reduction," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 997-1008, September.
    6. Efstathia Bura & R. Dennis Cook, 2001. "Estimating the structural dimension of regressions via parametric inverse regression," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 393-410.
    7. Kim, Kyongwon, 2022. "On principal graphical models with application to gene network," Computational Statistics & Data Analysis, Elsevier, vol. 166(C).
    8. Cook, R. Dennis & Ni, Liqiang, 2005. "Sufficient Dimension Reduction via Inverse Regression: A Minimum Discrepancy Approach," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 410-428, June.
    9. Yin, Xiangrong & Li, Bing & Cook, R. Dennis, 2008. "Successive direction extraction for estimating the central subspace in a multiple-index regression," Journal of Multivariate Analysis, Elsevier, vol. 99(8), pages 1733-1757, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Weng, Jiaying, 2022. "Fourier transform sparse inverse regression estimators for sufficient variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    2. Wang, Pei & Yin, Xiangrong & Yuan, Qingcong & Kryscio, Richard, 2021. "Feature filter for estimating central mean subspace and its sparse solution," Computational Statistics & Data Analysis, Elsevier, vol. 163(C).
    3. Lu Li & Kai Tan & Xuerong Meggie Wen & Zhou Yu, 2023. "Variable-dependent partial dimension reduction," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(2), pages 521-541, June.
    4. Fang, Fang & Yu, Zhou, 2020. "Model averaging assisted sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    5. Sabrina Duarte & Liliana Forzani & Pamela Llop & Rodrigo García Arancibia & Diego Tomassi, 2023. "Socioeconomic Index for Income and Poverty Prediction: A Sufficient Dimension Reduction Approach," Review of Income and Wealth, International Association for Research in Income and Wealth, vol. 69(2), pages 318-346, June.
    6. Forzani, Liliana & García Arancibia, Rodrigo & Llop, Pamela & Tomassi, Diego, 2018. "Supervised dimension reduction for ordinal predictors," Computational Statistics & Data Analysis, Elsevier, vol. 125(C), pages 136-155.
    7. Zifang Guo & Lexin Li & Wenbin Lu & Bing Li, 2015. "Groupwise Dimension Reduction via Envelope Method," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(512), pages 1515-1527, December.
    8. Yu, Zhou & Zhu, Lixing & Wen, Xuerong Meggie, 2012. "On model-free conditional coordinate tests for regressions," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 61-72.
    9. Wu, Runxiong & Chen, Xin, 2021. "MM algorithms for distance covariance based sufficient dimension reduction and sufficient variable selection," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    10. Wei Luo, 2022. "On efficient dimension reduction with respect to the interaction between two response variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 269-294, April.
    11. Scrucca, Luca, 2011. "Model-based SIR for dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 55(11), pages 3010-3026, November.
    12. Sheng, Wenhui & Yin, Xiangrong, 2013. "Direction estimation in single-index models via distance covariance," Journal of Multivariate Analysis, Elsevier, vol. 122(C), pages 148-161.
    13. Wang, Qin & Xue, Yuan, 2021. "An ensemble of inverse moment estimators for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 161(C).
    14. Li‐Ping Zhu & Li‐Xing Zhu, 2009. "On distribution‐weighted partial least squares with diverging number of highly correlated predictors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 525-548, April.
    15. Lian, Heng & Li, Gaorong, 2014. "Series expansion for functional sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 124(C), pages 150-165.
    16. Luo, Wei & Cai, Xizhen, 2016. "A new estimator for efficient dimension reduction in regression," Journal of Multivariate Analysis, Elsevier, vol. 145(C), pages 236-249.
    17. Liliana Forzani & Daniela Rodriguez & Mariela Sued, 2024. "Asymptotic results for nonparametric regression estimators after sufficient dimension reduction estimation," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 33(4), pages 987-1013, December.
    18. Hyung Park & Thaddeus Tarpey & Eva Petkova & R. Todd Ogden, 2024. "A high-dimensional single-index regression for interactions between treatment and covariates," Statistical Papers, Springer, vol. 65(7), pages 4025-4056, September.
    19. Yu, Zhou & Dong, Yuexiao & Huang, Mian, 2014. "General directional regression," Journal of Multivariate Analysis, Elsevier, vol. 124(C), pages 94-104.
    20. Andrea Bergesio & María Eugenia Szretter Noste & Víctor J. Yohai, 2021. "A robust proposal of estimation for the sufficient dimension reduction problem," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 30(3), pages 758-783, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:alstar:v:108:y:2024:i:4:d:10.1007_s10182-023-00491-x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.