IDEAS home Printed from https://ideas.repec.org/a/bla/stanee/v78y2024i2p374-396.html
   My bibliography  Save this article

Semiparametric recovery of central dimension reduction space with nonignorable nonresponse

Author

Listed:
  • Siming Zheng
  • Alan T. K. Wan
  • Yong Zhou

Abstract

Sufficient dimension reduction (SDR) methods are effective tools for handling high dimensional data. Classical SDR methods are developed under the assumption that the data are completely observed. When the data are incomplete due to missing values, SDR has only been considered when the data are randomly missing, but not when they are nonignorably missing, which is arguably more difficult to handle due to the missing values' dependence on the reasons they are missing. The purpose of this paper is to fill this void. We propose an intuitive, easy‐to‐implement SDR estimator based on a semiparametric propensity score function for response data with non‐ignorable missing values. We refer to it as the dimension reduction‐based imputed estimator. We establish the theoretical properties of this estimator and examine its empirical performance via an extensive numerical study on real and simulated data. As well, we compare the performance of our proposed dimension reduction‐based imputed estimator with two competing estimators, including the fusion refined estimator and cumulative slicing estimator. A distinguishing feature of our method is that it requires no validation sample. The SDR theory developed in this paper is a non‐trivial extension of the existing literature, due to the technical challenges posed by nonignorable missingness. All the technical proofs of the theorems are given in the Appendix S1.

Suggested Citation

  • Siming Zheng & Alan T. K. Wan & Yong Zhou, 2024. "Semiparametric recovery of central dimension reduction space with nonignorable nonresponse," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 78(2), pages 374-396, May.
    • Handle: RePEc:bla:stanee:v:78:y:2024:i:2:p:374-396
    DOI: 10.1111/stan.12321
    as

    Download full text from publisher

    File URL: https://doi.org/10.1111/stan.12321
    Download Restriction: no
    File URL: https://libkey.io/10.1111/stan.12321?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. Hansen, Lars Peter, 1982. "Large Sample Properties of Generalized Method of Moments Estimators," Econometrica, Econometric Society, vol. 50(4), pages 1029-1054, July.
    2. repec:mpr:mprres:8160 is not listed on IDEAS
    3. Li, Lexin & Lu, Wenbin, 2008. "Sufficient Dimension Reduction With Missing Predictors," Journal of the American Statistical Association, American Statistical Association, vol. 103, pages 822-831, June.
    4. Ding, Xiaobo & Wang, Qihua, 2011. "Fusion-Refinement Procedure for Dimension Reduction With Missing Response at Random," Journal of the American Statistical Association, American Statistical Association, vol. 106(495), pages 1193-1207.
    5. Guo, Xu & Wang, Tao & Xu, Wangli & Zhu, Lixing, 2014. "Dimension reduction with missing response at random," Computational Statistics & Data Analysis, Elsevier, vol. 69(C), pages 228-242.
    6. Xuerong Chen & Alan T. K. Wan & Yong Zhou, 2015. "Efficient Quantile Regression Analysis With Missing Observations," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 110(510), pages 723-741, June.
    7. Zhu, Li-Ping & Zhu, Li-Xing & Feng, Zheng-Hui, 2010. "Dimension Reduction in Regressions Through Cumulative Slicing Estimation," Journal of the American Statistical Association, American Statistical Association, vol. 105(492), pages 1455-1466.
    8. Puying Zhao & Lei Wang & Jun Shao, 2019. "Empirical likelihood and Wilks phenomenon for data with nonignorable missing values," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 46(4), pages 1003-1024, December.
    9. Yanyuan Ma & Liping Zhu, 2012. "A Semiparametric Approach to Dimension Reduction," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 107(497), pages 168-179, March.
    10. Dong, Yuexiao & Xia, Qi & Tang, Cheng Yong & Li, Zeda, 2018. "On sufficient dimension reduction with missing responses through estimating equations," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 67-77.
    11. Jun Shao & Lei Wang, 2016. "Semiparametric inverse propensity weighting for nonignorable missing data," Biometrika, Biometrika Trust, vol. 103(1), pages 175-187.
    12. Deng, Jianqiu & Yang, Xiaojie & Wang, Qihua, 2022. "Surrogate space based dimension reduction for nonignorable nonresponse," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    13. Wang, Lei & Zhao, Puying & Shao, Jun, 2021. "Dimension-reduced semiparametric estimation of distribution functions and quantiles with nonignorable nonresponse," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    14. Kim, Jae Kwang & Yu, Cindy Long, 2011. "A Semiparametric Estimation of Mean Functionals With Nonignorable Missing Data," Journal of the American Statistical Association, American Statistical Association, vol. 106(493), pages 157-165.
    15. Liping Zhu & Tao Wang & Lixing Zhu & Louis Ferré, 2010. "Sufficient dimension reduction through discretization-expectation estimation," Biometrika, Biometrika Trust, vol. 97(2), pages 295-304.
    16. Li, Bing & Wang, Shaoli, 2007. "On Directional Regression for Dimension Reduction," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 997-1008, September.
    17. Zhou, Yong & Wan, Alan T. K & Wang, Xiaojing, 2008. "Estimating Equations Inference With Missing Data," Journal of the American Statistical Association, American Statistical Association, vol. 103(483), pages 1187-1199.
    18. Yanyuan Ma & Liping Zhu, 2013. "A Review on Dimension Reduction," International Statistical Review, International Statistical Institute, vol. 81(1), pages 134-150, April.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Deng, Jianqiu & Yang, Xiaojie & Wang, Qihua, 2022. "Surrogate space based dimension reduction for nonignorable nonresponse," Computational Statistics & Data Analysis, Elsevier, vol. 168(C).
    2. Wang, Lei & Zhao, Puying & Shao, Jun, 2021. "Dimension-reduced semiparametric estimation of distribution functions and quantiles with nonignorable nonresponse," Computational Statistics & Data Analysis, Elsevier, vol. 156(C).
    3. Lei Wang, 2019. "Dimension reduction for kernel-assisted M-estimators with missing response at random," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(4), pages 889-910, August.
    4. Dong, Yuexiao & Xia, Qi & Tang, Cheng Yong & Li, Zeda, 2018. "On sufficient dimension reduction with missing responses through estimating equations," Computational Statistics & Data Analysis, Elsevier, vol. 126(C), pages 67-77.
    5. Majid Mojirsheibani, 2024. "Strong optimality of kernel functional regression in $$L^p$$ L p norms with partial response variables and applications," Statistical Papers, Springer, vol. 65(9), pages 5615-5648, December.
    6. Tang, Cheng Yong, 2024. "A model specification test for semiparametric nonignorable missing data modeling," Econometrics and Statistics, Elsevier, vol. 30(C), pages 124-132.
    7. Guo, Xu & Wang, Tao & Xu, Wangli & Zhu, Lixing, 2014. "Dimension reduction with missing response at random," Computational Statistics & Data Analysis, Elsevier, vol. 69(C), pages 228-242.
    8. Wei Luo, 2022. "On efficient dimension reduction with respect to the interaction between two response variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 269-294, April.
    9. Chen, Canyi & Xu, Wangli & Zhu, Liping, 2022. "Distributed estimation in heterogeneous reduced rank regression: With application to order determination in sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    10. Hung Hung & Su‐Yun Huang, 2019. "Sufficient dimension reduction via random‐partitions for the large‐p‐small‐n problem," Biometrics, The International Biometric Society, vol. 75(1), pages 245-255, March.
    11. Zhang, Ting & Wang, Lei, 2020. "Smoothed empirical likelihood inference and variable selection for quantile regression with nonignorable missing response," Computational Statistics & Data Analysis, Elsevier, vol. 144(C).
    12. Aiai Yu & Yujie Zhong & Xingdong Feng & Ying Wei, 2023. "Quantile regression for nonignorable missing data with its application of analyzing electronic medical records," Biometrics, The International Biometric Society, vol. 79(3), pages 2036-2049, September.
    13. Jingxuan Guo & Fuguo Liu & Wolfgang Karl Härdle & Xueliang Zhang & Kai Wang & Ting Zeng & Liping Yang & Maozai Tian, 2023. "Sampling Importance Resampling Algorithm with Nonignorable Missing Response Variable Based on Smoothed Quantile Regression," Mathematics, MDPI, vol. 11(24), pages 1-30, December.
    14. Ming-Yueh Huang & Chin-Tsang Chiang, 2017. "An Effective Semiparametric Estimation Approach for the Sufficient Dimension Reduction Model," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 112(519), pages 1296-1310, July.
    15. Wang, Qin & Xue, Yuan, 2021. "An ensemble of inverse moment estimators for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 161(C).
    16. Yujing Shao & Lei Wang, 2022. "Generalized partial linear models with nonignorable dropouts," Metrika: International Journal for Theoretical and Applied Statistics, Springer, vol. 85(2), pages 223-252, February.
    17. Lian, Heng & Li, Gaorong, 2014. "Series expansion for functional sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 124(C), pages 150-165.
    18. Lu Li & Kai Tan & Xuerong Meggie Wen & Zhou Yu, 2023. "Variable-dependent partial dimension reduction," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 32(2), pages 521-541, June.
    19. Lei Wang & Wei Ma, 2021. "Improved empirical likelihood inference and variable selection for generalized linear models with longitudinal nonignorable dropouts," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(3), pages 623-647, June.
    20. Wenquan Cui & Jianjun Xu & Yuehua Wu, 2023. "A new reproducing kernel‐based nonlinear dimension reduction method for survival data," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 50(3), pages 1365-1390, September.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bla:stanee:v:78:y:2024:i:2:p:374-396. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.blackwellpublishing.com/journal.asp?ref=0039-0402 .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.