IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v182y2023ics0167947323000154.html
   My bibliography  Save this article

Order determination for spiked-type models with a divergent number of spikes

Author

Listed:
  • Zeng, Yicheng
  • Zhu, Lixing

Abstract

For large dimensional spiked models, the order (number of spikes) determination is an important issue for dimension reduction. The authors propose a generic criterion to estimate the order when the dimension is proportional to the sample size and the order is divergent as the dimension goes to infinity. To handle the divergence of the order, the criterion is defined by location-shift truncated eigenvalues, unlike the existing criteria. They suggest two versions of the criterion: the first defines an objective function that is a sequence of ridge ratios of the defined eigenvalues in order to have a clear separation between the ratio at the true order and other ratios; and the second uses an objective function of double ridge ratios to enhance such a separation. To alleviate the effect of the bias in the scale estimation when the order is large, an iterative procedure is utilized for the estimation. Numerical studies are conducted on spiked population models and spiked Fisher matrices to examine the finite sample performances of the proposed methods.

Suggested Citation

  • Zeng, Yicheng & Zhu, Lixing, 2023. "Order determination for spiked-type models with a divergent number of spikes," Computational Statistics & Data Analysis, Elsevier, vol. 182(C).
    • Handle: RePEc:eee:csdana:v:182:y:2023:i:c:s0167947323000154
    DOI: 10.1016/j.csda.2023.107704
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167947323000154
    Download Restriction: Full text for ScienceDirect subscribers only.
    File URL: https://libkey.io/10.1016/j.csda.2023.107704?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Johnstone, Iain M. & Lu, Arthur Yu, 2009. "On Consistency and Sparsity for Principal Components Analysis in High Dimensions," Journal of the American Statistical Association, American Statistical Association, vol. 104(486), pages 682-693.
    2. Passemier, Damien & Yao, Jianfeng, 2014. "Estimation of the number of spikes, possibly equal, in the high-dimensional case," Journal of Multivariate Analysis, Elsevier, vol. 127(C), pages 173-183.
    3. Liping Zhu & Tao Wang & Lixing Zhu & Louis Ferré, 2010. "Sufficient dimension reduction through discretization-expectation estimation," Biometrika, Biometrika Trust, vol. 97(2), pages 295-304.
    4. Zhu, Lixing & Miao, Baiqi & Peng, Heng, 2006. "On Sliced Inverse Regression With High-Dimensional Covariates," Journal of the American Statistical Association, American Statistical Association, vol. 101, pages 630-643, June.
    5. Baik, Jinho & Silverstein, Jack W., 2006. "Eigenvalues of large sample covariance matrices of spiked population models," Journal of Multivariate Analysis, Elsevier, vol. 97(6), pages 1382-1408, July.
    6. Damien Passemier & Zhaoyuan Li & Jianfeng Yao, 2017. "On estimation of the noise variance in high dimensional probabilistic principal component analysis," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 51-67, January.
    7. Xie, Junshan & Zeng, Yicheng & Zhu, Lixing, 2021. "Limiting laws for extreme eigenvalues of large-dimensional spiked Fisher matrices with a divergent number of spikes," Journal of Multivariate Analysis, Elsevier, vol. 184(C).
    8. Zhu, Xuehu & Guo, Xu & Wang, Tao & Zhu, Lixing, 2020. "Dimensionality determination: A thresholding double ridge ratio approach," Computational Statistics & Data Analysis, Elsevier, vol. 146(C).
    9. Wei Luo & Bing Li, 2016. "Combining eigenvalues and variation of eigenvectors for order determination," Biometrika, Biometrika Trust, vol. 103(4), pages 875-887.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wang, Qin & Xue, Yuan, 2021. "An ensemble of inverse moment estimators for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 161(C).
    2. Nordhausen, Klaus & Oja, Hannu & Tyler, David E., 2022. "Asymptotic and bootstrap tests for subspace dimension," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    3. Xie, Chuanlong & Zhu, Lixing, 2020. "Generalized kernel-based inverse regression methods for sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 150(C).
    4. Liusha Yang & Matthew R. Mckay & Romain Couillet, 2018. "High-Dimensional MVDR Beamforming: Optimized Solutions Based on Spiked Random Matrix Models," Post-Print hal-01957672, HAL.
    5. Wei Luo, 2022. "On efficient dimension reduction with respect to the interaction between two response variables," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(2), pages 269-294, April.
    6. Zhu, Xuehu & Guo, Xu & Wang, Tao & Zhu, Lixing, 2020. "Dimensionality determination: A thresholding double ridge ratio approach," Computational Statistics & Data Analysis, Elsevier, vol. 146(C).
    7. Yata, Kazuyoshi & Aoshima, Makoto, 2013. "PCA consistency for the power spiked model in high-dimensional settings," Journal of Multivariate Analysis, Elsevier, vol. 122(C), pages 334-354.
    8. Forzani, Liliana & Gieco, Antonella & Tolmasky, Carlos, 2017. "Likelihood ratio test for partial sphericity in high and ultra-high dimensions," Journal of Multivariate Analysis, Elsevier, vol. 159(C), pages 18-38.
    9. Fang, Fang & Yu, Zhou, 2020. "Model averaging assisted sufficient dimension reduction," Computational Statistics & Data Analysis, Elsevier, vol. 152(C).
    10. Feng, Zheng-Hui & Lin, Lu & Zhu, Ruo-Qing & Zhu, Li-Xing, 2018. "Nonparametric Variable Selection and Its Application to Additive Models," IRTG 1792 Discussion Papers 2018-002, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    11. Pircalabelu, Eugen & Artemiou, Andreas, 2021. "Graph informed sliced inverse regression," Computational Statistics & Data Analysis, Elsevier, vol. 164(C).
    12. Zhou, Jingke & Xu, Wangli & Zhu, Lixing, 2015. "Robust estimating equation-based sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 134(C), pages 99-118.
    13. Zhang, Xin & Wang, Chong & Wu, Yichao, 2018. "Functional envelope for model-free sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 163(C), pages 37-50.
    14. Rosember Guerra-Urzola & Katrijn Van Deun & Juan C. Vera & Klaas Sijtsma, 2021. "A Guide for Sparse PCA: Model Comparison and Applications," Psychometrika, Springer;The Psychometric Society, vol. 86(4), pages 893-919, December.
    15. Jianqing Fan & Yuan Liao & Martina Mincheva, 2013. "Large covariance estimation by thresholding principal orthogonal complements," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 75(4), pages 603-680, September.
    16. Virta, Joni, 2021. "Testing for subsphericity when n and p are of different asymptotic order," Statistics & Probability Letters, Elsevier, vol. 179(C).
    17. Zeng, Bilin & Yu, Zhou & Wen, Xuerong Meggie, 2015. "A note on cumulative mean estimation," Statistics & Probability Letters, Elsevier, vol. 96(C), pages 322-327.
    18. Guerra Urzola, Rosember & Van Deun, Katrijn & Vera, J. C. & Sijtsma, K., 2021. "A guide for sparse PCA : Model comparison and applications," Other publications TiSEM 4d35b931-7f49-444b-b92f-a, Tilburg University, School of Economics and Management.
    19. Chen, Canyi & Xu, Wangli & Zhu, Liping, 2022. "Distributed estimation in heterogeneous reduced rank regression: With application to order determination in sufficient dimension reduction," Journal of Multivariate Analysis, Elsevier, vol. 190(C).
    20. Lili Xia & Tingyu Lai & Zhongzhan Zhang, 2023. "An Adaptive-to-Model Test for Parametric Functional Single-Index Model," Mathematics, MDPI, vol. 11(8), pages 1-25, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:182:y:2023:i:c:s0167947323000154. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.