IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v189y2022ics0047259x21002050.html
   My bibliography  Save this article

Spatial rank-based high-dimensional change point detection via random integration

Author

Listed:
  • Shu, Lei
  • Chen, Yu
  • Zhang, Weiping
  • Wang, Xueqin

Abstract

Detecting change points is an important task to identify an abrupt and significant change in the data generating process. Traditional change point detection methods are not applicable in high-dimensional situations due to many obstacles, such as the requirement of normality or the estimation of the covariance matrix. This paper presented a novel nonparametric method to overcome such issues by using the random integration with spatial ranks, which is tailored to high-dimensional change point detection problems. The proposed method is a unified framework that includes and extends many existing methods and can effectively handle high-dimensional non-normal data, whose asymptotic properties are established under mild conditions. In addition, we developed a computationally efficient algorithm to calculate the rejection thresholds and an effective post-signal diagnostic procedure to identify the potential directions. Finally, numerical studies together with real data examples demonstrated that the proposed method can identify the change point efficiently.

Suggested Citation

  • Shu, Lei & Chen, Yu & Zhang, Weiping & Wang, Xueqin, 2022. "Spatial rank-based high-dimensional change point detection via random integration," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    • Handle: RePEc:eee:jmvana:v:189:y:2022:i:c:s0047259x21002050
    DOI: 10.1016/j.jmva.2021.104942
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X21002050
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2021.104942?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Long Feng & Changliang Zou & Zhaojun Wang, 2016. "Multivariate-Sign-Based High-Dimensional Tests for the Two-Sample Location Problem," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(514), pages 721-735, April.
    2. Klaus Frick & Axel Munk & Hannes Sieling, 2014. "Multiscale change point inference," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(3), pages 495-580, June.
    3. Biman Chakraborty & Probul Chaudhuri, 1998. "On an adaptive transformation–retransformation estimate of multivariate location," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 60(1), pages 145-157.
    4. Graham, M.A. & Chakraborti, S. & Human, S.W., 2011. "A nonparametric exponentially weighted moving average signed-rank chart for monitoring location," Computational Statistics & Data Analysis, Elsevier, vol. 55(8), pages 2490-2503, August.
    5. Axel Gandy & Jan Terje Kvaløy, 2013. "Guaranteed Conditional Performance of Control Charts via Bootstrap Methods," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 40(4), pages 647-668, December.
    6. Changliang Zou & Zhaojun Wang & Fugee Tsung, 2012. "A spatial rank‐based multivariate EWMA control chart," Naval Research Logistics (NRL), John Wiley & Sons, vol. 59(2), pages 91-110, March.
    7. Haeran Cho & Piotr Fryzlewicz, 2015. "Multiple-change-point detection for high dimensional time series via sparsified binary segmentation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 77(2), pages 475-507, March.
    8. Jin-Ting Zhang & Jia Guo & Bu Zhou & Ming-Yen Cheng, 2020. "A Simple Two-Sample Test in High Dimensions Based on L2-Norm," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 115(530), pages 1011-1027, April.
    9. Cho, Haeran & Fryzlewicz, Piotr, 2015. "Multiple-change-point detection for high dimensional time series via sparsified binary segmentation," LSE Research Online Documents on Economics 57147, London School of Economics and Political Science, LSE Library.
    10. Staudacher, M. & Telser, S. & Amann, A. & Hinterhuber, H. & Ritsch-Marte, M., 2005. "A new method for change-point detection developed for on-line analysis of the heart beat variability during sleep," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 349(3), pages 582-596.
    11. Venkata Jandhyala & Stergios Fotopoulos & Ian MacNeill & Pengyu Liu, 2013. "Inference for single and multiple change-points in time series," Journal of Time Series Analysis, Wiley Blackwell, vol. 34(4), pages 423-446, July.
    12. Bai, Jushan, 1997. "Estimating Multiple Breaks One at a Time," Econometric Theory, Cambridge University Press, vol. 13(3), pages 315-352, June.
    13. Chib, Siddhartha, 1998. "Estimation and comparison of multiple change-point models," Journal of Econometrics, Elsevier, vol. 86(2), pages 221-241, June.
    14. Jushan Bai & Pierre Perron, 2003. "Computation and analysis of multiple structural change models," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 18(1), pages 1-22.
    15. Bai, Jushan, 2010. "Common breaks in means and variances for panel data," Journal of Econometrics, Elsevier, vol. 157(1), pages 78-92, July.
    16. T. Tony Cai & Weidong Liu & Yin Xia, 2014. "Two-sample test of high dimensional means under dependence," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(2), pages 349-372, March.
    17. Marc Lavielle & Gilles Teyssière, 2007. "Adaptive Detection of Multiple Change-Points in Asset Price Volatility," Springer Books, in: Gilles Teyssière & Alan P. Kirman (ed.), Long Memory in Economics, pages 129-156, Springer.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Likai & Wang, Weining & Wu, Wei Biao, 2019. "Inference of Break-Points in High-Dimensional Time Series," IRTG 1792 Discussion Papers 2019-013, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    2. Venkata Jandhyala & Stergios Fotopoulos & Ian MacNeill & Pengyu Liu, 2013. "Inference for single and multiple change-points in time series," Journal of Time Series Analysis, Wiley Blackwell, vol. 34(4), pages 423-446, July.
    3. Cho, Haeran & Kirch, Claudia, 2024. "Data segmentation algorithms: Univariate mean change and beyond," Econometrics and Statistics, Elsevier, vol. 30(C), pages 76-95.
    4. Pang, Tianxiao & Du, Lingjie & Chong, Terence Tai-Leung, 2021. "Estimating multiple breaks in nonstationary autoregressive models," Journal of Econometrics, Elsevier, vol. 221(1), pages 277-311.
    5. Lijing Ma & Andrew J. Grant & Georgy Sofronov, 2020. "Multiple change point detection and validation in autoregressive time series data," Statistical Papers, Springer, vol. 61(4), pages 1507-1528, August.
    6. Holger Dette & Dominik Wied, 2016. "Detecting relevant changes in time series models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 78(2), pages 371-394, March.
    7. Holger Dette & Theresa Eckle & Mathias Vetter, 2020. "Multiscale change point detection for dependent data," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1243-1274, December.
    8. Barigozzi, Matteo & Trapani, Lorenzo, 2020. "Sequential testing for structural stability in approximate factor models," Stochastic Processes and their Applications, Elsevier, vol. 130(8), pages 5149-5187.
    9. Duan, Jiangtao & Bai, Jushan & Han, Xu, 2023. "Quasi-maximum likelihood estimation of break point in high-dimensional factor models," Journal of Econometrics, Elsevier, vol. 233(1), pages 209-236.
    10. Wu Wang & Xuming He & Zhongyi Zhu, 2020. "Statistical inference for multiple change‐point models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 47(4), pages 1149-1170, December.
    11. Baltagi, Badi H. & Feng, Qu & Kao, Chihwa, 2016. "Estimation of heterogeneous panels with structural breaks," Journal of Econometrics, Elsevier, vol. 191(1), pages 176-195.
    12. Qing Yang & Yu-Ning Li & Yi Zhang, 2020. "Change point detection for nonparametric regression under strongly mixing process," Statistical Papers, Springer, vol. 61(4), pages 1465-1506, August.
    13. Alessandro Casini & Pierre Perron, 2018. "Structural Breaks in Time Series," Boston University - Department of Economics - Working Papers Series WP2019-02, Boston University - Department of Economics.
    14. Georges Dionne & Olfa Maalaoui Chun, 2013. "Default and liquidity regimes in the bond market during the 2002-2012 period," Canadian Journal of Economics, Canadian Economics Association, vol. 46(4), pages 1160-1195, November.
    15. Ma, Chenchen & Tu, Yundong, 2023. "Group fused Lasso for large factor models with multiple structural breaks," Journal of Econometrics, Elsevier, vol. 233(1), pages 132-154.
    16. Neil Hwang & Jiarui Xu & Shirshendu Chatterjee & Sharmodeep Bhattacharyya, 2022. "The Bethe Hessian and Information Theoretic Approaches for Online Change-Point Detection in Network Data," Sankhya A: The Indian Journal of Statistics, Springer;Indian Statistical Institute, vol. 84(1), pages 283-320, June.
    17. Mengjia Yu & Xiaohui Chen, 2021. "Finite sample change point inference and identification for high‐dimensional mean vectors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 83(2), pages 247-270, April.
    18. Hajra Siddiqa & Sajid Ali & Ismail Shah, 2021. "Most recent changepoint detection in censored panel data," Computational Statistics, Springer, vol. 36(1), pages 515-540, March.
    19. Otilia Boldea & Bettina Drepper & Zhuojiong Gan, 2020. "Change point estimation in panel data with time‐varying individual effects," Journal of Applied Econometrics, John Wiley & Sons, Ltd., vol. 35(6), pages 712-727, September.
    20. Ivor Cribben & Yi Yu, 2017. "Estimating whole-brain dynamics by using spectral clustering," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 66(3), pages 607-627, April.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:189:y:2022:i:c:s0047259x21002050. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.