IDEAS home Printed from https://ideas.repec.org/a/wly/envmet/v33y2022i2ne2710.html
   My bibliography  Save this article

Scalable multiple changepoint detection for functional data sequences

Author

Listed:
  • Trevor Harris
  • Bo Li
  • J. Derek Tucker

Abstract

We propose the multiple changepoint isolation (MCI) method for detecting multiple changes in the mean and covariance of a functional process. We first introduce a pair of projections to represent the variability “between” and “within” the functional observations. We then present an augmented fused lasso procedure to split the projections into multiple regions robustly. These regions act to isolate each changepoint away from the others so that the powerful univariate CUSUM statistic can be applied region‐wise to identify the changepoints. Simulations show that our method accurately detects the number and locations of changepoints under many different scenarios. These include light and heavy tailed data, data with symmetric and skewed distributions, sparsely and densely sampled changepoints, and mean and covariance changes. We show that our method outperforms a recent multiple functional changepoint detector and several univariate changepoint detectors applied to our proposed projections. We also show that MCI is more robust than existing approaches and scales linearly with sample size. Finally, we demonstrate our method on a large time series of water vapor mixing ratio profiles from atmospheric emitted radiance interferometer measurements.

Suggested Citation

  • Trevor Harris & Bo Li & J. Derek Tucker, 2022. "Scalable multiple changepoint detection for functional data sequences," Environmetrics, John Wiley & Sons, Ltd., vol. 33(2), March.
  • Handle: RePEc:wly:envmet:v:33:y:2022:i:2:n:e2710
    DOI: 10.1002/env.2710
    as

    Download full text from publisher

    File URL: https://doi.org/10.1002/env.2710
    Download Restriction: no

    File URL: https://libkey.io/10.1002/env.2710?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    References listed on IDEAS

    as
    1. István Berkes & Robertas Gabrys & Lajos Horváth & Piotr Kokoszka, 2009. "Detecting changes in the mean of functional observations," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(5), pages 927-946, November.
    2. Oleksandr Gromenko & Piotr Kokoszka & Matthew Reimherr, 2017. "Detection of change in the spatiotemporal mean function," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(1), pages 29-50, January.
    3. Tucker, J. Derek & Wu, Wei & Srivastava, Anuj, 2013. "Generative models for functional data using phase and amplitude separation," Computational Statistics & Data Analysis, Elsevier, vol. 61(C), pages 50-66.
    4. Shang, Han Lin & Hyndman, Rob.J., 2011. "Nonparametric time series forecasting with dynamic updating," Mathematics and Computers in Simulation (MATCOM), Elsevier, vol. 81(7), pages 1310-1324.
    5. Zhuo Qu & Wenlin Dai & Marc G. Genton, 2021. "Robust functional multivariate analysis of variance with environmental applications," Environmetrics, John Wiley & Sons, Ltd., vol. 32(1), February.
    6. J.‐L. Chapman & I. A. Eckley & R. Killick, 2020. "A nonparametric approach to detecting changes in variance in locally stationary time series," Environmetrics, John Wiley & Sons, Ltd., vol. 31(1), February.
    7. F. Finazzi & A. Fassò & F. Madonna & I. Negri & B. Sun & M. Rosoldi, 2019. "Statistical harmonization and uncertainty assessment in the comparison of satellite and radiosonde climate variables," Environmetrics, John Wiley & Sons, Ltd., vol. 30(2), March.
    8. Paul Fearnhead & Guillem Rigaill, 2019. "Changepoint Detection in the Presence of Outliers," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 114(525), pages 169-183, January.
    9. Hyndman, Rob J. & Booth, Heather, 2008. "Stochastic population forecasts using functional data models for mortality, fertility and migration," International Journal of Forecasting, Elsevier, vol. 24(3), pages 323-342.
    10. Aston, John A.D. & Kirch, Claudia, 2012. "Detecting and estimating changes in dependent functional data," Journal of Multivariate Analysis, Elsevier, vol. 109(C), pages 204-220.
    11. Francesca Fortuna & Stefano Antonio Gattone & Tonio Di Battista, 2020. "Functional estimation of diversity profiles," Environmetrics, John Wiley & Sons, Ltd., vol. 31(8), December.
    12. MacEachern, Steven N. & Rao, Youlan & Wu, Chunjie, 2007. "A Robust-Likelihood Cumulative Sum Chart," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1440-1447, December.
    13. Robert Tibshirani & Michael Saunders & Saharon Rosset & Ji Zhu & Keith Knight, 2005. "Sparsity and smoothness via the fused lasso," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 67(1), pages 91-108, February.
    14. Aue, Alexander & Gabrys, Robertas & Horváth, Lajos & Kokoszka, Piotr, 2009. "Estimation of a change-point in the mean function of functional data," Journal of Multivariate Analysis, Elsevier, vol. 100(10), pages 2254-2269, November.
    15. D. Jarušková & J. Antoch, 2020. "Changepoint analysis of Klementinum temperature series," Environmetrics, John Wiley & Sons, Ltd., vol. 31(1), February.
    16. A. Aue & G. Rice & O. Sönmez, 2020. "Structural break analysis for spectrum and trace of covariance operators," Environmetrics, John Wiley & Sons, Ltd., vol. 31(1), February.
    17. Ngai Hang Chan & Chun Yip Yau & Rong-Mao Zhang, 2014. "Group LASSO for Structural Break Time Series," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 590-599, June.
    18. Fryzlewicz, Piotr, 2014. "Wild binary segmentation for multiple change-point detection," LSE Research Online Documents on Economics 57146, London School of Economics and Political Science, LSE Library.
    19. J. Lee & R. Lund & J. Woody & Y. Xu, 2020. "Trend assessment for daily snow depths with changepoint considerations," Environmetrics, John Wiley & Sons, Ltd., vol. 31(1), February.
    20. Alexander Aue & Gregory Rice & Ozan Sönmez, 2018. "Detecting and dating structural breaks in functional data without dimension reduction," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 80(3), pages 509-529, June.
    21. Shao, Xiaofeng & Zhang, Xianyang, 2010. "Testing for Change Points in Time Series," Journal of the American Statistical Association, American Statistical Association, vol. 105(491), pages 1228-1240.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Luke Durell & J. Thad Scott & Douglas Nychka & Amanda S. Hering, 2023. "Functional forecasting of dissolved oxygen in high‐frequency vertical lake profiles," Environmetrics, John Wiley & Sons, Ltd., vol. 34(4), June.
    2. J. Derek Tucker & Drew Yarger, 2024. "Elastic functional changepoint detection of climate impacts from localized sources," Environmetrics, John Wiley & Sons, Ltd., vol. 35(1), February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. J. Derek Tucker & Drew Yarger, 2024. "Elastic functional changepoint detection of climate impacts from localized sources," Environmetrics, John Wiley & Sons, Ltd., vol. 35(1), February.
    2. Cho, Haeran & Kirch, Claudia, 2024. "Data segmentation algorithms: Univariate mean change and beyond," Econometrics and Statistics, Elsevier, vol. 30(C), pages 76-95.
    3. Mengchen Wang & Trevor Harris & Bo Li, 2023. "Asynchronous Changepoint Estimation for Spatially Correlated Functional Time Series," Journal of Agricultural, Biological and Environmental Statistics, Springer;The International Biometric Society;American Statistical Association, vol. 28(1), pages 157-176, March.
    4. Jialiang Li & Yaguang Li & Tailen Hsing, 2022. "On functional processes with multiple discontinuities," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 84(3), pages 933-972, July.
    5. Horváth, Lajos & Rice, Gregory & Zhao, Yuqian, 2022. "Change point analysis of covariance functions: A weighted cumulative sum approach," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    6. Holger Dette & Kevin Kokot & Stanislav Volgushev, 2020. "Testing relevant hypotheses in functional time series via self‐normalization," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(3), pages 629-660, July.
    7. Stoehr, Christina & Aston, John A D & Kirch, Claudia, 2021. "Detecting changes in the covariance structure of functional time series with application to fMRI data," Econometrics and Statistics, Elsevier, vol. 18(C), pages 44-62.
    8. Han Lin Shang & Jiguo Cao & Peijun Sang, 2022. "Stopping time detection of wood panel compression: A functional time‐series approach," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 71(5), pages 1205-1224, November.
    9. Rice, Gregory & Zhang, Chi, 2022. "Consistency of binary segmentation for multiple change-point estimation with functional data," Statistics & Probability Letters, Elsevier, vol. 180(C).
    10. Buddhananda Banerjee & Satyaki Mazumder, 2018. "A more powerful test identifying the change in mean of functional data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 70(3), pages 691-715, June.
    11. Xu, Haotian & Wang, Daren & Zhao, Zifeng & Yu, Yi, 2022. "Change point inference in high-dimensional regression models under temporal dependence," LIDAM Discussion Papers ISBA 2022027, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    12. Tadas Danielius & Alfredas Račkauskas, 2022. "Multiple Change-Point Detection in a Functional Sample via the 𝒢-Sum Process," Mathematics, MDPI, vol. 10(13), pages 1-27, June.
    13. B. Cooper Boniece & Lajos Horv'ath & Lorenzo Trapani, 2023. "On changepoint detection in functional data using empirical energy distance," Papers 2310.04853, arXiv.org.
    14. Dennis Schroers, 2024. "Robust Functional Data Analysis for Stochastic Evolution Equations in Infinite Dimensions," Papers 2401.16286, arXiv.org, revised Jun 2024.
    15. Axel Bücher & Holger Dette & Florian Heinrichs, 2020. "Detecting deviations from second-order stationarity in locally stationary functional time series," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 72(4), pages 1055-1094, August.
    16. Magda Monteiro & Marco Costa, 2023. "Change Point Detection by State Space Modeling of Long-Term Air Temperature Series in Europe," Stats, MDPI, vol. 6(1), pages 1-18, January.
    17. Jiang, Feiyu & Zhao, Zifeng & Shao, Xiaofeng, 2023. "Time series analysis of COVID-19 infection curve: A change-point perspective," Journal of Econometrics, Elsevier, vol. 232(1), pages 1-17.
    18. van Delft, Anne & Eichler, Michael, 2017. "Locally Stationary Functional Time Series," LIDAM Discussion Papers ISBA 2017023, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    19. Casini, Alessandro & Perron, Pierre, 2024. "Change-point analysis of time series with evolutionary spectra," Journal of Econometrics, Elsevier, vol. 242(2).
    20. Jirak, Moritz, 2012. "Change-point analysis in increasing dimension," Journal of Multivariate Analysis, Elsevier, vol. 111(C), pages 136-159.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:wly:envmet:v:33:y:2022:i:2:n:e2710. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Wiley Content Delivery (email available below). General contact details of provider: http://www.interscience.wiley.com/jpages/1180-4009/ .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.