IDEAS home Printed from https://ideas.repec.org/a/spr/testjl/v29y2020i1d10.1007_s11749-019-00655-5.html
   My bibliography  Save this article

Oracally efficient estimation for dense functional data with holiday effects

Author

Listed:
  • Li Cai

    (Zhejiang Gongshang University)

  • Lisha Li

    (Tsinghua University)

  • Simin Huang

    (Tsinghua University)

  • Liang Ma

    (Tsinghua University)

  • Lijian Yang

    (Tsinghua University)

Abstract

Existing functional data analysis literature has mostly overlooked data with spikes in mean, such as weekly sporting goods sales by a salesperson which spikes around holidays. For such functional data, two-step estimation procedures are formulated for the population mean function and holiday effect parameters, which correspond to the population sales curve and the spikes in sales during holiday times. The estimators are based on spline smoothing for individual trajectories using non-holiday observations, and are shown to be oracally efficient in the sense that both the mean function and holiday effects are estimated as efficiently as if all individual trajectories were known a priori. Consequently, an asymptotic simultaneous confidence band is established for the mean function and confidence intervals for holiday effects, respectively. Two sample extensions are also formulated and simulation experiments provide strong evidence that corroborates the asymptotic theory. Application to sporting goods sales data has led to a number of new discoveries.

Suggested Citation

  • Li Cai & Lisha Li & Simin Huang & Liang Ma & Lijian Yang, 2020. "Oracally efficient estimation for dense functional data with holiday effects," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(1), pages 282-306, March.
  • Handle: RePEc:spr:testjl:v:29:y:2020:i:1:d:10.1007_s11749-019-00655-5
    DOI: 10.1007/s11749-019-00655-5
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11749-019-00655-5
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11749-019-00655-5?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Wei Biao Wu & Zhibiao Zhao, 2007. "Inference of trends in time series," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(3), pages 391-410, June.
    2. Haeran Cho & Piotr Fryzlewicz, 2015. "Multiple-change-point detection for high dimensional time series via sparsified binary segmentation," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 77(2), pages 475-507, March.
    3. Schroeder, Anna Louise & Fryzlewicz, Piotr, 2013. "Adaptive trend estimation in financial time series via multiscale change-point-induced basis recovery," LSE Research Online Documents on Economics 54934, London School of Economics and Political Science, LSE Library.
    4. P. Raña & G. Aneiros & J. M. Vilar, 2015. "Detection of outliers in functional time series," Environmetrics, John Wiley & Sons, Ltd., vol. 26(3), pages 178-191, May.
    5. Jianqing Fan & Wenyang Zhang, 2000. "Simultaneous Confidence Bands and Hypothesis Testing in Varying‐coefficient Models," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 27(4), pages 715-731, December.
    6. Yao, Fang & Muller, Hans-Georg & Wang, Jane-Ling, 2005. "Functional Data Analysis for Sparse Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 577-590, June.
    7. P. Fryzlewicz & S. Subba Rao, 2014. "Multiple-change-point detection for auto-regressive conditional heteroscedastic processes," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 76(5), pages 903-924, November.
    8. Li, Bin & Yu, Qingzhao, 2008. "Classification of functional data: A segmentation approach," Computational Statistics & Data Analysis, Elsevier, vol. 52(10), pages 4790-4800, June.
    9. Shujie Ma, 2014. "A plug-in the number of knots selector for polynomial spline regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 26(3), pages 489-507, September.
    10. John A. Rice & Colin O. Wu, 2001. "Nonparametric Mixed Effects Models for Unequally Sampled Noisy Curves," Biometrics, The International Biometric Society, vol. 57(1), pages 253-259, March.
    11. Fan, Jianqing & Huang, Tao & Li, Runze, 2007. "Analysis of Longitudinal Data With Semiparametric Estimation of Covariance Function," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 632-641, June.
    12. Jiangyan Wang & Suojin Wang & Lijian Yang, 2016. "Simultaneous confidence bands for the distribution function of a finite population and of its superpopulation," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(4), pages 692-709, December.
    13. Qiongxia Song & Lijian Yang, 2009. "Spline confidence bands for variance functions," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 21(5), pages 589-609.
    14. Shuzhuan Zheng & Rong Liu & Lijian Yang & Wolfgang K. Härdle, 2016. "Statistical inference for generalized additive models: simultaneous confidence corridors and variable selection," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(4), pages 607-626, December.
    15. Cho, Haeran & Fryzlewicz, Piotr, 2015. "Multiple-change-point detection for high dimensional time series via sparsified binary segmentation," LSE Research Online Documents on Economics 57147, London School of Economics and Political Science, LSE Library.
    16. Li Cai & Lijian Yang, 2015. "A smooth simultaneous confidence band for conditional variance function," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 24(3), pages 632-655, September.
    17. Lijie Gu & Li Wang & Wolfgang Härdle & Lijian Yang, 2014. "A simultaneous confidence corridor for varying coefficient regression with sparse functional data," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 23(4), pages 806-843, December.
    18. Guanqun Cao & Lijian Yang & David Todem, 2012. "Simultaneous inference for the mean function based on dense functional data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(2), pages 359-377.
    19. Shuzhuan Zheng & Lijian Yang & Wolfgang K. Härdle, 2014. "A Smooth Simultaneous Confidence Corridor for the Mean of Sparse Functional Data," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 109(506), pages 661-673, June.
    20. Jianhua Z. Huang & Lijian Yang, 2004. "Identification of non‐linear additive autoregressive models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(2), pages 463-477, May.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen Zhong & Lijian Yang, 2021. "Simultaneous confidence bands for comparing variance functions of two samples based on deterministic designs," Computational Statistics, Springer, vol. 36(2), pages 1197-1218, June.
    2. Li Cai & Suojin Wang, 2021. "Global statistical inference for the difference between two regression mean curves with covariates possibly partially missing," Statistical Papers, Springer, vol. 62(6), pages 2573-2602, December.
    3. Li Cai & Lijie Gu & Qihua Wang & Suojin Wang, 2021. "Simultaneous confidence bands for nonparametric regression with missing covariate data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(6), pages 1249-1279, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yuanyuan Zhang & Lijian Yang, 2018. "A smooth simultaneous confidence band for correlation curve," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 27(2), pages 247-269, June.
    2. Li Cai & Lijie Gu & Qihua Wang & Suojin Wang, 2021. "Simultaneous confidence bands for nonparametric regression with missing covariate data," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(6), pages 1249-1279, December.
    3. Jie Li & Jiangyan Wang & Lijian Yang, 2022. "Kolmogorov–Smirnov simultaneous confidence bands for time series distribution function," Computational Statistics, Springer, vol. 37(3), pages 1015-1039, July.
    4. Wang, Jiangyan & Gu, Lijie & Yang, Lijian, 2022. "Oracle-efficient estimation for functional data error distribution with simultaneous confidence band," Computational Statistics & Data Analysis, Elsevier, vol. 167(C).
    5. Chen Zhong & Lijian Yang, 2021. "Simultaneous confidence bands for comparing variance functions of two samples based on deterministic designs," Computational Statistics, Springer, vol. 36(2), pages 1197-1218, June.
    6. Gu, Lijie & Wang, Suojin & Yang, Lijian, 2021. "Smooth simultaneous confidence band for the error distribution function in nonparametric regression," Computational Statistics & Data Analysis, Elsevier, vol. 155(C).
    7. Lijie Gu & Suojin Wang & Lijian Yang, 2019. "Simultaneous confidence bands for the distribution function of a finite population in stratified sampling," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(4), pages 983-1005, August.
    8. Shuzhuan Zheng & Rong Liu & Lijian Yang & Wolfgang K. Härdle, 2016. "Statistical inference for generalized additive models: simultaneous confidence corridors and variable selection," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(4), pages 607-626, December.
    9. Zhong, Chen, 2024. "Oracle-efficient estimation and trend inference in non-stationary time series with trend and heteroscedastic ARMA error," Computational Statistics & Data Analysis, Elsevier, vol. 193(C).
    10. Jiangyan Wang & Suojin Wang & Lijian Yang, 2016. "Simultaneous confidence bands for the distribution function of a finite population and of its superpopulation," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 25(4), pages 692-709, December.
    11. Yueying Wang & Guannan Wang & Li Wang & R. Todd Ogden, 2020. "Simultaneous confidence corridors for mean functions in functional data analysis of imaging data," Biometrics, The International Biometric Society, vol. 76(2), pages 427-437, June.
    12. Li Cai & Suojin Wang, 2021. "Global statistical inference for the difference between two regression mean curves with covariates possibly partially missing," Statistical Papers, Springer, vol. 62(6), pages 2573-2602, December.
    13. Kun Huang & Sijie Zheng & Lijian Yang, 2022. "Inference for dependent error functional data with application to event-related potentials," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 31(4), pages 1100-1120, December.
    14. Fryzlewicz, Piotr, 2020. "Detecting possibly frequent change-points: Wild Binary Segmentation 2 and steepest-drop model selection," LSE Research Online Documents on Economics 103430, London School of Economics and Political Science, LSE Library.
    15. Chen, Likai & Wang, Weining & Wu, Wei Biao, 2019. "Inference of Break-Points in High-Dimensional Time Series," IRTG 1792 Discussion Papers 2019-013, Humboldt University of Berlin, International Research Training Group 1792 "High Dimensional Nonstationary Time Series".
    16. Huaihou Chen & Yuanjia Wang, 2011. "A Penalized Spline Approach to Functional Mixed Effects Model Analysis," Biometrics, The International Biometric Society, vol. 67(3), pages 861-870, September.
    17. Cho, Haeran & Korkas, Karolos K., 2022. "High-dimensional GARCH process segmentation with an application to Value-at-Risk," Econometrics and Statistics, Elsevier, vol. 23(C), pages 187-203.
    18. Cho, Haeran & Kirch, Claudia, 2024. "Data segmentation algorithms: Univariate mean change and beyond," Econometrics and Statistics, Elsevier, vol. 30(C), pages 76-95.
    19. Guanqun Cao & Lijian Yang & David Todem, 2012. "Simultaneous inference for the mean function based on dense functional data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 24(2), pages 359-377.
    20. Cao, Guanqun & Wang, Li, 2018. "Simultaneous inference for the mean of repeated functional data," Journal of Multivariate Analysis, Elsevier, vol. 165(C), pages 279-295.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:testjl:v:29:y:2020:i:1:d:10.1007_s11749-019-00655-5. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.