IDEAS home Printed from https://ideas.repec.org/a/bpj/ijbist/v6y2010i1n28.html
   My bibliography  Save this article

Fast Function-on-Scalar Regression with Penalized Basis Expansions

Author

Listed:
  • Reiss Philip T.

    (New York University and Nathan S. Kline Institute for Psychiatric Research)

  • Huang Lei

    (New York University)

  • Mennes Maarten

    (New York University)

Abstract

Regression models for functional responses and scalar predictors are often fitted by means of basis functions, with quadratic roughness penalties applied to avoid overfitting. The fitting approach described by Ramsay and Silverman in the 1990s amounts to a penalized ordinary least squares (P-OLS) estimator of the coefficient functions. We recast this estimator as a generalized ridge regression estimator, and present a penalized generalized least squares (P-GLS) alternative. We describe algorithms by which both estimators can be implemented, with automatic selection of optimal smoothing parameters, in a more computationally efficient manner than has heretofore been available. We discuss pointwise confidence intervals for the coefficient functions, simultaneous inference by permutation tests, and model selection, including a novel notion of pointwise model selection. P-OLS and P-GLS are compared in a simulation study. Our methods are illustrated with an analysis of age effects in a functional magnetic resonance imaging data set, as well as a reanalysis of a now-classic Canadian weather data set. An R package implementing the methods is publicly available.

Suggested Citation

  • Reiss Philip T. & Huang Lei & Mennes Maarten, 2010. "Fast Function-on-Scalar Regression with Penalized Basis Expansions," The International Journal of Biostatistics, De Gruyter, vol. 6(1), pages 1-30, August.
  • Handle: RePEc:bpj:ijbist:v:6:y:2010:i:1:n:28
    DOI: 10.2202/1557-4679.1246
    as

    Download full text from publisher

    File URL: https://doi.org/10.2202/1557-4679.1246
    Download Restriction: For access to full text, subscription to the journal or payment for the individual article is required.

    File URL: https://libkey.io/10.2202/1557-4679.1246?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Xihong Lin, 2004. "Equivalent kernels of smoothing splines in nonparametric regression for clustered/longitudinal data," Biometrika, Biometrika Trust, vol. 91(1), pages 177-193, March.
    2. Antoniadis, Anestis & Sapatinas, Theofanis, 2007. "Estimation and inference in functional mixed-effects models," Computational Statistics & Data Analysis, Elsevier, vol. 51(10), pages 4793-4813, June.
    3. Wensheng Guo, 2002. "Functional Mixed Effects Models," Biometrics, The International Biometric Society, vol. 58(1), pages 121-128, March.
    4. Yao, Fang & Muller, Hans-Georg & Wang, Jane-Ling, 2005. "Functional Data Analysis for Sparse Longitudinal Data," Journal of the American Statistical Association, American Statistical Association, vol. 100, pages 577-590, June.
    5. R. L. Eubank & Chunfeng Huang & Y. Muñoz Maldonado & Naisyin Wang & Suojin Wang & R. J. Buchanan, 2004. "Smoothing spline estimation in varying‐coefficient models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 653-667, August.
    6. Jeffrey S. Morris & Raymond J. Carroll, 2006. "Wavelet‐based functional mixed models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 68(2), pages 179-199, April.
    7. Krivobokova, Tatyana & Kauermann, Goran, 2007. "A Note on Penalized Spline Smoothing With Correlated Errors," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1328-1337, December.
    8. Schäfer Juliane & Strimmer Korbinian, 2005. "A Shrinkage Approach to Large-Scale Covariance Matrix Estimation and Implications for Functional Genomics," Statistical Applications in Genetics and Molecular Biology, De Gruyter, vol. 4(1), pages 1-32, November.
    9. Maria Durbán & Iain D. Currie, 2003. "A note on P-spline additive models with correlated errors," Computational Statistics, Springer, vol. 18(2), pages 251-262, July.
    10. Philip T. Reiss & R. Todd Ogden, 2009. "Smoothing parameter selection for a class of semiparametric linear models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 71(2), pages 505-523, April.
    11. Robert T. Krafty & Phyllis A. Gimotty & David Holtz & George Coukos & Wensheng Guo, 2008. "Varying Coefficient Model with Unknown Within-Subject Covariance for Analysis of Tumor Growth Curves," Biometrics, The International Biometric Society, vol. 64(4), pages 1023-1031, December.
    12. J. Fan & J.‐T. Zhang, 2000. "Two‐step estimation of functional linear models with applications to longitudinal data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(2), pages 303-322.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ana-Maria Staicu & Yingxing Li & Ciprian M. Crainiceanu & David Ruppert, 2014. "Likelihood Ratio Tests for Dependent Data with Applications to Longitudinal and Functional Data Analysis," Scandinavian Journal of Statistics, Danish Society for Theoretical Statistics;Finnish Statistical Society;Norwegian Statistical Association;Swedish Statistical Association, vol. 41(4), pages 932-949, December.
    2. Zhang, Xiaoke & Zhong, Qixian & Wang, Jane-Ling, 2020. "A new approach to varying-coefficient additive models with longitudinal covariates," Computational Statistics & Data Analysis, Elsevier, vol. 145(C).
    3. Huaihou Chen & Yuanjia Wang, 2011. "A Penalized Spline Approach to Functional Mixed Effects Model Analysis," Biometrics, The International Biometric Society, vol. 67(3), pages 861-870, September.
    4. Chen, Ziqi & Hu, Jianhua & Zhu, Hongtu, 2020. "Surface functional models," Journal of Multivariate Analysis, Elsevier, vol. 180(C).
    5. Matthew Reimherr & Dan Nicolae, 2016. "Estimating Variance Components in Functional Linear Models With Applications to Genetic Heritability," Journal of the American Statistical Association, Taylor & Francis Journals, vol. 111(513), pages 407-422, March.
    6. Jeff Goldsmith & Vadim Zipunnikov & Jennifer Schrack, 2015. "Generalized multilevel function-on-scalar regression and principal component analysis," Biometrics, The International Biometric Society, vol. 71(2), pages 344-353, June.
    7. Yuan Wang & Jianhua Hu & Kim-Anh Do & Brian P. Hobbs, 2019. "An Efficient Nonparametric Estimate for Spatially Correlated Functional Data," Statistics in Biosciences, Springer;International Chinese Statistical Association, vol. 11(1), pages 162-183, April.
    8. Cederbaum, Jona & Scheipl, Fabian & Greven, Sonja, 2018. "Fast symmetric additive covariance smoothing," Computational Statistics & Data Analysis, Elsevier, vol. 120(C), pages 25-41.
    9. Mengfei Ran & Yihe Yang, 2022. "Optimal Estimation of Large Functional and Longitudinal Data by Using Functional Linear Mixed Model," Mathematics, MDPI, vol. 10(22), pages 1-28, November.
    10. Chau, Van Vinh & von Sachs, Rainer, 2016. "Functional mixed effects wavelet estimation for spectra of replicated time series," LIDAM Discussion Papers ISBA 2016013, Université catholique de Louvain, Institute of Statistics, Biostatistics and Actuarial Sciences (ISBA).
    11. R. L. Eubank & Chunfeng Huang & Y. Muñoz Maldonado & Naisyin Wang & Suojin Wang & R. J. Buchanan, 2004. "Smoothing spline estimation in varying‐coefficient models," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 66(3), pages 653-667, August.
    12. Philip T. Reiss & Lei Huang & Pei‐Shien Wu & Huaihou Chen & Stan Colcombe, 2017. "Pointwise influence matrices for functional‐response regression," Biometrics, The International Biometric Society, vol. 73(4), pages 1092-1101, December.
    13. Hao, Siteng & Lin, Shu-Chin & Wang, Jane-Ling & Zhong, Qixian, 2024. "Dynamic modeling for multivariate functional and longitudinal data," Journal of Econometrics, Elsevier, vol. 239(2).
    14. Wang, Shaoli & Huang, Mian & Wu, Xing & Yao, Weixin, 2016. "Mixture of functional linear models and its application to CO2-GDP functional data," Computational Statistics & Data Analysis, Elsevier, vol. 97(C), pages 1-15.
    15. Haochang Shou & Vadim Zipunnikov & Ciprian M. Crainiceanu & Sonja Greven, 2015. "Structured functional principal component analysis," Biometrics, The International Biometric Society, vol. 71(1), pages 247-257, March.
    16. Zanin, Luca & Marra, Giampiero, 2012. "Assessing the functional relationship between CO2 emissions and economic development using an additive mixed model approach," Economic Modelling, Elsevier, vol. 29(4), pages 1328-1337.
    17. Şentürk, Damla & Ghosh, Samiran & Nguyen, Danh V., 2014. "Exploratory time varying lagged regression: Modeling association of cognitive and functional trajectories with expected clinic visits in older adults," Computational Statistics & Data Analysis, Elsevier, vol. 73(C), pages 1-15.
    18. John A. D. Aston & Jeng‐Min Chiou & Jonathan P. Evans, 2010. "Linguistic pitch analysis using functional principal component mixed effect models," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 59(2), pages 297-317, March.
    19. Hongxiao Zhu & Philip J. Brown & Jeffrey S. Morris, 2012. "Robust Classification of Functional and Quantitative Image Data Using Functional Mixed Models," Biometrics, The International Biometric Society, vol. 68(4), pages 1260-1268, December.
    20. Lauren N. Berry & Nathaniel E. Helwig, 2021. "Cross-Validation, Information Theory, or Maximum Likelihood? A Comparison of Tuning Methods for Penalized Splines," Stats, MDPI, vol. 4(3), pages 1-24, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:bpj:ijbist:v:6:y:2010:i:1:n:28. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Peter Golla (email available below). General contact details of provider: https://www.degruyter.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.