IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v170y2019icp25-45.html
   My bibliography  Save this article

An RKHS model for variable selection in functional linear regression

Author

Listed:
  • Berrendero, José R.
  • Bueno-Larraz, Beatriz
  • Cuevas, Antonio

Abstract

A mathematical model for variable selection in functional linear regression models with scalar response is proposed. By “variable selection” we mean a procedure to replace the whole trajectories of the functional explanatory variables with their values at a finite number of carefully selected instants (or “impact points”). The basic idea of our approach is to use the Reproducing Kernel Hilbert Space (RKHS) associated with the underlying process, instead of the more usual L2[0,1] space, in the definition of the linear model. This turns out to be especially suitable for variable selection purposes, since the finite-dimensional linear model based on the selected “impact points” can be seen as a particular case of the RKHS-based linear functional model. In this framework, we address the consistent estimation of the optimal design of impact points and we check, via simulations and real data examples, the performance of the proposed method.

Suggested Citation

  • Berrendero, José R. & Bueno-Larraz, Beatriz & Cuevas, Antonio, 2019. "An RKHS model for variable selection in functional linear regression," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 25-45.
    • Handle: RePEc:eee:jmvana:v:170:y:2019:i:c:p:25-45
    DOI: 10.1016/j.jmva.2018.04.008
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047259X17305596
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.jmva.2018.04.008?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Hao Ji & Hans-Georg Müller, 2017. "Optimal designs for longitudinal and functional data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(3), pages 859-876, June.
    2. Fraiman, Ricardo & Gimenez, Yanina & Svarc, Marcela, 2016. "Feature selection for functional data," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 191-208.
    3. F. Ferraty & P. Hall & P. Vieu, 2010. "Most-predictive design points for functional data predictors," Biometrika, Biometrika Trust, vol. 97(4), pages 807-824.
    4. A. Delaigle & P. Hall & N. Bathia, 2012. "Componentwise classification and clustering of functional data," Biometrika, Biometrika Trust, vol. 99(2), pages 299-313.
    5. Aneiros, Germán & Vieu, Philippe, 2014. "Variable selection in infinite-dimensional problems," Statistics & Probability Letters, Elsevier, vol. 94(C), pages 12-20.
    6. Jianqing Fan & Jinchi Lv, 2008. "Sure independence screening for ultrahigh dimensional feature space," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(5), pages 849-911, November.
    7. G. Aneiros & P. Vieu, 2016. "Sparse nonparametric model for regression with functional covariate," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(4), pages 839-859, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Belli, Edoardo, 2022. "Smoothly adaptively centered ridge estimator," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    2. Chen, Di-Rong & Cheng, Kun & Liu, Chao, 2022. "Framelet block thresholding estimator for sparse functional data," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    3. Yang, Yang & Yang, Yanrong & Shang, Han Lin, 2022. "Feature extraction for functional time series: Theory and application to NIR spectroscopy data," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    4. Liang, Weijuan & Zhang, Qingzhao & Ma, Shuangge, 2023. "Locally sparse quantile estimation for a partially functional interaction model," Computational Statistics & Data Analysis, Elsevier, vol. 186(C).
    5. Dominik Poß & Dominik Liebl & Alois Kneip & Hedwig Eisenbarth & Tor D. Wager & Lisa Feldman Barrett, 2020. "Superconsistent estimation of points of impact in non‐parametric regression with functional predictors," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 82(4), pages 1115-1140, September.
    6. Aneiros, Germán & Novo, Silvia & Vieu, Philippe, 2022. "Variable selection in functional regression models: A review," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    7. Aneiros, Germán & Cao, Ricardo & Fraiman, Ricardo & Genest, Christian & Vieu, Philippe, 2019. "Recent advances in functional data analysis and high-dimensional statistics," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 3-9.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Aneiros, Germán & Cao, Ricardo & Fraiman, Ricardo & Genest, Christian & Vieu, Philippe, 2019. "Recent advances in functional data analysis and high-dimensional statistics," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 3-9.
    2. Bodnar, Taras & Okhrin, Ostap & Parolya, Nestor, 2019. "Optimal shrinkage estimator for high-dimensional mean vector," Journal of Multivariate Analysis, Elsevier, vol. 170(C), pages 63-79.
    3. Park, So Young & Xiao, Luo & Willbur, Jayson D. & Staicu, Ana-Maria & Jumbe, N. L’ntshotsholé, 2018. "A joint design for functional data with application to scheduling ultrasound scans," Computational Statistics & Data Analysis, Elsevier, vol. 122(C), pages 101-114.
    4. Floriello, Davide & Vitelli, Valeria, 2017. "Sparse clustering of functional data," Journal of Multivariate Analysis, Elsevier, vol. 154(C), pages 1-18.
    5. Aneiros, Germán & Novo, Silvia & Vieu, Philippe, 2022. "Variable selection in functional regression models: A review," Journal of Multivariate Analysis, Elsevier, vol. 188(C).
    6. A. Pini & S. Vantini, 2017. "Interval-wise testing for functional data," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 29(2), pages 407-424, April.
    7. Marco Stefanucci & Laura M. Sangalli & Pierpaolo Brutti, 2018. "PCA‐based discrimination of partially observed functional data, with an application to AneuRisk65 data set," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 72(3), pages 246-264, August.
    8. Karl Mosler & Pavlo Mozharovskyi, 2017. "Fast DD-classification of functional data," Statistical Papers, Springer, vol. 58(4), pages 1055-1089, December.
    9. Latouche, Pierre & Mattei, Pierre-Alexandre & Bouveyron, Charles & Chiquet, Julien, 2016. "Combining a relaxed EM algorithm with Occam’s razor for Bayesian variable selection in high-dimensional regression," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 177-190.
    10. Belli, Edoardo, 2022. "Smoothly adaptively centered ridge estimator," Journal of Multivariate Analysis, Elsevier, vol. 189(C).
    11. Fraiman, Ricardo & Gimenez, Yanina & Svarc, Marcela, 2016. "Feature selection for functional data," Journal of Multivariate Analysis, Elsevier, vol. 146(C), pages 191-208.
    12. Germán Aneiros & Philippe Vieu, 2015. "Partial linear modelling with multi-functional covariates," Computational Statistics, Springer, vol. 30(3), pages 647-671, September.
    13. G. Aneiros & P. Vieu, 2016. "Sparse nonparametric model for regression with functional covariate," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(4), pages 839-859, October.
    14. Shuyu Meng & Zhensheng Huang, 2024. "Variable Selection in Semi-Functional Partially Linear Regression Models with Time Series Data," Mathematics, MDPI, vol. 12(17), pages 1-23, September.
    15. Guochang Wang & Jianjun Zhou & Wuqing Wu & Min Chen, 2017. "Robust functional sliced inverse regression," Statistical Papers, Springer, vol. 58(1), pages 227-245, March.
    16. Vieu, Philippe, 2018. "On dimension reduction models for functional data," Statistics & Probability Letters, Elsevier, vol. 136(C), pages 134-138.
    17. Hao Ji & Hans-Georg Müller, 2017. "Optimal designs for longitudinal and functional data," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 79(3), pages 859-876, June.
    18. Shuichi Kawano, 2014. "Selection of tuning parameters in bridge regression models via Bayesian information criterion," Statistical Papers, Springer, vol. 55(4), pages 1207-1223, November.
    19. Sauvenier, Mathieu & Van Bellegem, Sébastien, 2023. "Direction Identification and Minimax Estimation by Generalized Eigenvalue Problem in High Dimensional Sparse Regression," LIDAM Discussion Papers CORE 2023005, Université catholique de Louvain, Center for Operations Research and Econometrics (CORE).
    20. Mojirsheibani, Majid & Shaw, Crystal, 2018. "Classification with incomplete functional covariates," Statistics & Probability Letters, Elsevier, vol. 139(C), pages 40-46.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:170:y:2019:i:c:p:25-45. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.