IDEAS home Printed from https://ideas.repec.org/a/eee/csdana/v53y2008i1p164-175.html
   My bibliography  Save this article

Selection of components and degrees of smoothing via lasso in high dimensional nonparametric additive models

Author

Listed:
  • Zheng, Shurong

Abstract

This paper proposes a procedure for selecting components and degrees of smoothing in high dimensional nonparametric additive models. In the procedure, different components have different penalties, and all the smoothing parameters in one component have the same penalties. The idea is similar to, but in fact different from, Wang et al.'s [Wang, H., Li, G.D., Tsai, C.L., 2007. Regression coefficient and autoregressive order shrinkage and selection via the lasso. Journal of the Royal Statistical Society, Series B 69, 63-78] modified lasso, which requires different penalties for different parameters. The procedure obtains the sequence of components according to the importance of these components by Efron et al.'s [Efron, B., Hastie, T., Johnstone, I., Tibshirani, R., 2004. Least angle regression. Annals of Statistics 32, 407-489] LARS. CV or BIC selector can be used to select the tuning parameters in the procedure, where some asymptotic properties are proved. Some simulation results and two examples are used to illustrate the procedure.

Suggested Citation

  • Zheng, Shurong, 2008. "Selection of components and degrees of smoothing via lasso in high dimensional nonparametric additive models," Computational Statistics & Data Analysis, Elsevier, vol. 53(1), pages 164-175, September.
    • Handle: RePEc:eee:csdana:v:53:y:2008:i:1:p:164-175
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0167-9473(08)00335-6
    Download Restriction: Full text for ScienceDirect subscribers only.
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Frédéric Ferraty & Philippe Vieu, 2002. "The Functional Nonparametric Model and Application to Spectrometric Data," Computational Statistics, Springer, vol. 17(4), pages 545-564, December.
    2. S. N. Wood, 2000. "Modelling and smoothing parameter estimation with multiple quadratic penalties," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 62(2), pages 413-428.
    3. Simon N. Wood, 2004. "Stable and Efficient Multiple Smoothing Parameter Estimation for Generalized Additive Models," Journal of the American Statistical Association, American Statistical Association, vol. 99, pages 673-686, January.
    4. Gerhard Tutz & Harald Binder, 2006. "Generalized Additive Modeling with Implicit Variable Selection by Likelihood-Based Boosting," Biometrics, The International Biometric Society, vol. 62(4), pages 961-971, December.
    5. Hansheng Wang & Guodong Li & Chih‐Ling Tsai, 2007. "Regression coefficient and autoregressive order shrinkage and selection via the lasso," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 69(1), pages 63-78, February.
    6. Ferraty, F. & Vieu, P., 2003. "Curves discrimination: a nonparametric functional approach," Computational Statistics & Data Analysis, Elsevier, vol. 44(1-2), pages 161-173, October.
    7. Wang, Hansheng & Leng, Chenlei, 2007. "Unified LASSO Estimation by Least Squares Approximation," Journal of the American Statistical Association, American Statistical Association, vol. 102, pages 1039-1048, September.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. de Uña Álvarez, Jacobo & Roca Pardiñas, Javier, 2009. "Additive models in censored regression," Computational Statistics & Data Analysis, Elsevier, vol. 53(9), pages 3490-3501, July.
    2. Umberto Amato & Anestis Antoniadis & Italia De Feis, 2016. "Additive model selection," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 25(4), pages 519-564, November.
    3. Boj, Eva & Delicado, Pedro & Fortiana, Josep, 2010. "Distance-based local linear regression for functional predictors," Computational Statistics & Data Analysis, Elsevier, vol. 54(2), pages 429-437, February.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Morteza Amini & Mahdi Roozbeh, 2019. "Improving the prediction performance of the LASSO by subtracting the additive structural noises," Computational Statistics, Springer, vol. 34(1), pages 415-432, March.
    2. Lenka Zbonakova & Wolfgang Karl Härdle & Weining Wang, 2016. "Time Varying Quantile Lasso," SFB 649 Discussion Papers SFB649DP2016-047, Sonderforschungsbereich 649, Humboldt University, Berlin, Germany.
    3. Longhi, Christian & Musolesi, Antonio & Baumont, Catherine, 2014. "Modeling structural change in the European metropolitan areas during the process of economic integration," Economic Modelling, Elsevier, vol. 37(C), pages 395-407.
    4. Strasak, Alexander M. & Umlauf, Nikolaus & Pfeiffer, Ruth M. & Lang, Stefan, 2011. "Comparing penalized splines and fractional polynomials for flexible modelling of the effects of continuous predictor variables," Computational Statistics & Data Analysis, Elsevier, vol. 55(4), pages 1540-1551, April.
    5. Delsol, Laurent & Ferraty, Frédéric & Vieu, Philippe, 2011. "Structural test in regression on functional variables," Journal of Multivariate Analysis, Elsevier, vol. 102(3), pages 422-447, March.
    6. Morteza Amini & Mahdi Roozbeh & Nur Anisah Mohamed, 2024. "Separation of the Linear and Nonlinear Covariates in the Sparse Semi-Parametric Regression Model in the Presence of Outliers," Mathematics, MDPI, vol. 12(2), pages 1-17, January.
    7. Philip T. Reiss & R. Todd Ogden, 2010. "Functional Generalized Linear Models with Images as Predictors," Biometrics, The International Biometric Society, vol. 66(1), pages 61-69, March.
    8. Jianqing Fan & Jinchi Lv, 2008. "Sure independence screening for ultrahigh dimensional feature space," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 70(5), pages 849-911, November.
    9. Gerhard Tutz & Harald Binder, 2006. "Generalized Additive Modeling with Implicit Variable Selection by Likelihood-Based Boosting," Biometrics, The International Biometric Society, vol. 62(4), pages 961-971, December.
    10. Scott Tainsky & Brian M. Mills & Jason A. Winfree, 2015. "Further Examination of Potential Discrimination Among MLB Umpires," Journal of Sports Economics, , vol. 16(4), pages 353-374, May.
    11. Alessandro Gregorio & Francesco Iafrate, 2021. "Regularized bridge-type estimation with multiple penalties," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 73(5), pages 921-951, October.
    12. Coussement, Kristof & Buckinx, Wouter, 2011. "A probability-mapping algorithm for calibrating the posterior probabilities: A direct marketing application," European Journal of Operational Research, Elsevier, vol. 214(3), pages 732-738, November.
    13. Ordás Criado, Carlos & Valente, Simone & Stengos, Thanasis, 2009. "Growth and the pollution convergence hypothesis: A nonparametric approach," MPRA Paper 17492, University Library of Munich, Germany.
    14. Sylvie Charlot & Riccardo Crescenzi & Antonio Musolesi, 2014. "Augmented and Unconstrained: revisiting the Regional Knowledge Production Function," SEEDS Working Papers 2414, SEEDS, Sustainability Environmental Economics and Dynamics Studies, revised Aug 2014.
    15. Zhou, Jie, 2011. "Maximum likelihood ratio test for the stability of sequence of Gaussian random processes," Computational Statistics & Data Analysis, Elsevier, vol. 55(6), pages 2114-2127, June.
    16. Simon N. Wood, 2020. "Inference and computation with generalized additive models and their extensions," TEST: An Official Journal of the Spanish Society of Statistics and Operations Research, Springer;Sociedad de Estadística e Investigación Operativa, vol. 29(2), pages 307-339, June.
    17. Chenlei Leng & Minh-Ngoc Tran & David Nott, 2014. "Bayesian adaptive Lasso," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 66(2), pages 221-244, April.
    18. Musolesi Antonio & Mazzanti Massimiliano, 2014. "Nonlinearity, heterogeneity and unobserved effects in the carbon dioxide emissions-economic development relation for advanced countries," Studies in Nonlinear Dynamics & Econometrics, De Gruyter, vol. 18(5), pages 1-21, December.
    19. Zhang, Hao Helen & Lu, Wenbin & Wang, Hansheng, 2010. "On sparse estimation for semiparametric linear transformation models," Journal of Multivariate Analysis, Elsevier, vol. 101(7), pages 1594-1606, August.
    20. Takuma Yoshida, 2016. "Asymptotics and smoothing parameter selection for penalized spline regression with various loss functions," Statistica Neerlandica, Netherlands Society for Statistics and Operations Research, vol. 70(4), pages 278-303, November.

    More about this item

    Statistics

    Access and download statistics

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:csdana:v:53:y:2008:i:1:p:164-175. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/csda .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.