IDEAS home Printed from https://ideas.repec.org/a/eee/jmvana/v97y2006i9p2023-2033.html
   My bibliography  Save this article

Nonlinear regression modeling via regularized wavelets and smoothing parameter selection

Author

Listed:
  • Fujii, Toru
  • Konishi, Sadanori

Abstract

We introduce regularized wavelet-based methods for nonlinear regression modeling when design points are not equally spaced. A crucial issue in the model building process is a choice of tuning parameters that control the smoothness of a fitted curve. We derive model selection criteria from an information-theoretic and also Bayesian approaches. Monte Carlo simulations are conducted to examine the performance of the proposed wavelet-based modeling technique.

Suggested Citation

  • Fujii, Toru & Konishi, Sadanori, 2006. "Nonlinear regression modeling via regularized wavelets and smoothing parameter selection," Journal of Multivariate Analysis, Elsevier, vol. 97(9), pages 2023-2033, October.
    • Handle: RePEc:eee:jmvana:v:97:y:2006:i:9:p:2023-2033
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0047-259X(06)00085-6
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Sadanori Konishi, 2004. "Bayesian information criteria and smoothing parameter selection in radial basis function networks," Biometrika, Biometrika Trust, vol. 91(1), pages 27-43, March.
    2. Antoniadis A. & Fan J., 2001. "Regularization of Wavelet Approximations," Journal of the American Statistical Association, American Statistical Association, vol. 96, pages 939-967, September.
    3. Marianna Pensky & Brani Vidakovic, 2001. "On Non-Equally Spaced Wavelet Regression," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 53(4), pages 681-690, December.
    4. Antoniadis, Anestis & Dinh Tuan Pham, 1998. "Wavelet regression for random or irregular design," Computational Statistics & Data Analysis, Elsevier, vol. 28(4), pages 353-369, October.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hidetoshi Matsui & Takamitsu Araki & Sadanori Konishi, 2011. "Multiclass Functional Discriminant Analysis and Its Application to Gesture Recognition," Journal of Classification, Springer;The Classification Society, vol. 28(2), pages 227-243, July.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Antoniadis, Anestis & Sapatinas, Theofanis, 2003. "Wavelet methods for continuous-time prediction using Hilbert-valued autoregressive processes," Journal of Multivariate Analysis, Elsevier, vol. 87(1), pages 133-158, October.
    2. Michael Levine, 2019. "Robust functional estimation in the multivariate partial linear model," Annals of the Institute of Statistical Mathematics, Springer;The Institute of Statistical Mathematics, vol. 71(4), pages 743-770, August.
    3. Amato, Umberto & Antoniadis, Anestis & De Feis, Italia & Goude, Yannig & Lagache, Audrey, 2021. "Forecasting high resolution electricity demand data with additive models including smooth and jagged components," International Journal of Forecasting, Elsevier, vol. 37(1), pages 171-185.
    4. Shuichi Kawano, 2014. "Selection of tuning parameters in bridge regression models via Bayesian information criterion," Statistical Papers, Springer, vol. 55(4), pages 1207-1223, November.
    5. Fan, Jianqing & Liao, Yuan & Shi, Xiaofeng, 2015. "Risks of large portfolios," Journal of Econometrics, Elsevier, vol. 186(2), pages 367-387.
    6. Umberto Amato & Anestis Antoniadis & Italia De Feis & Irene Gijbels, 2021. "Penalised robust estimators for sparse and high-dimensional linear models," Statistical Methods & Applications, Springer;Società Italiana di Statistica, vol. 30(1), pages 1-48, March.
    7. Bartosz Uniejewski, 2024. "Regularization for electricity price forecasting," Operations Research and Decisions, Wroclaw University of Science and Technology, Faculty of Management, vol. 34(3), pages 267-286.
    8. Le Zhang & Qiang Yang, 2020. "Investigation of the Design and Fault Prediction Method for an Abrasive Particle Sensor Used in Wind Turbine Gearbox," Energies, MDPI, vol. 13(2), pages 1-13, January.
    9. Jack P. C. Kleijnen & Susan M. Sanchez & Thomas W. Lucas & Thomas M. Cioppa, 2005. "State-of-the-Art Review: A User’s Guide to the Brave New World of Designing Simulation Experiments," INFORMS Journal on Computing, INFORMS, vol. 17(3), pages 263-289, August.
    10. Matthieu Garcin & Dominique Guegan, 2015. "Optimal wavelet shrinkage of a noisy dynamical system with non-linear noise impact," Documents de travail du Centre d'Economie de la Sorbonne 15085, Université Panthéon-Sorbonne (Paris 1), Centre d'Economie de la Sorbonne.
    11. Sophie Lambert-Lacroix & Laurent Zwald, 2016. "The adaptive BerHu penalty in robust regression," Journal of Nonparametric Statistics, Taylor & Francis Journals, vol. 28(3), pages 487-514, September.
    12. Sumanjay Dutta & Shashi Jain, 2023. "Precision versus Shrinkage: A Comparative Analysis of Covariance Estimation Methods for Portfolio Allocation," Papers 2305.11298, arXiv.org.
    13. Saman Banafti & Tae-Hwy Lee, 2022. "Inferential Theory for Granular Instrumental Variables in High Dimensions," Papers 2201.06605, arXiv.org, revised Sep 2023.
    14. Hidetoshi Matsui & Takamitsu Araki & Sadanori Konishi, 2011. "Multiclass Functional Discriminant Analysis and Its Application to Gesture Recognition," Journal of Classification, Springer;The Classification Society, vol. 28(2), pages 227-243, July.
    15. Hee-Seok Oh & Donghoh Kim & Youngjo Lee, 2009. "Cross-validated wavelet shrinkage," Computational Statistics, Springer, vol. 24(3), pages 497-512, August.
    16. Umberto Amato & Anestis Antoniadis & Italia Feis & Irène Gijbels, 2022. "Penalized wavelet estimation and robust denoising for irregular spaced data," Computational Statistics, Springer, vol. 37(4), pages 1621-1651, September.
    17. Ando, Tomohiro, 2009. "Bayesian inference for the hazard term structure with functional predictors using Bayesian predictive information criteria," Computational Statistics & Data Analysis, Elsevier, vol. 53(6), pages 1925-1939, April.
    18. Fan, Jianqing & Wang, Weichen & Zhong, Yiqiao, 2019. "Robust covariance estimation for approximate factor models," Journal of Econometrics, Elsevier, vol. 208(1), pages 5-22.
    19. Alan T. K. Wan & Jinhong You & Riquan Zhang, 2016. "A Seemingly Unrelated Nonparametric Additive Model with Autoregressive Errors," Econometric Reviews, Taylor & Francis Journals, vol. 35(5), pages 894-928, May.
    20. Ando, Tomohiro, 2009. "Bayesian factor analysis with fat-tailed factors and its exact marginal likelihood," Journal of Multivariate Analysis, Elsevier, vol. 100(8), pages 1717-1726, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:jmvana:v:97:y:2006:i:9:p:2023-2033. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/622892/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.