IDEAS home Printed from https://ideas.repec.org/a/eee/intfor/v27yi3p725-739.html
   My bibliography  Save this article

A heuristic method for parameter selection in LS-SVM: Application to time series prediction

Author

Listed:
  • Rubio, Ginés
  • Pomares, Héctor
  • Rojas, Ignacio
  • Herrera, Luis Javier

Abstract

Least Squares Support Vector Machines (LS-SVM) are the state of the art in kernel methods for regression. These models have been successfully applied for time series modelling and prediction. A critical issue for the performance of these models is the choice of the kernel parameters and the hyperparameters which define the function to be minimized. In this paper a heuristic method for setting both the [sigma] parameter of the Gaussian kernel and the regularization hyperparameter based on information extracted from the time series to be modelled is presented and evaluated.

Suggested Citation

  • Rubio, Ginés & Pomares, Héctor & Rojas, Ignacio & Herrera, Luis Javier, 2011. "A heuristic method for parameter selection in LS-SVM: Application to time series prediction," International Journal of Forecasting, Elsevier, vol. 27(3), pages 725-739, July.
    • Handle: RePEc:eee:intfor:v:27:y::i:3:p:725-739
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0169207010000440
    Download Restriction: Full text for ScienceDirect subscribers only
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Balkin, Sandy D. & Ord, J. Keith, 2000. "Automatic neural network modeling for univariate time series," International Journal of Forecasting, Elsevier, vol. 16(4), pages 509-515.
    2. Alves da Silva, Alexandre P. & Ferreira, Vitor H. & Velasquez, Roberto M.G., 2008. "Input space to neural network based load forecasters," International Journal of Forecasting, Elsevier, vol. 24(4), pages 616-629.
    3. Melard, G. & Pasteels, J. -M., 2000. "Automatic ARIMA modeling including interventions, using time series expert software," International Journal of Forecasting, Elsevier, vol. 16(4), pages 497-508.
    4. Zhang, Guoqiang & Eddy Patuwo, B. & Y. Hu, Michael, 1998. "Forecasting with artificial neural networks:: The state of the art," International Journal of Forecasting, Elsevier, vol. 14(1), pages 35-62, March.
    5. Timo Teräsvirta & Marcelo C. Medeiros & Gianluigi Rech, 2006. "Building neural network models for time series: a statistical approach," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 25(1), pages 49-75.
    6. Tay, Francis E. H. & Cao, Lijuan, 2001. "Application of support vector machines in financial time series forecasting," Omega, Elsevier, vol. 29(4), pages 309-317, August.
    7. Jursa, René & Rohrig, Kurt, 2008. "Short-term wind power forecasting using evolutionary algorithms for the automated specification of artificial intelligence models," International Journal of Forecasting, Elsevier, vol. 24(4), pages 694-709.
    8. Guy Melard & Jean-Michel Pasteels, 2000. "Automatic ARIMA modeling including interventions, using time series expert software," ULB Institutional Repository 2013/13744, ULB -- Universite Libre de Bruxelles.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Plakandaras, Vasilios & Gupta, Rangan & Gogas, Periklis & Papadimitriou, Theophilos, 2015. "Forecasting the U.S. real house price index," Economic Modelling, Elsevier, vol. 45(C), pages 259-267.
    2. Plakandaras, Vasilios & Gogas, Periklis & Papadimitriou, Theophilos & Gupta, Rangan, 2019. "A re-evaluation of the term spread as a leading indicator," International Review of Economics & Finance, Elsevier, vol. 64(C), pages 476-492.
    3. Vasilios Plakandaras & Periklis Gogas & Theophilos Papadimitriou & Rangan Gupta, 2016. "The Term Premium as a Leading Macroeconomic Indicator," Working Papers 201613, University of Pretoria, Department of Economics.
    4. Theophilos Papadimitriou & Periklis Gogas & Vasilios Plakandaras, 2016. "Testing Exchange Rate Models in a Small Open Economy: an SVR Approach," Bulletin of Applied Economics, Risk Market Journals, vol. 3(2), pages 9-29.
    5. Plakandaras, Vasilios & Papadimitriou, Theophilos & Gogas, Periklis, 2019. "Forecasting transportation demand for the U.S. market," Transportation Research Part A: Policy and Practice, Elsevier, vol. 126(C), pages 195-214.
    6. Bangzhu Zhu & Xuetao Shi & Julien Chevallier & Ping Wang & Yi‐Ming Wei, 2016. "An Adaptive Multiscale Ensemble Learning Paradigm for Nonstationary and Nonlinear Energy Price Time Series Forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 35(7), pages 633-651, November.
    7. Vasilios Plakandaras & Elie Bouri & Rangan Gupta, 2019. "Forecasting Bitcoin Returns: Is there a Role for the U.S. – China Trade War?," Working Papers 201980, University of Pretoria, Department of Economics.
    8. Plakandaras, Vasilios & Gupta, Rangan & Wohar, Mark E., 2017. "The depreciation of the pound post-Brexit: Could it have been predicted?," Finance Research Letters, Elsevier, vol. 21(C), pages 206-213.
    9. Wang, Jian Qi & Du, Yu & Wang, Jing, 2020. "LSTM based long-term energy consumption prediction with periodicity," Energy, Elsevier, vol. 197(C).
    10. Yun Bai & Zhenzhong Sun & Bo Zeng & Jianyu Long & Lin Li & José Valente Oliveira & Chuan Li, 2019. "A comparison of dimension reduction techniques for support vector machine modeling of multi-parameter manufacturing quality prediction," Journal of Intelligent Manufacturing, Springer, vol. 30(5), pages 2245-2256, June.
    11. Theodore Syriopoulos & Michael Tsatsaronis & Ioannis Karamanos, 2021. "Support Vector Machine Algorithms: An Application to Ship Price Forecasting," Computational Economics, Springer;Society for Computational Economics, vol. 57(1), pages 55-87, January.
    12. repec:ipg:wpaper:2014-473 is not listed on IDEAS
    13. M. A. Ghorbani & R. Khatibi & V. Karimi & Zaher Mundher Yaseen & M. Zounemat-Kermani, 2018. "Learning from Multiple Models Using Artificial Intelligence to Improve Model Prediction Accuracies: Application to River Flows," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 32(13), pages 4201-4215, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Jan G. De Gooijer & Rob J. Hyndman, 2005. "25 Years of IIF Time Series Forecasting: A Selective Review," Monash Econometrics and Business Statistics Working Papers 12/05, Monash University, Department of Econometrics and Business Statistics.
    2. De Gooijer, Jan G. & Hyndman, Rob J., 2006. "25 years of time series forecasting," International Journal of Forecasting, Elsevier, vol. 22(3), pages 443-473.
    3. Mirakyan, Atom & Meyer-Renschhausen, Martin & Koch, Andreas, 2017. "Composite forecasting approach, application for next-day electricity price forecasting," Energy Economics, Elsevier, vol. 66(C), pages 228-237.
    4. Szafranek, Karol, 2019. "Bagged neural networks for forecasting Polish (low) inflation," International Journal of Forecasting, Elsevier, vol. 35(3), pages 1042-1059.
    5. Singh, Sarbjit & Parmar, Kulwinder Singh & Kumar, Jatinder & Makkhan, Sidhu Jitendra Singh, 2020. "Development of new hybrid model of discrete wavelet decomposition and autoregressive integrated moving average (ARIMA) models in application to one month forecast the casualties cases of COVID-19," Chaos, Solitons & Fractals, Elsevier, vol. 135(C).
    6. Rajae Azrak & Guy Melard & Hassane Njimi, 2004. "Forecasting in the analysis of mobile telecommunication data: correction for outliers and replacement of missing observations," ULB Institutional Repository 2013/13748, ULB -- Universite Libre de Bruxelles.
    7. Daniel Fernández, 2011. "Suficiencia del capital y previsiones de la banca uruguaya por su exposición al sector industrial," Monetaria, CEMLA, vol. 0(4), pages 517-589, octubre-d.
    8. Javier Pereda, 2011. "Estimación de la tasa natural de interés para Perú: un enfoque financiero," Monetaria, CEMLA, vol. 0(4), pages 429-459, octubre-d.
    9. Ricardo P. Masini & Marcelo C. Medeiros & Eduardo F. Mendes, 2023. "Machine learning advances for time series forecasting," Journal of Economic Surveys, Wiley Blackwell, vol. 37(1), pages 76-111, February.
    10. Carlos A. Medel, 2013. "How informative are in-sample information criteria to forecasting? The case of Chilean GDP," Latin American Journal of Economics-formerly Cuadernos de Economía, Instituto de Economía. Pontificia Universidad Católica de Chile., vol. 50(1), pages 133-161, May.
    11. Singh, Sarbjit & Parmar, Kulwinder Singh & Makkhan, Sidhu Jitendra Singh & Kaur, Jatinder & Peshoria, Shruti & Kumar, Jatinder, 2020. "Study of ARIMA and least square support vector machine (LS-SVM) models for the prediction of SARS-CoV-2 confirmed cases in the most affected countries," Chaos, Solitons & Fractals, Elsevier, vol. 139(C).
    12. Horng-I Hsieh & Tsung-Pei Lee & Tian-Shyug Lee, 2011. "A Hybrid Particle Swarm Optimization and Support Vector Regression Model for Financial Time Series Forecasting," International Journal of Business Administration, International Journal of Business Administration, Sciedu Press, vol. 2(2), pages 48-56, May.
    13. Terasvirta, Timo & van Dijk, Dick & Medeiros, Marcelo C., 2005. "Linear models, smooth transition autoregressions, and neural networks for forecasting macroeconomic time series: A re-examination," International Journal of Forecasting, Elsevier, vol. 21(4), pages 755-774.
    14. George Athanasopoulos & D. Poskitt & Farshid Vahid, 2012. "Two Canonical VARMA Forms: Scalar Component Models Vis-à-Vis the Echelon Form," Econometric Reviews, Taylor & Francis Journals, vol. 31(1), pages 60-83.
    15. Tamara Burdisso & Eduardo Ariel Corso, 2011. "Incertidumbre y dolarización de cartera: el caso argentino en el último medio siglo," Monetaria, CEMLA, vol. 0(4), pages 461-515, octubre-d.
    16. Carlos Medel, 2012. "¿Akaike o Schwarz? ¿Cuál elegir para Predecir el PIB Chileno?," Working Papers Central Bank of Chile 658, Central Bank of Chile.
    17. Mingyue Qiu & Yu Song, 2016. "Predicting the Direction of Stock Market Index Movement Using an Optimized Artificial Neural Network Model," PLOS ONE, Public Library of Science, vol. 11(5), pages 1-11, May.
    18. Qi, Min & Yang, Sha, 2003. "Forecasting consumer credit card adoption: what can we learn about the utility function?," International Journal of Forecasting, Elsevier, vol. 19(1), pages 71-85.
    19. Ediger, Volkan S. & Akar, Sertac & Ugurlu, Berkin, 2006. "Forecasting production of fossil fuel sources in Turkey using a comparative regression and ARIMA model," Energy Policy, Elsevier, vol. 34(18), pages 3836-3846, December.
    20. Song, Haiyan & Gao, Bastian Z. & Lin, Vera S., 2013. "Combining statistical and judgmental forecasts via a web-based tourism demand forecasting system," International Journal of Forecasting, Elsevier, vol. 29(2), pages 295-310.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:intfor:v:27:y::i:3:p:725-739. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/locate/ijforecast .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.