IDEAS home Printed from https://ideas.repec.org/a/eee/chsofr/v178y2024ics0960077923012961.html
   My bibliography  Save this article

Optimizing LSTM with multi-strategy improved WOA for robust prediction of high-speed machine tests data

Author

Listed:
  • Che, Zhongyuan
  • Peng, Chong
  • Yue, Chenxiao

Abstract

LSTM networks are popular for predicting data with nonlinear and temporal properties. However, it is difficult to select optimal hyperparameters using empirical methods, which can significantly affect their performance and modeling time. To address this, we propose a novel hybrid model called CMAL-WOA-LSTM (CWLM), which utilizes the multi-strategy improved whale optimization algorithm (WOA) to optimize three key hyperparameters of LSTM. Four modifications are introduced to improve the performance of WOA. Circle chaotic map is used for population initialization, and a modified dynamic backward learning strategy improves population diversity. A nonlinear function optimizes iterations to allow global exploration and faster convergence. Lévy Flight updates of feasible solutions using random walks are carried out near the optimal value for each iteration. By conducting benchmarks and comparative analysis, we illustrate the effectiveness and rationale behind the four improvements. Subsequently, we explain our optimization ideas for constructing hybrid models, highlighting their distinctions from traditional deep learning approaches. Moreover, we provide detailed modeling steps for CWLM and elaborate on the relationships of each part within the model. CWLM is compared with five other models using milling force data and wear data from high-speed machine tests. Root Mean Square Error, Mean Absolute Error, Mean Absolute Percentage Error, R-Squared, and computational time are used as error metrics. The results show that CWLM outperforms other models in terms of prediction performance and robustness. CWLM demonstrates improved prediction performance and robustness, making it applicable in a wide range of applications that use LSTM for data prediction.

Suggested Citation

  • Che, Zhongyuan & Peng, Chong & Yue, Chenxiao, 2024. "Optimizing LSTM with multi-strategy improved WOA for robust prediction of high-speed machine tests data," Chaos, Solitons & Fractals, Elsevier, vol. 178(C).
  • Handle: RePEc:eee:chsofr:v:178:y:2024:i:c:s0960077923012961
    DOI: 10.1016/j.chaos.2023.114394
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0960077923012961
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.chaos.2023.114394?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Cao, Qing & Ewing, Bradley T. & Thompson, Mark A., 2012. "Forecasting wind speed with recurrent neural networks," European Journal of Operational Research, Elsevier, vol. 221(1), pages 148-154.
    2. Ghimire, Sujan & Deo, Ravinesh C. & Raj, Nawin & Mi, Jianchun, 2019. "Deep solar radiation forecasting with convolutional neural network and long short-term memory network algorithms," Applied Energy, Elsevier, vol. 253(C), pages 1-1.
    3. Zhang, Zhendong & Ye, Lei & Qin, Hui & Liu, Yongqi & Wang, Chao & Yu, Xiang & Yin, Xingli & Li, Jie, 2019. "Wind speed prediction method using Shared Weight Long Short-Term Memory Network and Gaussian Process Regression," Applied Energy, Elsevier, vol. 247(C), pages 270-284.
    4. Xiaoyu Shi & Xuewen Lei & Qiang Huang & Shengzhi Huang & Kun Ren & Yuanyuan Hu, 2018. "Hourly Day-Ahead Wind Power Prediction Using the Hybrid Model of Variational Model Decomposition and Long Short-Term Memory," Energies, MDPI, vol. 11(11), pages 1-20, November.
    5. Prasanth, Sikakollu & Singh, Uttam & Kumar, Arun & Tikkiwal, Vinay Anand & Chong, Peter H.J., 2021. "Forecasting spread of COVID-19 using google trends: A hybrid GWO-deep learning approach," Chaos, Solitons & Fractals, Elsevier, vol. 142(C).
    6. Bilin Shao & Maolin Li & Yu Zhao & Genqing Bian, 2019. "Nickel Price Forecast Based on the LSTM Neural Network Optimized by the Improved PSO Algorithm," Mathematical Problems in Engineering, Hindawi, vol. 2019, pages 1-15, September.
    7. Tajie H. Harris & Edward J. Banigan & David A. Christian & Christoph Konradt & Elia D. Tait Wojno & Kazumi Norose & Emma H. Wilson & Beena John & Wolfgang Weninger & Andrew D. Luster & Andrea J. Liu &, 2012. "Generalized Lévy walks and the role of chemokines in migration of effector CD8+ T cells," Nature, Nature, vol. 486(7404), pages 545-548, June.
    8. Shahid, Farah & Zameer, Aneela & Muneeb, Muhammad, 2021. "A novel genetic LSTM model for wind power forecast," Energy, Elsevier, vol. 223(C).
    9. Xingrui Jiao & Yuping Song & Yang Kong & Xiaolong Tang, 2022. "Volatility forecasting for crude oil based on text information and deep learning PSO‐LSTM model," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(5), pages 933-944, August.
    10. Bao-Jian Li & Guo-Liang Sun & Yan Liu & Wen-Chuan Wang & Xu-Dong Huang, 2022. "Monthly Runoff Forecasting Using Variational Mode Decomposition Coupled with Gray Wolf Optimizer-Based Long Short-term Memory Neural Networks," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(6), pages 2095-2115, April.
    11. Gehad Ismail Sayed & Ashraf Darwish & Aboul Ella Hassanien, 2018. "A New Chaotic Whale Optimization Algorithm for Features Selection," Journal of Classification, Springer;The Classification Society, vol. 35(2), pages 300-344, July.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Manisha Sawant & Rupali Patil & Tanmay Shikhare & Shreyas Nagle & Sakshi Chavan & Shivang Negi & Neeraj Dhanraj Bokde, 2022. "A Selective Review on Recent Advancements in Long, Short and Ultra-Short-Term Wind Power Prediction," Energies, MDPI, vol. 15(21), pages 1-24, October.
    2. Joseph, Lionel P. & Deo, Ravinesh C. & Prasad, Ramendra & Salcedo-Sanz, Sancho & Raj, Nawin & Soar, Jeffrey, 2023. "Near real-time wind speed forecast model with bidirectional LSTM networks," Renewable Energy, Elsevier, vol. 204(C), pages 39-58.
    3. Nguyen, Hoang-Phuong & Baraldi, Piero & Zio, Enrico, 2021. "Ensemble empirical mode decomposition and long short-term memory neural network for multi-step predictions of time series signals in nuclear power plants," Applied Energy, Elsevier, vol. 283(C).
    4. Xu, Xuefang & Hu, Shiting & Shao, Huaishuang & Shi, Peiming & Li, Ruixiong & Li, Deguang, 2023. "A spatio-temporal forecasting model using optimally weighted graph convolutional network and gated recurrent unit for wind speed of different sites distributed in an offshore wind farm," Energy, Elsevier, vol. 284(C).
    5. Liu, Yongqi & Qin, Hui & Zhang, Zhendong & Pei, Shaoqian & Jiang, Zhiqiang & Feng, Zhongkai & Zhou, Jianzhong, 2020. "Probabilistic spatiotemporal wind speed forecasting based on a variational Bayesian deep learning model," Applied Energy, Elsevier, vol. 260(C).
    6. Saeed, Adnan & Li, Chaoshun & Gan, Zhenhao & Xie, Yuying & Liu, Fangjie, 2022. "A simple approach for short-term wind speed interval prediction based on independently recurrent neural networks and error probability distribution," Energy, Elsevier, vol. 238(PC).
    7. Sandra Minerva Valdivia-Bautista & José Antonio Domínguez-Navarro & Marco Pérez-Cisneros & Carlos Jesahel Vega-Gómez & Beatriz Castillo-Téllez, 2023. "Artificial Intelligence in Wind Speed Forecasting: A Review," Energies, MDPI, vol. 16(5), pages 1-28, March.
    8. Ma, Zhengjing & Mei, Gang, 2022. "A hybrid attention-based deep learning approach for wind power prediction," Applied Energy, Elsevier, vol. 323(C).
    9. Hanifi, Shahram & Zare-Behtash, Hossein & Cammarano, Andrea & Lotfian, Saeid, 2023. "Offshore wind power forecasting based on WPD and optimised deep learning methods," Renewable Energy, Elsevier, vol. 218(C).
    10. Xu, Xuefang & Hu, Shiting & Shi, Peiming & Shao, Huaishuang & Li, Ruixiong & Li, Zhi, 2023. "Natural phase space reconstruction-based broad learning system for short-term wind speed prediction: Case studies of an offshore wind farm," Energy, Elsevier, vol. 262(PA).
    11. Wang, Jianzhou & Xiong, Shenghua, 2014. "A hybrid forecasting model based on outlier detection and fuzzy time series – A case study on Hainan wind farm of China," Energy, Elsevier, vol. 76(C), pages 526-541.
    12. Hwang, Eunju, 2022. "Prediction intervals of the COVID-19 cases by HAR models with growth rates and vaccination rates in top eight affected countries: Bootstrap improvement," Chaos, Solitons & Fractals, Elsevier, vol. 155(C).
    13. Yeom, Jong-Min & Deo, Ravinesh C. & Adamwoski, Jan F. & Chae, Taebyeong & Kim, Dong-Su & Han, Kyung-Soo & Kim, Do-Yong, 2020. "Exploring solar and wind energy resources in North Korea with COMS MI geostationary satellite data coupled with numerical weather prediction reanalysis variables," Renewable and Sustainable Energy Reviews, Elsevier, vol. 119(C).
    14. Fang, Ping & Fu, Wenlong & Wang, Kai & Xiong, Dongzhen & Zhang, Kai, 2022. "A compositive architecture coupling outlier correction, EWT, nonlinear Volterra multi-model fusion with multi-objective optimization for short-term wind speed forecasting," Applied Energy, Elsevier, vol. 307(C).
    15. Jihong Qu & Kun Ren & Xiaoyu Shi, 2021. "Binary Grey Wolf Optimization-Regularized Extreme Learning Machine Wrapper Coupled with the Boruta Algorithm for Monthly Streamflow Forecasting," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(3), pages 1029-1045, February.
    16. Lim, Juin Yau & Safder, Usman & How, Bing Shen & Ifaei, Pouya & Yoo, Chang Kyoo, 2021. "Nationwide sustainable renewable energy and Power-to-X deployment planning in South Korea assisted with forecasting model," Applied Energy, Elsevier, vol. 283(C).
    17. Shab Gbémou & Julien Eynard & Stéphane Thil & Emmanuel Guillot & Stéphane Grieu, 2021. "A Comparative Study of Machine Learning-Based Methods for Global Horizontal Irradiance Forecasting," Energies, MDPI, vol. 14(11), pages 1-23, May.
    18. Yuze Li & Shangrong Jiang & Yunjie Wei & Shouyang Wang, 2021. "Take Bitcoin into your portfolio: a novel ensemble portfolio optimization framework for broad commodity assets," Financial Innovation, Springer;Southwestern University of Finance and Economics, vol. 7(1), pages 1-26, December.
    19. Miguel A. Jaramillo-Morán & Agustín García-García, 2019. "Applying Artificial Neural Networks to Forecast European Union Allowance Prices: The Effect of Information from Pollutant-Related Sectors," Energies, MDPI, vol. 12(23), pages 1-18, November.
    20. Ozdemir, Ali Can & Buluş, Kurtuluş & Zor, Kasım, 2022. "Medium- to long-term nickel price forecasting using LSTM and GRU networks," Resources Policy, Elsevier, vol. 78(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:chsofr:v:178:y:2024:i:c:s0960077923012961. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Thayer, Thomas R. (email available below). General contact details of provider: https://www.journals.elsevier.com/chaos-solitons-and-fractals .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.