IDEAS home Printed from https://ideas.repec.org/a/gam/jmathe/v8y2020i8p1233-d390292.html
   My bibliography  Save this article

Dimension Reduction of Machine Learning-Based Forecasting Models Employing Principal Component Analysis

Author

Listed:
  • Yinghui Meng

    (School of Computer and Communication Engineering, Zhengzhou University of Light Industry, Zhengzhou 450002, China)

  • Sultan Noman Qasem

    (Computer Science Department, College of Computer and Information Sciences, Al Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
    Computer Science Department, Faculty of Applied Science, Taiz University, Taiz, Yemen)

  • Manouchehr Shokri

    (Faculty of civil engineering, Institute of Structural Mechanics (ISM), Bauhaus-Universität Weimar, 99423 Weimar, Germany)

  • Shahab S

    (Institute of Research and Development, Duy Tan University, Da Nang 550000, Vietnam)

Abstract

In this research, an attempt was made to reduce the dimension of wavelet-ANFIS/ANN (artificial neural network/adaptive neuro-fuzzy inference system) models toward reliable forecasts as well as to decrease computational cost. In this regard, the principal component analysis was performed on the input time series decomposed by a discrete wavelet transform to feed the ANN/ANFIS models. The models were applied for dissolved oxygen (DO) forecasting in rivers which is an important variable affecting aquatic life and water quality. The current values of DO, water surface temperature, salinity, and turbidity have been considered as the input variable to forecast DO in a three-time step further. The results of the study revealed that PCA can be employed as a powerful tool for dimension reduction of input variables and also to detect inter-correlation of input variables. Results of the PCA-wavelet-ANN models are compared with those obtained from wavelet-ANN models while the earlier one has the advantage of less computational time than the later models. Dealing with ANFIS models, PCA is more beneficial to avoid wavelet-ANFIS models creating too many rules which deteriorate the efficiency of the ANFIS models. Moreover, manipulating the wavelet-ANFIS models utilizing PCA leads to a significant decreasing in computational time. Finally, it was found that the PCA-wavelet-ANN/ANFIS models can provide reliable forecasts of dissolved oxygen as an important water quality indicator in rivers.

Suggested Citation

  • Yinghui Meng & Sultan Noman Qasem & Manouchehr Shokri & Shahab S, 2020. "Dimension Reduction of Machine Learning-Based Forecasting Models Employing Principal Component Analysis," Mathematics, MDPI, vol. 8(8), pages 1-15, July.
  • Handle: RePEc:gam:jmathe:v:8:y:2020:i:8:p:1233-:d:390292
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/2227-7390/8/8/1233/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/2227-7390/8/8/1233/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Ali Ahani & Mojtaba Shourian & Peiman Rahimi Rad, 2018. "Performance Assessment of the Linear, Nonlinear and Nonparametric Data Driven Models in River Flow Forecasting," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 32(2), pages 383-399, January.
    2. Xing Zhang & Zhuoqun Wei, 2019. "A Hybrid Model Based on Principal Component Analysis, Wavelet Transform, and Extreme Learning Machine Optimized by Bat Algorithm for Daily Solar Radiation Forecasting," Sustainability, MDPI, vol. 11(15), pages 1-20, July.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Lihuan Guo & Wei Wang & Yenchun Jim Wu, 2023. "What Do Scholars Propose for Future COVID-19 Research in Academic Publications? A Topic Analysis Based on Autoencoder," SAGE Open, , vol. 13(2), pages 21582440231, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Wei Sun & Junjian Zhang, 2020. "Carbon Price Prediction Based on Ensemble Empirical Mode Decomposition and Extreme Learning Machine Optimized by Improved Bat Algorithm Considering Energy Price Factors," Energies, MDPI, vol. 13(13), pages 1-22, July.
    2. Na Sun & Nan Zhang & Shuai Zhang & Tian Peng & Wei Jiang & Jie Ji & Xiangmiao Hao, 2022. "An Integrated Framework Based on an Improved Gaussian Process Regression and Decomposition Technique for Hourly Solar Radiation Forecasting," Sustainability, MDPI, vol. 14(22), pages 1-22, November.
    3. Lingqi Li & Kai Wu & Enhui Jiang & Huijuan Yin & Yuanjian Wang & Shimin Tian & Suzhen Dang, 2021. "Evaluating Runoff-Sediment Relationship Variations Using Generalized Additive Models That Incorporate Reservoir Indices for Check Dams," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(11), pages 3845-3860, September.
    4. Ran-Ran He & Yuanfang Chen & Qin Huang & Zheng-Wei Pan & Yong Liu, 2020. "Predictability of Monthly Streamflow Time Series and its Relationship with Basin Characteristics: an Empirical Study Based on the MOPEX Basins," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 34(15), pages 4991-5007, December.
    5. Fugang LI & Guangwen MA & Shijun CHEN & Weibin HUANG, 2021. "An Ensemble Modeling Approach to Forecast Daily Reservoir Inflow Using Bidirectional Long- and Short-Term Memory (Bi-LSTM), Variational Mode Decomposition (VMD), and Energy Entropy Method," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(9), pages 2941-2963, July.
    6. Saeid Mehdizadeh & Ali Kozekalani Sales, 2018. "A Comparative Study of Autoregressive, Autoregressive Moving Average, Gene Expression Programming and Bayesian Networks for Estimating Monthly Streamflow," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 32(9), pages 3001-3022, July.
    7. Yi Liang & Haichao Wang & Wei-Chiang Hong, 2021. "Sustainable Development Evaluation of Innovation and Entrepreneurship Education of Clean Energy Major in Colleges and Universities Based on SPA-VFS and GRNN Optimized by Chaos Bat Algorithm," Sustainability, MDPI, vol. 13(11), pages 1-26, May.
    8. L. M. Fernández-Ahumada & J. Ramírez-Faz & R. López-Luque & A. Márquez-García & M. Varo-Martínez, 2019. "A Methodology for Buildings Access to Solar Radiation in Sustainable Cities," Sustainability, MDPI, vol. 11(23), pages 1-17, November.
    9. Ahmad Khazaee Poul & Mojtaba Shourian & Hadi Ebrahimi, 2019. "A Comparative Study of MLR, KNN, ANN and ANFIS Models with Wavelet Transform in Monthly Stream Flow Prediction," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 33(8), pages 2907-2923, June.
    10. Saeid Mehdizadeh, 2020. "Using AR, MA, and ARMA Time Series Models to Improve the Performance of MARS and KNN Approaches in Monthly Precipitation Modeling under Limited Climatic Data," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 34(1), pages 263-282, January.
    11. Alireza Emadi & Reza Sobhani & Hossein Ahmadi & Arezoo Boroomandnia & Sarvin Zamanzad-Ghavidel & Hazi Mohammad Azamathulla, 2022. "Multivariate modeling of agricultural river water abstraction via novel integrated-wavelet methods in various climatic conditions," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 24(4), pages 4845-4871, April.
    12. MacMillan, Andrew & Schell, Kristen R. & Roughley, Colter, 2023. "A predictive model of velocity for local hydrokinetic power assessment based on remote sensing data," Renewable Energy, Elsevier, vol. 211(C), pages 285-295.
    13. Meysam Alizamir & Kaywan Othman Ahmed & Jalal Shiri & Ahmad Fakheri Fard & Sungwon Kim & Salim Heddam & Ozgur Kisi, 2023. "A New Insight for Daily Solar Radiation Prediction by Meteorological Data Using an Advanced Artificial Intelligence Algorithm: Deep Extreme Learning Machine Integrated with Variational Mode Decomposit," Sustainability, MDPI, vol. 15(14), pages 1-35, July.
    14. Muhammad Aslam & Jae-Myeong Lee & Mustafa Raed Altaha & Seung-Jae Lee & Sugwon Hong, 2020. "AE-LSTM Based Deep Learning Model for Degradation Rate Influenced Energy Estimation of a PV System," Energies, MDPI, vol. 13(17), pages 1-14, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jmathe:v:8:y:2020:i:8:p:1233-:d:390292. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.