IDEAS home Printed from https://ideas.repec.org/a/spr/waterr/v36y2022i11d10.1007_s11269-022-03248-4.html
   My bibliography  Save this article

Framework for Hyperparameter Impact Analysis and Selection for Water Resources Feedforward Neural Network

Author

Listed:
  • Xuan Wang

    (Tongji University)

  • Wenchong Tian

    (Tongji University)

  • Zhenliang Liao

    (Tongji University
    Xinjiang University)

Abstract

The Feedforward Neural Network (FNN) is currently commonly used in problems involving water resources. However, the hyperparameters have received minimal attention: (i) Very little research has looked at how the hyperparameters affect FNN performance. (ii) Trial-and-error hyperparameter selection may have a significant degree of randomness. For the impact analysis and selection of hyperparameters, a model-based framework was proposed in this study. Through the framework, it was possible to (i) estimate how the hyperparameters affect model performance, offering theoretical direction for the hyperparameter selection, and (ii) select the hyperparameters based on the posterior hyperparameter distributions, with a certain degree of robustness. A case study of surface water quality prediction was carried out with 1,492,992 FNNs developed and trained using different hyperparameter sets. Theoretical inferences from the hyperparameter impact analysis were drawn, and a set of hyperparameters was chosen based on the obtained posterior hyperparameter distributions. The framework’s applicability in the research on water resources FNN for the impact analysis and selection of hyperparameters was demonstrated through the case study.

Suggested Citation

  • Xuan Wang & Wenchong Tian & Zhenliang Liao, 2022. "Framework for Hyperparameter Impact Analysis and Selection for Water Resources Feedforward Neural Network," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(11), pages 4201-4217, September.
    • Handle: RePEc:spr:waterr:v:36:y:2022:i:11:d:10.1007_s11269-022-03248-4
    DOI: 10.1007/s11269-022-03248-4
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11269-022-03248-4
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.
    File URL: https://libkey.io/10.1007/s11269-022-03248-4?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Habibeh Sharifi & Abbas Roozbahani & Seied Mehdy Hashemy Shahdany, 2021. "Evaluating the Performance of Agricultural Water Distribution Systems Using FIS, ANN and ANFIS Intelligent Models," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(6), pages 1797-1816, April.
    2. S. Vijay & K. Kamaraj, 2021. "Prediction of Water Quality Index in Drinking Water Distribution System Using Activation Functions Based Ann," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(2), pages 535-553, January.
    3. Tian, Wenchong & Liao, Zhenliang & Zhang, Jin, 2017. "An optimization of artificial neural network model for predicting chlorophyll dynamics," Ecological Modelling, Elsevier, vol. 364(C), pages 42-52.
    4. Sandeep Bansal & Geetha Ganesan, 2019. "Advanced Evaluation Methodology for Water Quality Assessment Using Artificial Neural Network Approach," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 33(9), pages 3127-3141, July.
    5. Juliano Santos Finck & Olavo Correa Pedrollo, 2021. "Facing Losses of Telemetric Signal in Real Time Forecasting of Water Level using Artificial Neural Networks," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(3), pages 1119-1133, February.
    6. Lindenschmidt, Karl-Erich & Fleischbein, Katrin & Baborowski, Martina, 2007. "Structural uncertainty in a river water quality modelling system," Ecological Modelling, Elsevier, vol. 204(3), pages 289-300.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Laís Régis Salvino & Heber Pimentel Gomes & Saulo de Tarso Marques Bezerra, 2022. "Design of a Control System Using an Artificial Neural Network to Optimize the Energy Efficiency of Water Distribution Systems," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(8), pages 2779-2793, June.
    2. Zehai Gao & Yang Liu & Nan Li & Kangjie Ma, 2022. "An Enhanced Beetle Antennae Search Algorithm Based Comprehensive Water Quality Index for Urban River Water Quality Assessment," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(8), pages 2685-2702, June.
    3. Li, Y.P. & Huang, G.H. & Zhang, N. & Nie, S.L., 2011. "An inexact-stochastic with recourse model for developing regional economic-ecological sustainability under uncertainty," Ecological Modelling, Elsevier, vol. 222(2), pages 370-379.
    4. Icen Yoosefdoost & Abbas Khashei-Siuki & Hossein Tabari & Omolbani Mohammadrezapour, 2022. "Runoff Simulation Under Future Climate Change Conditions: Performance Comparison of Data-Mining Algorithms and Conceptual Models," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(4), pages 1191-1215, March.
    5. Huang, Jiacong & Gao, Junfeng & Liu, Jutao & Zhang, Yinjun, 2013. "State and parameter update of a hydrodynamic-phytoplankton model using ensemble Kalman filter," Ecological Modelling, Elsevier, vol. 263(C), pages 81-91.
    6. Wenxiang, Ding & Caiyun, Zhang & Shaoping, Shang & Xueding, Li, 2022. "Optimization of deep learning model for coastal chlorophyll a dynamic forecast," Ecological Modelling, Elsevier, vol. 467(C).
    7. Vinay Kumar Gautam & Chaitanya B. Pande & Kanak N. Moharir & Abhay M. Varade & Nitin Liladhar Rane & Johnbosco C. Egbueri & Fahad Alshehri, 2023. "Prediction of Sodium Hazard of Irrigation Purpose using Artificial Neural Network Modelling," Sustainability, MDPI, vol. 15(9), pages 1-17, May.
    8. Maharjan, Ganga Ram & Ruidisch, Marianne & Shope, Christopher L. & Choi, Kwanghun & Huwe, Bernd & Kim, Seong Joon & Tenhunen, John & Arnhold, Sebastian, 2016. "Assessing the effectiveness of split fertilization and cover crop cultivation in order to conserve soil and water resources and improve crop productivity," Agricultural Water Management, Elsevier, vol. 163(C), pages 305-318.
    9. Mojtaba Kadkhodazadeh & Saeed Farzin, 2021. "A Novel LSSVM Model Integrated with GBO Algorithm to Assessment of Water Quality Parameters," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(12), pages 3939-3968, September.
    10. Prashant K. Srivastava & Manika Gupta & Ujjwal Singh & Rajendra Prasad & Prem Chandra Pandey & A. S. Raghubanshi & George P. Petropoulos, 2021. "Sensitivity analysis of artificial neural network for chlorophyll prediction using hyperspectral data," Environment, Development and Sustainability: A Multidisciplinary Approach to the Theory and Practice of Sustainable Development, Springer, vol. 23(4), pages 5504-5519, April.
    11. Qiang Xu & Zhimin Qiang & Qiuwen Chen & Kuo Liu & Nan Cao, 2018. "A Superposed Model for the Pipe Failure Assessment of Water Distribution Networks and Uncertainty Analysis: A Case Study," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 32(5), pages 1713-1723, March.
    12. Costabile, Pierfranco & Costanzo, Carmelina & Gangi, Fabiola & De Gaetani, Carlo Iapige & Rossi, Lorenzo & Gandolfi, Claudio & Masseroni, Daniele, 2023. "High-resolution 2D modelling for simulating and improving the management of border irrigation," Agricultural Water Management, Elsevier, vol. 275(C).
    13. Parvin Golfam & Parisa-Sadat Ashofteh, 2022. "Performance Indexes Analysis of the Reservoir-Hydropower Plant System Affected by Climate Change," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(13), pages 5127-5162, October.
    14. Chao Liu & Mingshuang Xu & Yufeng Liu & Xuefei Li & Zonglin Pang & Sheng Miao, 2022. "Predicting Groundwater Indicator Concentration Based on Long Short-Term Memory Neural Network: A Case Study," IJERPH, MDPI, vol. 19(23), pages 1-14, November.
    15. Monika Kulisz & Justyna Kujawska & Bartosz Przysucha & Wojciech Cel, 2021. "Forecasting Water Quality Index in Groundwater Using Artificial Neural Network," Energies, MDPI, vol. 14(18), pages 1-17, September.
    16. Kooi, B.W. & Bontje, D. & van Voorn, G.A.K. & Kooijman, S.A.L.M., 2008. "Sublethal toxic effects in a simple aquatic food chain," Ecological Modelling, Elsevier, vol. 212(3), pages 304-318.
    17. Jingjing Xia & Jin Zeng, 2022. "Environmental Factors Assisted the Evaluation of Entropy Water Quality Indices with Efficient Machine Learning Technique," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(6), pages 2045-2060, April.
    18. Hye-Suk Yi & Sangyoung Park & Kwang-Guk An & Keun-Chang Kwak, 2018. "Algal Bloom Prediction Using Extreme Learning Machine Models at Artificial Weirs in the Nakdong River, Korea," IJERPH, MDPI, vol. 15(10), pages 1-20, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:waterr:v:36:y:2022:i:11:d:10.1007_s11269-022-03248-4. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.