IDEAS home Printed from https://ideas.repec.org/a/spr/waterr/v35y2021i1d10.1007_s11269-020-02704-3.html
   My bibliography  Save this article

Ensemble Boosting and Bagging Based Machine Learning Models for Groundwater Potential Prediction

Author

Listed:
  • Amirhosein Mosavi

    (Ton Duc Thang University
    Ton Duc Thang University)

  • Farzaneh Sajedi Hosseini

    (University of Tehran)

  • Bahram Choubin

    (West Azarbaijan Agricultural and Natural Resources Research and Education Center, AREEO)

  • Massoud Goodarzi

    (Soil Conservation and Watershed Management Research Institute (SCWMRI), AREEO)

  • Adrienn A. Dineva

    (Duy Tan University)

  • Elham Rafiei Sardooi

    (University of Jiroft)

Abstract

Due to the rapidly increasing demand for groundwater, as one of the principal freshwater resources, there is an urge to advance novel prediction systems to more accurately estimate the groundwater potential for an informed groundwater resource management. Ensemble machine learning methods are generally reported to produce more accurate results. However, proposing the novel ensemble models along with running comparative studies for performance evaluation of these models would be equally essential to precisely identify the suitable methods. Thus, the current study is designed to provide knowledge on the performance of the four ensemble models i.e., Boosted generalized additive model (GamBoost), adaptive Boosting classification trees (AdaBoost), Bagged classification and regression trees (Bagged CART), and random forest (RF). To build the models, 339 groundwater resources’ locations and the spatial groundwater potential conditioning factors were used. Thereafter, the recursive feature elimination (RFE) method was applied to identify the key features. The RFE specified that the best number of features for groundwater potential modeling was 12 variables among 15 (with a mean Accuracy of about 0.84). The modeling results indicated that the Bagging models (i.e., RF and Bagged CART) had a higher performance than the Boosting models (i.e., AdaBoost and GamBoost). Overall, the RF model outperformed the other models (with accuracy = 0.86, Kappa = 0.67, Precision = 0.85, and Recall = 0.91). Also, the topographic position index’s predictive variables, valley depth, drainage density, elevation, and distance from stream had the highest contribution in the modeling process. Groundwater potential maps predicted in this study can help water resources managers and policymakers in the fields of watershed and aquifer management to preserve an optimal exploit from this important freshwater.

Suggested Citation

  • Amirhosein Mosavi & Farzaneh Sajedi Hosseini & Bahram Choubin & Massoud Goodarzi & Adrienn A. Dineva & Elham Rafiei Sardooi, 2021. "Ensemble Boosting and Bagging Based Machine Learning Models for Groundwater Potential Prediction," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(1), pages 23-37, January.
  • Handle: RePEc:spr:waterr:v:35:y:2021:i:1:d:10.1007_s11269-020-02704-3
    DOI: 10.1007/s11269-020-02704-3
    as

    Download full text from publisher

    File URL: http://link.springer.com/10.1007/s11269-020-02704-3
    File Function: Abstract
    Download Restriction: Access to the full text of the articles in this series is restricted.

    File URL: https://libkey.io/10.1007/s11269-020-02704-3?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Andreas Mayr & Nora Fenske & Benjamin Hofner & Thomas Kneib & Matthias Schmid, 2012. "Generalized additive models for location, scale and shape for high dimensional data—a flexible approach based on boosting," Journal of the Royal Statistical Society Series C, Royal Statistical Society, vol. 61(3), pages 403-427, May.
    2. Lemmens, A. & Croux, C., 2006. "Bagging and boosting classification trees to predict churn," Other publications TiSEM d5cb664d-5859-44db-a621-e, Tilburg University, School of Economics and Management.
    3. Rajat Agarwal & P. Garg, 2016. "Remote Sensing and GIS Based Groundwater Potential & Recharge Zones Mapping Using Multi-Criteria Decision Making Technique," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 30(1), pages 243-260, January.
    4. Feng, Cong & Cui, Mingjian & Hodge, Bri-Mathias & Zhang, Jie, 2017. "A data-driven multi-model methodology with deep feature selection for short-term wind forecasting," Applied Energy, Elsevier, vol. 190(C), pages 1245-1257.
    5. Shruti Sachdeva & Bijendra Kumar, 2020. "A Comparative Study between Frequency Ratio Model and Gradient Boosted Decision Trees with Greedy Dimensionality Reduction in Groundwater Potential Assessment," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 34(15), pages 4593-4615, December.
    6. Hofner, Benjamin & Mayr, Andreas & Schmid, Matthias, 2016. "gamboostLSS: An R Package for Model Building and Variable Selection in the GAMLSS Framework," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 74(i01).
    7. Rajat Agarwal & P. K. Garg, 2016. "Remote Sensing and GIS Based Groundwater Potential & Recharge Zones Mapping Using Multi-Criteria Decision Making Technique," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 30(1), pages 243-260, January.
    8. Shaghayegh Miraki & Sasan Hedayati Zanganeh & Kamran Chapi & Vijay P. Singh & Ataollah Shirzadi & Himan Shahabi & Binh Thai Pham, 2019. "Mapping Groundwater Potential Using a Novel Hybrid Intelligence Approach," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 33(1), pages 281-302, January.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. You-Shyang Chen & Chien-Ku Lin & Chih-Min Lo & Su-Fen Chen & Qi-Jun Liao, 2021. "Comparable Studies of Financial Bankruptcy Prediction Using Advanced Hybrid Intelligent Classification Models to Provide Early Warning in the Electronics Industry," Mathematics, MDPI, vol. 9(20), pages 1-26, October.
    2. Li-Ya Wu & Sung-Shun Weng, 2021. "Ensemble Learning Models for Food Safety Risk Prediction," Sustainability, MDPI, vol. 13(21), pages 1-26, November.
    3. Ahmad Jafarzadeh & Abbas Khashei-Siuki & Mohsen Pourreza-Bilondi, 2022. "Performance Assessment of Model Averaging Techniques to Reduce Structural Uncertainty of Groundwater Modeling," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(1), pages 353-377, January.
    4. Duong Hai Ha & Phong Tung Nguyen & Romulus Costache & Nadhir Al-Ansari & Tran Phong & Huu Duy Nguyen & Mahdis Amiri & Rohit Sharma & Indra Prakash & Hiep Le & Hanh Bich Thi Nguyen & Binh Thai Pham, 2021. "Quadratic Discriminant Analysis Based Ensemble Machine Learning Models for Groundwater Potential Modeling and Mapping," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(13), pages 4415-4433, October.
    5. Abinash Mohanta & Arpan Pradhan & Monalisa Mallick & K. C. Patra, 2021. "Assessment of Shear Stress Distribution in Meandering Compound Channels with Differential Roughness Through Various Artificial Intelligence Approach," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(13), pages 4535-4559, October.
    6. Kagiso Samuel More & Christian Wolkersdorfer, 2022. "Predicting and Forecasting Mine Water Parameters Using a Hybrid Intelligent System," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(8), pages 2813-2826, June.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Riccardo De Bin & Vegard Grødem Stikbakke, 2023. "A boosting first-hitting-time model for survival analysis in high-dimensional settings," Lifetime Data Analysis: An International Journal Devoted to Statistical Methods and Applications for Time-to-Event Data, Springer, vol. 29(2), pages 420-440, April.
    2. Shabnam Mehrnoor & Maryam Robati & Mir Masoud Kheirkhah Zarkesh & Forough Farsad & Shahram Baikpour, 2023. "Land subsidence hazard assessment based on novel hybrid approach: BWM, weighted overlay index (WOI), and support vector machine (SVM)," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 115(3), pages 1997-2030, February.
    3. Xue Wang & Kun Tan & Kailei Xu & Yu Chen & Jianwei Ding, 2019. "Quantitative Evaluation of the Eco-Environment in a Coalfield Based on Multi-Temporal Remote Sensing Imagery: A Case Study of Yuxian, China," IJERPH, MDPI, vol. 16(3), pages 1-18, February.
    4. Neslihan Beden & Nazire Göksu Soydan-Oksal & Sema Arıman & Hayatullah Ahmadzai, 2023. "Delineation of a Groundwater Potential Zone Map for the Kızılırmak Delta by Using Remote-Sensing-Based Geospatial and Analytical Hierarchy Processes," Sustainability, MDPI, vol. 15(14), pages 1-21, July.
    5. Groll Andreas & Kneib Thomas & Mayr Andreas & Schauberger Gunther, 2018. "On the dependency of soccer scores – a sparse bivariate Poisson model for the UEFA European football championship 2016," Journal of Quantitative Analysis in Sports, De Gruyter, vol. 14(2), pages 65-79, June.
    6. Senapati, Ujjal & Das, Tapan Kumar, 2024. "Delineation of potential alternative agriculture region using RS and AHP-based GIS techniques in the drought prone upper Dwarakeswer river basin, West Bengal, India," Ecological Modelling, Elsevier, vol. 490(C).
    7. Duong Hai Ha & Phong Tung Nguyen & Romulus Costache & Nadhir Al-Ansari & Tran Phong & Huu Duy Nguyen & Mahdis Amiri & Rohit Sharma & Indra Prakash & Hiep Le & Hanh Bich Thi Nguyen & Binh Thai Pham, 2021. "Quadratic Discriminant Analysis Based Ensemble Machine Learning Models for Groundwater Potential Modeling and Mapping," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(13), pages 4415-4433, October.
    8. Ting Liu & Sherong Zhang & Chao Wang, 2021. "A BIM-Based Safety Management Framework for Operation and Maintenance in Water Diversion Projects," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 35(5), pages 1619-1635, March.
    9. Gilbert, Ciaran & Browell, Jethro & McMillan, David, 2021. "Probabilistic access forecasting for improved offshore operations," International Journal of Forecasting, Elsevier, vol. 37(1), pages 134-150.
    10. Boyao Zhang & Tobias Hepp & Sonja Greven & Elisabeth Bergherr, 2022. "Adaptive step-length selection in gradient boosting for Gaussian location and scale models," Computational Statistics, Springer, vol. 37(5), pages 2295-2332, November.
    11. Xinyang Liu & Yu Wang, 2022. "Identification and Assessment of Groundwater and Soil Contamination from an Informal Landfill Site," Sustainability, MDPI, vol. 14(24), pages 1-16, December.
    12. Pazhuparambil Jayarajan Sajil Kumar & Lakshmanan Elango & Michael Schneider, 2022. "GIS and AHP Based Groundwater Potential Zones Delineation in Chennai River Basin (CRB), India," Sustainability, MDPI, vol. 14(3), pages 1-22, February.
    13. Ujjayini Priya & Muhammad Anwar Iqbal & Mohammed Abdus Salam & Md. Nur-E-Alam & Mohammed Faruque Uddin & Abu Reza Md. Towfiqul Islam & Showmitra Kumar Sarkar & Saiful Islam Imran & Aweng Eh Rak, 2022. "Sustainable Groundwater Potential Zoning with Integrating GIS, Remote Sensing, and AHP Model: A Case from North-Central Bangladesh," Sustainability, MDPI, vol. 14(9), pages 1-24, May.
    14. Roshani Singh & Aditya Kumar Anand & Pallavi Banerjee Chattopadhyay, 2022. "Investigation of Topographical Controls on the Groundwater Potential Zone in a Hilly Watershed Using a Geospatial and Geophysical Approach," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 36(13), pages 5313-5333, October.
    15. Guigui Xu & Xiaosi Su & Yiwu Zhang & Bing You, 2021. "Identifying Potential Sites for Artificial Recharge in the Plain Area of the Daqing River Catchment Using GIS-Based Multi-Criteria Analysis," Sustainability, MDPI, vol. 13(7), pages 1-15, April.
    16. Veysel Aslan & Recep Çelik, 2021. "Integrated GIS-Based Multi-Criteria Analysis for Groundwater Potential Mapping in the Euphrates’s Sub-Basin, Harran Basin, Turkey," Sustainability, MDPI, vol. 13(13), pages 1-16, July.
    17. Ciro Figueiredo & Caroline Mota, 2019. "Learning Preferences in a Spatial Multiple Criteria Decision Approach: An Application in Public Security Planning," International Journal of Information Technology & Decision Making (IJITDM), World Scientific Publishing Co. Pte. Ltd., vol. 18(04), pages 1403-1432, July.
    18. Adam, Timo & Mayr, Andreas & Kneib, Thomas, 2022. "Gradient boosting in Markov-switching generalized additive models for location, scale, and shape," Econometrics and Statistics, Elsevier, vol. 22(C), pages 3-16.
    19. Uday Mandal & Satiprasad Sahoo & Selva Balaji Munusamy & Anirban Dhar & Sudhindra N. Panda & Amlanjyoti Kar & Prasanta K. Mishra, 2016. "Delineation of Groundwater Potential Zones of Coastal Groundwater Basin Using Multi-Criteria Decision Making Technique," Water Resources Management: An International Journal, Published for the European Water Resources Association (EWRA), Springer;European Water Resources Association (EWRA), vol. 30(12), pages 4293-4310, September.
    20. Nicolai Hans & Nadja Klein & Florian Faschingbauer & Michael Schneider & Andreas Mayr, 2023. "Boosting distributional copula regression," Biometrics, The International Biometric Society, vol. 79(3), pages 2298-2310, September.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:spr:waterr:v:35:y:2021:i:1:d:10.1007_s11269-020-02704-3. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Sonal Shukla or Springer Nature Abstracting and Indexing (email available below). General contact details of provider: http://www.springer.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.