IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v193y2024ics1364032124000066.html
   My bibliography  Save this article

A protocol for developing and evaluating neural network-based surrogate models and its application to building energy prediction

Author

Listed:
  • Hou, D.
  • Evins, R.

Abstract

Because of their low computational costs, surrogate models (SMs), also known as meta-models, have attracted attention as simplified approximations of detailed simulations. Besides conventional statistical approaches, machine-learning techniques, such as neural networks (NNs), have been used to develop surrogate models. However, surrogate models based on NNs are currently not developed in a consistent manner. The development process of the models is not adequately described in most studies. There may be some doubt regarding the abilities of such models due to a lack of documented validation. In order to address these issues, this paper presents a protocol for the systematic development of NN-based surrogate models and how the procedure should be reported and justified. The protocol covers the model development procedure sample generation, data processing, SM training and validation, how to report the implementation, and how to justify the modeling choices.

Suggested Citation

  • Hou, D. & Evins, R., 2024. "A protocol for developing and evaluating neural network-based surrogate models and its application to building energy prediction," Renewable and Sustainable Energy Reviews, Elsevier, vol. 193(C).
    • Handle: RePEc:eee:rensus:v:193:y:2024:i:c:s1364032124000066
    DOI: 10.1016/j.rser.2024.114283
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S1364032124000066
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.rser.2024.114283?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Luo, Na & Langevin, Jared & Chandra-Putra, Handi & Lee, Sang Hoon, 2022. "Quantifying the effect of multiple load flexibility strategies on commercial building electricity demand and services via surrogate modeling," Applied Energy, Elsevier, vol. 309(C).
    2. Jee-Heon Kim & Nam-Chul Seong & Wonchang Choi, 2019. "Modeling and Optimizing a Chiller System Using a Machine Learning Algorithm," Energies, MDPI, vol. 12(15), pages 1-13, July.
    3. Pino-Mejías, Rafael & Pérez-Fargallo, Alexis & Rubio-Bellido, Carlos & Pulido-Arcas, Jesús A., 2017. "Comparison of linear regression and artificial neural networks models to predict heating and cooling energy demand, energy consumption and CO2 emissions," Energy, Elsevier, vol. 118(C), pages 24-36.
    4. Thrampoulidis, Emmanouil & Mavromatidis, Georgios & Lucchi, Aurelien & Orehounig, Kristina, 2021. "A machine learning-based surrogate model to approximate optimal building retrofit solutions," Applied Energy, Elsevier, vol. 281(C).
    5. Seunghui Lee & Sungwon Jung & Jaewook Lee, 2019. "Prediction Model Based on an Artificial Neural Network for User-Based Building Energy Consumption in South Korea," Energies, MDPI, vol. 12(4), pages 1-18, February.
    6. David Moher & Alessandro Liberati & Jennifer Tetzlaff & Douglas G Altman & The PRISMA Group, 2009. "Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement," PLOS Medicine, Public Library of Science, vol. 6(7), pages 1-6, July.
    7. Zhang, Liang & Wen, Jin & Li, Yanfei & Chen, Jianli & Ye, Yunyang & Fu, Yangyang & Livingood, William, 2021. "A review of machine learning in building load prediction," Applied Energy, Elsevier, vol. 285(C).
    8. Yaolin Lin & Shiquan Zhou & Wei Yang & Chun-Qing Li, 2018. "Design Optimization Considering Variable Thermal Mass, Insulation, Absorptance of Solar Radiation, and Glazing Ratio Using a Prediction Model and Genetic Algorithm," Sustainability, MDPI, vol. 10(2), pages 1-15, January.
    9. Kim, Wonuk & Jeon, Yongseok & Kim, Yongchan, 2016. "Simulation-based optimization of an integrated daylighting and HVAC system using the design of experiments method," Applied Energy, Elsevier, vol. 162(C), pages 666-674.
    10. Mauricio Nath Lopes & Roberto Lamberts, 2018. "Development of a Metamodel to Predict Cooling Energy Consumption of HVAC Systems in Office Buildings in Different Climates," Sustainability, MDPI, vol. 10(12), pages 1-25, December.
    11. Chegari, Badr & Tabaa, Mohamed & Simeu, Emmanuel & Moutaouakkil, Fouad & Medromi, Hicham, 2022. "An optimal surrogate-model-based approach to support comfortable and nearly zero energy buildings design," Energy, Elsevier, vol. 248(C).
    12. Jason Runge & Radu Zmeureanu, 2019. "Forecasting Energy Use in Buildings Using Artificial Neural Networks: A Review," Energies, MDPI, vol. 12(17), pages 1-27, August.
    13. Berk Ekici & Okan F. S. F. Turkcan & Michela Turrin & Ikbal Sevil Sariyildiz & Mehmet Fatih Tasgetiren, 2022. "Optimising High-Rise Buildings for Self-Sufficiency in Energy Consumption and Food Production Using Artificial Intelligence: Case of Europoint Complex in Rotterdam," Energies, MDPI, vol. 15(2), pages 1-35, January.
    14. Hossein Moayedi & Amir Mosavi, 2021. "Double-Target Based Neural Networks in Predicting Energy Consumption in Residential Buildings," Energies, MDPI, vol. 14(5), pages 1-25, March.
    15. Ciulla, G. & D'Amico, A. & Lo Brano, V. & Traverso, M., 2019. "Application of optimized artificial intelligence algorithm to evaluate the heating energy demand of non-residential buildings at European level," Energy, Elsevier, vol. 176(C), pages 380-391.
    16. Wang, Lan & Lee, Eric W.M. & Yuen, Richard K.K., 2018. "Novel dynamic forecasting model for building cooling loads combining an artificial neural network and an ensemble approach," Applied Energy, Elsevier, vol. 228(C), pages 1740-1753.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    2. Razak Olu-Ajayi & Hafiz Alaka & Hakeem Owolabi & Lukman Akanbi & Sikiru Ganiyu, 2023. "Data-Driven Tools for Building Energy Consumption Prediction: A Review," Energies, MDPI, vol. 16(6), pages 1-20, March.
    3. Bin Xu & Xiang Yuan, 2022. "A Novel Method of BP Neural Network Based Green Building Design—The Case of Hotel Buildings in Hot Summer and Cold Winter Region of China," Sustainability, MDPI, vol. 14(4), pages 1-22, February.
    4. Gautham Krishnadas & Aristides Kiprakis, 2020. "A Machine Learning Pipeline for Demand Response Capacity Scheduling," Energies, MDPI, vol. 13(7), pages 1-25, April.
    5. Manuel R. Arahal & Manuel G. Ortega & Manuel G. Satué, 2021. "Chiller Load Forecasting Using Hyper-Gaussian Nets," Energies, MDPI, vol. 14(12), pages 1-15, June.
    6. Wangqi Xiong & Jiandong Wang, 2020. "Minimizing Power Consumption of an Experimental HVAC System Based on Parallel Grid Searching," Energies, MDPI, vol. 13(8), pages 1-18, April.
    7. Wang, Zeyu & Liu, Jian & Zhang, Yuanxin & Yuan, Hongping & Zhang, Ruixue & Srinivasan, Ravi S., 2021. "Practical issues in implementing machine-learning models for building energy efficiency: Moving beyond obstacles," Renewable and Sustainable Energy Reviews, Elsevier, vol. 143(C).
    8. Leonidas Zouloumis & Georgios Stergianakos & Nikolaos Ploskas & Giorgos Panaras, 2021. "Dynamic Simulation-Based Surrogate Model for the Dimensioning of Building Energy Systems," Energies, MDPI, vol. 14(21), pages 1-13, November.
    9. Aliyon, Kasra & Rajaee, Fatemeh & Ritvanen, Jouni, 2023. "Use of artificial intelligence in reducing energy costs of a post-combustion carbon capture plant," Energy, Elsevier, vol. 278(PA).
    10. Cao, Wenqiang & Yu, Junqi & Chao, Mengyao & Wang, Jingqi & Yang, Siyuan & Zhou, Meng & Wang, Meng, 2023. "Short-term energy consumption prediction method for educational buildings based on model integration," Energy, Elsevier, vol. 283(C).
    11. Gao, Zhikun & Yang, Siyuan & Yu, Junqi & Zhao, Anjun, 2024. "Hybrid forecasting model of building cooling load based on combined neural network," Energy, Elsevier, vol. 297(C).
    12. Ahmed Abdelaziz & Vitor Santos & Miguel Sales Dias, 2021. "Machine Learning Techniques in the Energy Consumption of Buildings: A Systematic Literature Review Using Text Mining and Bibliometric Analysis," Energies, MDPI, vol. 14(22), pages 1-31, November.
    13. İlkay Unay-Gailhard & Mark A. Brennen, 2022. "How digital communications contribute to shaping the career paths of youth: a review study focused on farming as a career option," Agriculture and Human Values, Springer;The Agriculture, Food, & Human Values Society (AFHVS), vol. 39(4), pages 1491-1508, December.
    14. Mahin Ghafari & Vali Baigi & Zahra Cheraghi & Amin Doosti-Irani, 2016. "The Prevalence of Asymptomatic Bacteriuria in Iranian Pregnant Women: A Systematic Review and Meta-Analysis," PLOS ONE, Public Library of Science, vol. 11(6), pages 1-10, June.
    15. Elizabeth T Cafiero-Fonseca & Andrew Stawasz & Sydney T Johnson & Reiko Sato & David E Bloom, 2017. "The full benefits of adult pneumococcal vaccination: A systematic review," PLOS ONE, Public Library of Science, vol. 12(10), pages 1-23, October.
    16. Santos Urbina & Sofía Villatoro & Jesús Salinas, 2021. "Self-Regulated Learning and Technology-Enhanced Learning Environments in Higher Education: A Scoping Review," Sustainability, MDPI, vol. 13(13), pages 1-12, June.
    17. Oded Berger-Tal & Alison L Greggor & Biljana Macura & Carrie Ann Adams & Arden Blumenthal & Amos Bouskila & Ulrika Candolin & Carolina Doran & Esteban Fernández-Juricic & Kiyoko M Gotanda & Catherine , 2019. "Systematic reviews and maps as tools for applying behavioral ecology to management and policy," Behavioral Ecology, International Society for Behavioral Ecology, vol. 30(1), pages 1-8.
    18. Nadine Desrochers & Adèle Paul‐Hus & Jen Pecoskie, 2017. "Five decades of gratitude: A meta‐synthesis of acknowledgments research," Journal of the Association for Information Science & Technology, Association for Information Science & Technology, vol. 68(12), pages 2821-2833, December.
    19. Maryono, Maryono & Killoes, Aditya Marendra & Adhikari, Rajendra & Abdul Aziz, Ammar, 2024. "Agriculture development through multi-stakeholder partnerships in developing countries: A systematic literature review," Agricultural Systems, Elsevier, vol. 213(C).
    20. Alene Sze Jing Yong & Yi Heng Lim & Mark Wing Loong Cheong & Ednin Hamzah & Siew Li Teoh, 2022. "Willingness-to-pay for cancer treatment and outcome: a systematic review," The European Journal of Health Economics, Springer;Deutsche Gesellschaft für Gesundheitsökonomie (DGGÖ), vol. 23(6), pages 1037-1057, August.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:193:y:2024:i:c:s1364032124000066. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.