IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v308y2024ics0360544224027531.html
   My bibliography  Save this article

Evaluating missing data handling methods for developing building energy benchmarking models

Author

Listed:
  • Lee, Kyungjae
  • Lim, Hyunwoo
  • Hwang, Jeongyun
  • Lee, Doyeon

Abstract

This study explored methods for handling missing data in the development of machine learning-based energy benchmarking models, assessing their training time, performance, and variance. Unlike the common assumption of missing completely at random, this study adopted a missing at random (MAR) perspective, which is more appropriate for building data. We compared the inherent missing data handling method of extreme gradient boosting (XGBoost) with the Median, k-nearest neighbors (KNN), and classification and regression trees (CART) methods, alongside Shapley additive explanation (SHAP) method for model interpretability. The findings indicate that, despite its computational demands, the CART method most accurately mirrors the original data distribution, thereby enhancing model performance and stability. The KNN method is effective, while the XGBoost method is viable under computational time constraints. This work highlights the importance of reliable test data for performing accurate evaluations of imputation methods. These results offer guidelines for the selection of imputation methods in model development, contributing to the improved accuracy of energy benchmarking models. The MAR-based approach for missing data analysis holds promise for future research on building energy data, providing crucial insights for accurate energy benchmark model performance assessments.

Suggested Citation

  • Lee, Kyungjae & Lim, Hyunwoo & Hwang, Jeongyun & Lee, Doyeon, 2024. "Evaluating missing data handling methods for developing building energy benchmarking models," Energy, Elsevier, vol. 308(C).
  • Handle: RePEc:eee:energy:v:308:y:2024:i:c:s0360544224027531
    DOI: 10.1016/j.energy.2024.132979
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0360544224027531
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2024.132979?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Pino-Mejías, Rafael & Pérez-Fargallo, Alexis & Rubio-Bellido, Carlos & Pulido-Arcas, Jesús A., 2017. "Comparison of linear regression and artificial neural networks models to predict heating and cooling energy demand, energy consumption and CO2 emissions," Energy, Elsevier, vol. 118(C), pages 24-36.
    2. Papadopoulos, Sokratis & Kontokosta, Constantine E., 2019. "Grading buildings on energy performance using city benchmarking data," Applied Energy, Elsevier, vol. 233, pages 244-253.
    3. Robinson, Caleb & Dilkina, Bistra & Hubbs, Jeffrey & Zhang, Wenwen & Guhathakurta, Subhrajit & Brown, Marilyn A. & Pendyala, Ram M., 2017. "Machine learning approaches for estimating commercial building energy consumption," Applied Energy, Elsevier, vol. 208(C), pages 889-904.
    4. Olanrewaju Akande & Fan Li & Jerome Reiter, 2017. "An Empirical Comparison of Multiple Imputation Methods for Categorical Data," The American Statistician, Taylor & Francis Journals, vol. 71(2), pages 162-170, April.
    5. Arjunan, Pandarasamy & Poolla, Kameshwar & Miller, Clayton, 2020. "EnergyStar++: Towards more accurate and explanatory building energy benchmarking," Applied Energy, Elsevier, vol. 276(C).
    6. Amasyali, Kadir & El-Gohary, Nora M., 2018. "A review of data-driven building energy consumption prediction studies," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1192-1205.
    7. Nguyen, Anh-Tuan & Reiter, Sigrid & Rigo, Philippe, 2014. "A review on simulation-based optimization methods applied to building performance analysis," Applied Energy, Elsevier, vol. 113(C), pages 1043-1058.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Yesilyurt, Hasan & Dokuz, Yesim & Dokuz, Ahmet Sakir, 2024. "Data-driven energy consumption prediction of a university office building using machine learning algorithms," Energy, Elsevier, vol. 310(C).
    2. Li, Tian & Bie, Haipei & Lu, Yi & Sawyer, Azadeh Omidfar & Loftness, Vivian, 2024. "MEBA: AI-powered precise building monthly energy benchmarking approach," Applied Energy, Elsevier, vol. 359(C).
    3. Guo, Yanhua & Wang, Ningbo & Shao, Shuangquan & Huang, Congqi & Zhang, Zhentao & Li, Xiaoqiong & Wang, Youdong, 2024. "A review on hybrid physics and data-driven modeling methods applied in air source heat pump systems for energy efficiency improvement," Renewable and Sustainable Energy Reviews, Elsevier, vol. 204(C).
    4. Langevin, J. & Reyna, J.L. & Ebrahimigharehbaghi, S. & Sandberg, N. & Fennell, P. & Nägeli, C. & Laverge, J. & Delghust, M. & Mata, É. & Van Hove, M. & Webster, J. & Federico, F. & Jakob, M. & Camaras, 2020. "Developing a common approach for classifying building stock energy models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 133(C).
    5. Wang, Ran & Lu, Shilei & Feng, Wei, 2020. "A novel improved model for building energy consumption prediction based on model integration," Applied Energy, Elsevier, vol. 262(C).
    6. Wenninger, Simon & Kaymakci, Can & Wiethe, Christian, 2022. "Explainable long-term building energy consumption prediction using QLattice," Applied Energy, Elsevier, vol. 308(C).
    7. Salah Vaisi & Saleh Mohammadi & Benedetto Nastasi & Kavan Javanroodi, 2020. "A New Generation of Thermal Energy Benchmarks for University Buildings," Energies, MDPI, vol. 13(24), pages 1-18, December.
    8. Venkatraj, V. & Dixit, M.K., 2022. "Challenges in implementing data-driven approaches for building life cycle energy assessment: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    9. Razak Olu-Ajayi & Hafiz Alaka & Hakeem Owolabi & Lukman Akanbi & Sikiru Ganiyu, 2023. "Data-Driven Tools for Building Energy Consumption Prediction: A Review," Energies, MDPI, vol. 16(6), pages 1-20, March.
    10. Xu, Yuanjin & Li, Fei & Asgari, Armin, 2022. "Prediction and optimization of heating and cooling loads in a residential building based on multi-layer perceptron neural network and different optimization algorithms," Energy, Elsevier, vol. 240(C).
    11. Andrews, Abigail & Jain, Rishee K., 2022. "Beyond Energy Efficiency: A clustering approach to embed demand flexibility into building energy benchmarking," Applied Energy, Elsevier, vol. 327(C).
    12. Liu, Xue & Ding, Yong & Tang, Hao & Fan, Lingxiao & Lv, Jie, 2022. "Investigating the effects of key drivers on energy consumption of nonresidential buildings: A data-driven approach integrating regularization and quantile regression," Energy, Elsevier, vol. 244(PA).
    13. Altieri, Domenico & Patel, Martin K. & Lazarus, Joël & Branca, Giovanni, 2023. "Numerical analysis of low-cost optimization measures for improving energy efficiency in residential buildings," Energy, Elsevier, vol. 273(C).
    14. García Kerdan, Iván & Morillón Gálvez, David, 2020. "Artificial neural network structure optimisation for accurately prediction of exergy, comfort and life cycle cost performance of a low energy building," Applied Energy, Elsevier, vol. 280(C).
    15. Chen, Xia & Geyer, Philipp, 2022. "Machine assistance in energy-efficient building design: A predictive framework toward dynamic interaction with human decision-making under uncertainty," Applied Energy, Elsevier, vol. 307(C).
    16. Miriam Benedetti & Francesca Bonfà & Vito Introna & Annalisa Santolamazza & Stefano Ubertini, 2019. "Real Time Energy Performance Control for Industrial Compressed Air Systems: Methodology and Applications," Energies, MDPI, vol. 12(20), pages 1-28, October.
    17. Tian, Wei & Heo, Yeonsook & de Wilde, Pieter & Li, Zhanyong & Yan, Da & Park, Cheol Soo & Feng, Xiaohang & Augenbroe, Godfried, 2018. "A review of uncertainty analysis in building energy assessment," Renewable and Sustainable Energy Reviews, Elsevier, vol. 93(C), pages 285-301.
    18. Luca Gugliermetti & Fabrizio Cumo & Sofia Agostinelli, 2024. "A Future Direction of Machine Learning for Building Energy Management: Interpretable Models," Energies, MDPI, vol. 17(3), pages 1-27, February.
    19. Yue, Naihua & Caini, Mauro & Li, Lingling & Zhao, Yang & Li, Yu, 2023. "A comparison of six metamodeling techniques applied to multi building performance vectors prediction on gymnasiums under multiple climate conditions," Applied Energy, Elsevier, vol. 332(C).
    20. Ahlrichs, Jakob & Rockstuhl, Sebastian & Tränkler, Timm & Wenninger, Simon, 2020. "The impact of political instruments on building energy retrofits: A risk-integrated thermal Energy Hub approach," Energy Policy, Elsevier, vol. 147(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:308:y:2024:i:c:s0360544224027531. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.