IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v17y2024i17p4518-d1474242.html
   My bibliography  Save this article

LightGBM-, SHAP-, and Correlation-Matrix-Heatmap-Based Approaches for Analyzing Household Energy Data: Towards Electricity Self-Sufficient Houses

Author

Listed:
  • Nitin Kumar Singh

    (Graduate School of Life Science and Systems Engineering, Kyushu Institute of Technology, 2-4 Hibikino, Wakamatsu Campus, Kitakyushu 808-0196, Japan
    Graduate School of Advanced Science and Engineering, Hiroshima University, Higashi Hiroshima City 739-8527, Japan)

  • Masaaki Nagahara

    (Graduate School of Advanced Science and Engineering, Hiroshima University, Higashi Hiroshima City 739-8527, Japan)

Abstract

The rapidly growing global energy demand, environmental concerns, and the urgent need to reduce carbon footprints have made sustainable household energy consumption a critical priority. This study aims to analyze household energy data to predict the electricity self-sufficiency rate of households and extract meaningful insights that can enhance it. For this purpose, we use LightGBM (Light Gradient Boosting Machine)-, SHAP (SHapley Additive exPlanations)-, and correlation-heatmap-based approaches to analyze 12 months of energy and questionnaire survey data collected from over 200 smart houses in Kitakyushu, Japan. First, we use LightGBM to predict the ESSR of households and identify the key features that impact the prediction model. By using LightGBM, we demonstrated that the key features are the housing type, average monthly electricity bill, presence of floor heating system, average monthly gas bill, electricity tariff plan, electrical capacity, number of TVs, cooking equipment used, number of washing and drying machines, and the frequency of viewing home energy management systems (HEMSs). Furthermore, we adopted the LightGBM classifier with ℓ 1 regularization to extract the most significant features and established a statistical correlation between these features and the electricity self-sufficiency rate. This LightGBM-based model can also predict the electricity self-sufficiency rate of households that did not participate in the questionnaire survey. The LightGBM-based model offers a global view of feature importance but lacks detailed explanations for individual predictions. For this purpose, we used SHAP analysis to identify the impact-wise order of key features that influence the electricity self-sufficiency rate (ESSR) and evaluated the contribution of each feature to the model’s predictions. A heatmap is also used to analyze the correlation among household variables and the ESSR. To evaluate the performance of the classification model, we used a confusion matrix showing a good F1 score (Weighted Avg) of 0.90. The findings discussed in this article offer valuable insights for energy policymakers to achieve the objective of developing energy-self-sufficient houses.

Suggested Citation

  • Nitin Kumar Singh & Masaaki Nagahara, 2024. "LightGBM-, SHAP-, and Correlation-Matrix-Heatmap-Based Approaches for Analyzing Household Energy Data: Towards Electricity Self-Sufficient Houses," Energies, MDPI, vol. 17(17), pages 1-32, September.
    • Handle: RePEc:gam:jeners:v:17:y:2024:i:17:p:4518-:d:1474242
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/17/17/4518/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/17/17/4518/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Shang, Yitong & Li, Sen, 2024. "FedPT-V2G: Security enhanced federated transformer learning for real-time V2G dispatch with non-IID data," Applied Energy, Elsevier, vol. 358(C).
    2. Nitin Kumar Singh & Takuya Fukushima & Masaaki Nagahara, 2023. "Gradient Boosting Approach to Predict Energy-Saving Awareness of Households in Kitakyushu," Energies, MDPI, vol. 16(16), pages 1-10, August.
    3. Ozcan, Mustafa, 2018. "The role of renewables in increasing Turkey's self-sufficiency in electrical energy," Renewable and Sustainable Energy Reviews, Elsevier, vol. 82(P3), pages 2629-2639.
    4. Carl-Friedrich Schleussner & Joeri Rogelj & Michiel Schaeffer & Tabea Lissner & Rachel Licker & Erich M. Fischer & Reto Knutti & Anders Levermann & Katja Frieler & William Hare, 2016. "Science and policy characteristics of the Paris Agreement temperature goal," Nature Climate Change, Nature, vol. 6(9), pages 827-835, September.
    5. Zhu, Nanyang & Wang, Ying & Yuan, Kun & Yan, Jiahao & Li, Yaping & Zhang, Kaifeng, 2024. "GGNet: A novel graph structure for power forecasting in renewable power plants considering temporal lead-lag correlations," Applied Energy, Elsevier, vol. 364(C).
    6. Nejat, Payam & Jomehzadeh, Fatemeh & Taheri, Mohammad Mahdi & Gohari, Mohammad & Abd. Majid, Muhd Zaimi, 2015. "A global review of energy consumption, CO2 emissions and policy in the residential sector (with an overview of the top ten CO2 emitting countries)," Renewable and Sustainable Energy Reviews, Elsevier, vol. 43(C), pages 843-862.
    7. Tian, Jinfang & Yu, Longguang & Xue, Rui & Zhuang, Shan & Shan, Yuli, 2022. "Global low-carbon energy transition in the post-COVID-19 era," Applied Energy, Elsevier, vol. 307(C).
    8. Bruni, G. & Cordiner, S. & Mulone, V., 2014. "Domestic distributed power generation: Effect of sizing and energy management strategy on the environmental efficiency of a photovoltaic-battery-fuel cell system," Energy, Elsevier, vol. 77(C), pages 133-143.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Bulut, Umit & Muratoglu, Gonul, 2018. "Renewable energy in Turkey: Great potential, low but increasing utilization, and an empirical analysis on renewable energy-growth nexus," Energy Policy, Elsevier, vol. 123(C), pages 240-250.
    2. Afshin Tatar & Amin Shokrollahi & Abbas Zeinijahromi & Manouchehr Haghighi, 2024. "Deep Learning for Predicting Hydrogen Solubility in n-Alkanes: Enhancing Sustainable Energy Systems," Sustainability, MDPI, vol. 16(17), pages 1-24, August.
    3. Sun, Lu & Fujii, Minoru & Li, Zhaoling & Dong, Huijuan & Geng, Yong & Liu, Zhe & Fujita, Tsuyoshi & Yu, Xiaoman & Zhang, Yuepeng, 2020. "Energy-saving and carbon emission reduction effect of urban-industrial symbiosis implementation with feasibility analysis in the city," Technological Forecasting and Social Change, Elsevier, vol. 151(C).
    4. Andrew Chapman & Timothy Fraser & Melanie Dennis, 2019. "Investigating Ties between Energy Policy and Social Equity Research: A Citation Network Analysis," Social Sciences, MDPI, vol. 8(5), pages 1-18, April.
    5. Krzysztof Wiśniewski & Gabriela Rutkowska & Katarzyna Jeleniewicz & Norbert Dąbkowski & Jarosław Wójt & Marek Chalecki & Tomasz Wierzbicki, 2024. "Ecologically Friendly Building Materials: A Case Study of Clay–Ash Composites for the Efficient Management of Fly Ash from the Thermal Conversion of Sewage Sludge," Sustainability, MDPI, vol. 16(9), pages 1-18, April.
    6. Eid Gul & Giorgio Baldinelli & Pietro Bartocci, 2022. "Energy Transition: Renewable Energy-Based Combined Heat and Power Optimization Model for Distributed Communities," Energies, MDPI, vol. 15(18), pages 1-18, September.
    7. Ahmed, Gaffer & Kishore, Nanda, 2024. "Synergistic effects on properties of biofuel and biochar produced through co-feed pyrolysis of Erythrina indica and Azadirachta indica biomass," Renewable Energy, Elsevier, vol. 227(C).
    8. Agga, Ali & Abbou, Ahmed & Labbadi, Moussa & El Houm, Yassine, 2021. "Short-term self consumption PV plant power production forecasts based on hybrid CNN-LSTM, ConvLSTM models," Renewable Energy, Elsevier, vol. 177(C), pages 101-112.
    9. Anass Berouine & Radouane Ouladsine & Mohamed Bakhouya & Mohamed Essaaidi, 2020. "Towards a Real-Time Predictive Management Approach of Indoor Air Quality in Energy-Efficient Buildings," Energies, MDPI, vol. 13(12), pages 1-16, June.
    10. Taghizadeh-Hesary, Farhad & Rasoulinezhad, Ehsan & Shahbaz, Muhammad & Vinh Vo, Xuan, 2021. "How energy transition and power consumption are related in Asian economies with different income levels?," Energy, Elsevier, vol. 237(C).
    11. David Klenert & Franziska Funke & Linus Mattauch & Brian O’Callaghan, 2020. "Five Lessons from COVID-19 for Advancing Climate Change Mitigation," Environmental & Resource Economics, Springer;European Association of Environmental and Resource Economists, vol. 76(4), pages 751-778, August.
    12. Khiareddine, Abla & Ben Salah, Chokri & Rekioua, Djamila & Mimouni, Mohamed Faouzi, 2018. "Sizing methodology for hybrid photovoltaic /wind/ hydrogen/battery integrated to energy management strategy for pumping system," Energy, Elsevier, vol. 153(C), pages 743-762.
    13. Dong, Xianjing & Zhang, Xiaojuan & Zhang, Congcong & Bi, Chunyu, 2023. "Building sustainability education for green recovery in the energy resource sector: A cross country analysis," Resources Policy, Elsevier, vol. 81(C).
    14. Ascione, Fabrizio & De Masi, Rosa Francesca & de Rossi, Filippo & Ruggiero, Silvia & Vanoli, Giuseppe Peter, 2016. "Optimization of building envelope design for nZEBs in Mediterranean climate: Performance analysis of residential case study," Applied Energy, Elsevier, vol. 183(C), pages 938-957.
    15. Ari, Izzet & Yikmaz, Riza Fikret, 2019. "The role of renewable energy in achieving Turkey's INDC," Renewable and Sustainable Energy Reviews, Elsevier, vol. 105(C), pages 244-251.
    16. Róbert Csalódi & Tímea Czvetkó & Viktor Sebestyén & János Abonyi, 2022. "Sectoral Analysis of Energy Transition Paths and Greenhouse Gas Emissions," Energies, MDPI, vol. 15(21), pages 1-26, October.
    17. Jun-Young Park & Fabian Schloesser & Axel Timmermann & Dipayan Choudhury & June-Yi Lee & Arjun Babu Nellikkattil, 2023. "Future sea-level projections with a coupled atmosphere-ocean-ice-sheet model," Nature Communications, Nature, vol. 14(1), pages 1-11, December.
    18. Yan, Peiliang & Fan, Weijun & Han, Yu & Ding, Hongbing & Wen, Chuang & Elbarghthi, Anas F.A. & Yang, Yan, 2023. "Leaf-vein bionic fin configurations for enhanced thermal energy storage performance of phase change materials in smart heating and cooling systems," Applied Energy, Elsevier, vol. 346(C).
    19. Roula Inglesi-Lotz & Luis Diez del Corral Morales, 2017. "The Effect of Education on a Country’s Energy Consumption: Evidence from Developed and Developing Countries," Working Papers 201733, University of Pretoria, Department of Economics.
    20. Galatioto, A. & Ricciu, R. & Salem, T. & Kinab, E., 2019. "Energy and economic analysis on retrofit actions for Italian public historic buildings," Energy, Elsevier, vol. 176(C), pages 58-66.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:17:y:2024:i:17:p:4518-:d:1474242. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.