IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v324y2022ics0306261922009515.html
   My bibliography  Save this article

A deep reinforced learning spatiotemporal energy demand estimation system using deep learning and electricity demand monitoring data

Author

Listed:
  • Maki, Seiya
  • Fujii, Minoru
  • Fujita, Tsuyoshi
  • Shiraishi, Yasushi
  • Ashina, Shuichi
  • Gomi, Kei
  • Sun, Lu
  • Budi Nugroho, Sudarmanto
  • Nakano, Ryoko
  • Osawa, Takahiro
  • Immanuel, Gito
  • Boer, Rizaldi

Abstract

Tracking decarbonization effects requires a model for the identification of spatial energy demands on city facilities. However, most developing countries lack detailed discrete time and device-specific energy demand data. In this study, we installed multiple energy demand monitoring systems that could observe electricity demands at the device level in some residences in Bogor, Indonesia. The study aimed to estimate the time-series and equipment ratio of electricity consumption by households in the entire city based on the monitoring data. However, the number of households monitored was small, and therefore unlikely to be regarded as having a representative system. Therefore, we used questionnaire data to create monitored mimic data and increased the number of samples to estimate the energy demand characteristics of the entire city via spatial interpolation. In addition, we developed a reinforcement learning system for discrete time–electricity demand estimation systems for unmonitored households using a 5-step procedure; 1) Analyzing energy demand and its patterns from monitoring data, 2) Questionnaire-based surveying of households, 3) Estimation of energy demand and its patterns based on questionnaire responses in monitored households, 4) Development of a deep learning model that extends the results from (3) to unmonitored households using data fusion, and 5) Spatial interpolation of energy demand characteristics for all households in Bogor using a spatial statistics method. The spatial electricity demand of households was interpolated from GIS and high-resolution satellite data matching procedures. Based on this analysis, we developed an hourly energy demand prediction system that could be automatically improved by adding new data from the reinforced learning framework.

Suggested Citation

  • Maki, Seiya & Fujii, Minoru & Fujita, Tsuyoshi & Shiraishi, Yasushi & Ashina, Shuichi & Gomi, Kei & Sun, Lu & Budi Nugroho, Sudarmanto & Nakano, Ryoko & Osawa, Takahiro & Immanuel, Gito & Boer, Rizald, 2022. "A deep reinforced learning spatiotemporal energy demand estimation system using deep learning and electricity demand monitoring data," Applied Energy, Elsevier, vol. 324(C).
    • Handle: RePEc:eee:appene:v:324:y:2022:i:c:s0306261922009515
    DOI: 10.1016/j.apenergy.2022.119652
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261922009515
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2022.119652?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Chou, Jui-Sheng & Gusti Ayu Novi Yutami, I, 2014. "Smart meter adoption and deployment strategy for residential buildings in Indonesia," Applied Energy, Elsevier, vol. 128(C), pages 336-349.
    2. Wu, Jingda & He, Hongwen & Peng, Jiankun & Li, Yuecheng & Li, Zhanjiang, 2018. "Continuous reinforcement learning of energy management with deep Q network for a power split hybrid electric bus," Applied Energy, Elsevier, vol. 222(C), pages 799-811.
    3. Rahman, Aowabin & Srikumar, Vivek & Smith, Amanda D., 2018. "Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 212(C), pages 372-385.
    4. Hargreaves, Tom & Nye, Michael & Burgess, Jacquelin, 2013. "Keeping energy visible? Exploring how householders interact with feedback from smart energy monitors in the longer term," Energy Policy, Elsevier, vol. 52(C), pages 126-134.
    5. Wang, Zhe & Hong, Tianzhen, 2020. "Reinforcement learning for building controls: The opportunities and challenges," Applied Energy, Elsevier, vol. 269(C).
    6. Permana, A.S. & Perera, R. & Kumar, S., 2008. "Understanding energy consumption pattern of households in different urban development forms: A comparative study in Bandung City, Indonesia," Energy Policy, Elsevier, vol. 36(11), pages 4287-4297, November.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Oh, Jinwoo & Han, Ukmin & Jung, Yujun & Kang, Yong Tae & Lee, Hoseong, 2024. "Advancing waste heat potential assessment for net-zero emissions: A review of demand-based thermal energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 202(C).
    2. Zhang, Lei & Huang, Zhijia & Wang, Zhenpo & Li, Xiaohui & Sun, Fengchun, 2024. "An urban charging load forecasting model based on trip chain model for private passenger electric vehicles: A case study in Beijing," Energy, Elsevier, vol. 299(C).
    3. Issam Hanafi & Bousselham Samoudi & Ahlem Ben Halima & Laurent Canale, 2022. "Hotspots and Tendencies of Energy Optimization Based on Bibliometric Review," Energies, MDPI, vol. 16(1), pages 1-22, December.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Strong, Derek Ryan, 2017. "The Early Diffusion of Smart Meters in the US Electric Power Industry," Thesis Commons 7zprk, Center for Open Science.
    2. Chou, Jui-Sheng & Kim, Changwan & Ung, Thanh-Khiet & Yutami, I Gusti Ayu Novi & Lin, Guo-Tai & Son, Hyojoo, 2015. "Cross-country review of smart grid adoption in residential buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 48(C), pages 192-213.
    3. Burchell, Kevin & Rettie, Ruth & Roberts, Tom C., 2016. "Householder engagement with energy consumption feedback: the role of community action and communications," Energy Policy, Elsevier, vol. 88(C), pages 178-186.
    4. Chou, Jui-Sheng & Gusti Ayu Novi Yutami, I, 2014. "Smart meter adoption and deployment strategy for residential buildings in Indonesia," Applied Energy, Elsevier, vol. 128(C), pages 336-349.
    5. Bożena Gajdzik & Magdalena Jaciow & Radosław Wolniak & Robert Wolny & Wieslaw Wes Grebski, 2023. "Assessment of Energy and Heat Consumption Trends and Forecasting in the Small Consumer Sector in Poland Based on Historical Data," Resources, MDPI, vol. 12(9), pages 1-33, September.
    6. Bardsley, Nicholas & Büchs, Milena & James, Patrick & Papafragkou, Anastasios & Rushby, Thomas & Saunders, Clare & Smith, Graham & Wallbridge, Rebecca & Woodman, Nicholas, 2019. "Domestic thermal upgrades, community action and energy saving: A three-year experimental study of prosperous households," Energy Policy, Elsevier, vol. 127(C), pages 475-485.
    7. Chen, Zhelun & O’Neill, Zheng & Wen, Jin & Pradhan, Ojas & Yang, Tao & Lu, Xing & Lin, Guanjing & Miyata, Shohei & Lee, Seungjae & Shen, Chou & Chiosa, Roberto & Piscitelli, Marco Savino & Capozzoli, , 2023. "A review of data-driven fault detection and diagnostics for building HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    8. Brown, Christopher J. & Markusson, Nils, 2019. "The responses of older adults to smart energy monitors," Energy Policy, Elsevier, vol. 130(C), pages 218-226.
    9. Sun, Alexander Y., 2020. "Optimal carbon storage reservoir management through deep reinforcement learning," Applied Energy, Elsevier, vol. 278(C).
    10. Liu, Che & Sun, Bo & Zhang, Chenghui & Li, Fan, 2020. "A hybrid prediction model for residential electricity consumption using holt-winters and extreme learning machine," Applied Energy, Elsevier, vol. 275(C).
    11. Yassine Chemingui & Adel Gastli & Omar Ellabban, 2020. "Reinforcement Learning-Based School Energy Management System," Energies, MDPI, vol. 13(23), pages 1-21, December.
    12. Matteo Acquarone & Claudio Maino & Daniela Misul & Ezio Spessa & Antonio Mastropietro & Luca Sorrentino & Enrico Busto, 2023. "Influence of the Reward Function on the Selection of Reinforcement Learning Agents for Hybrid Electric Vehicles Real-Time Control," Energies, MDPI, vol. 16(6), pages 1-22, March.
    13. Li, Shuangqi & He, Hongwen & Li, Jianwei, 2019. "Big data driven lithium-ion battery modeling method based on SDAE-ELM algorithm and data pre-processing technology," Applied Energy, Elsevier, vol. 242(C), pages 1259-1273.
    14. Yang, Ningkang & Han, Lijin & Xiang, Changle & Liu, Hui & Li, Xunmin, 2021. "An indirect reinforcement learning based real-time energy management strategy via high-order Markov Chain model for a hybrid electric vehicle," Energy, Elsevier, vol. 236(C).
    15. Gokhale, Gargya & Claessens, Bert & Develder, Chris, 2022. "Physics informed neural networks for control oriented thermal modeling of buildings," Applied Energy, Elsevier, vol. 314(C).
    16. Hopkins, Debbie & Stephenson, Janet, 2014. "Generation Y mobilities through the lens of energy cultures: a preliminary exploration of mobility cultures," Journal of Transport Geography, Elsevier, vol. 38(C), pages 88-91.
    17. Lu, Yakai & Tian, Zhe & Zhou, Ruoyu & Liu, Wenjing, 2021. "A general transfer learning-based framework for thermal load prediction in regional energy system," Energy, Elsevier, vol. 217(C).
    18. Molinari, Marco & Anund Vogel, Jonas & Rolando, Davide & Lundqvist, Per, 2023. "Using living labs to tackle innovation bottlenecks: the KTH Live-In Lab case study," Applied Energy, Elsevier, vol. 338(C).
    19. Davide Coraci & Silvio Brandi & Marco Savino Piscitelli & Alfonso Capozzoli, 2021. "Online Implementation of a Soft Actor-Critic Agent to Enhance Indoor Temperature Control and Energy Efficiency in Buildings," Energies, MDPI, vol. 14(4), pages 1-26, February.
    20. Liu, Mingzhe & Guo, Mingyue & Fu, Yangyang & O’Neill, Zheng & Gao, Yuan, 2024. "Expert-guided imitation learning for energy management: Evaluating GAIL’s performance in building control applications," Applied Energy, Elsevier, vol. 372(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:324:y:2022:i:c:s0306261922009515. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.