IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v194y2017icp333-342.html
   My bibliography  Save this article

k-means based load estimation of domestic smart meter measurements

Author

Listed:
  • Al-Wakeel, Ali
  • Wu, Jianzhong
  • Jenkins, Nick

Abstract

A load estimation algorithm based on k-means cluster analysis was developed. The algorithm applies cluster centres – of previously clustered load profiles – and distance functions to estimate missing and future measurements. Canberra, Manhattan, Euclidean, and Pearson correlation distances were investigated. Several case studies were implemented using daily and segmented load profiles of aggregated smart meters. Segmented profiles cover a time window that is less than or equal to 24h. Simulation results show that Canberra distance outperforms the other distance functions. Results also show that the segmented cluster centres produce more accurate load estimates than daily cluster centres. Higher accuracy estimates were obtained with cluster centres in the range of 16–24h. The developed load estimation algorithm can be integrated with state estimation or other network operational tools to enable better monitoring and control of distribution networks.

Suggested Citation

  • Al-Wakeel, Ali & Wu, Jianzhong & Jenkins, Nick, 2017. "k-means based load estimation of domestic smart meter measurements," Applied Energy, Elsevier, vol. 194(C), pages 333-342.
    • Handle: RePEc:eee:appene:v:194:y:2017:i:c:p:333-342
    DOI: 10.1016/j.apenergy.2016.06.046
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261916308200
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2016.06.046?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Mena, Rodrigo & Hennebel, Martin & Li, Yan-Fu & Zio, Enrico, 2014. "Self-adaptable hierarchical clustering analysis and differential evolution for optimal integration of renewable distributed generation," Applied Energy, Elsevier, vol. 133(C), pages 388-402.
    2. McLoughlin, Fintan & Duffy, Aidan & Conlon, Michael, 2015. "A clustering approach to domestic electricity load profile characterisation using smart metering data," Applied Energy, Elsevier, vol. 141(C), pages 190-199.
    3. David J. Hand & Heikki Mannila & Padhraic Smyth, 2001. "Principles of Data Mining," MIT Press Books, The MIT Press, edition 1, volume 1, number 026208290x, April.
    4. Räsänen, Teemu & Voukantsis, Dimitrios & Niska, Harri & Karatzas, Kostas & Kolehmainen, Mikko, 2010. "Data-based method for creating electricity use load profiles using large amount of customer-specific hourly measured electricity use data," Applied Energy, Elsevier, vol. 87(11), pages 3538-3545, November.
    5. Räsänen, Teemu & Ruuskanen, Juhani & Kolehmainen, Mikko, 2008. "Reducing energy consumption by using self-organizing maps to create more personalized electricity use information," Applied Energy, Elsevier, vol. 85(9), pages 830-840, September.
    6. Zhou, Kaile & Fu, Chao & Yang, Shanlin, 2016. "Big data driven smart energy management: From big data to big insights," Renewable and Sustainable Energy Reviews, Elsevier, vol. 56(C), pages 215-225.
    7. Rhodes, Joshua D. & Cole, Wesley J. & Upshaw, Charles R. & Edgar, Thomas F. & Webber, Michael E., 2014. "Clustering analysis of residential electricity demand profiles," Applied Energy, Elsevier, vol. 135(C), pages 461-471.
    8. Coelho, Vitor N. & Coelho, Igor M. & Coelho, Bruno N. & Reis, Agnaldo J.R. & Enayatifar, Rasul & Souza, Marcone J.F. & Guimarães, Frederico G., 2016. "A self-adaptive evolutionary fuzzy model for load forecasting problems on smart grid environment," Applied Energy, Elsevier, vol. 169(C), pages 567-584.
    9. Raza, Muhammad Qamar & Khosravi, Abbas, 2015. "A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 50(C), pages 1352-1372.
    10. Soares, Lacir J. & Medeiros, Marcelo C., 2008. "Modeling and forecasting short-term electricity load: A comparison of methods with an application to Brazilian data," International Journal of Forecasting, Elsevier, vol. 24(4), pages 630-644.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Chao & Lasaulce, Samson & Hennebel, Martin & Saludjian, Lucas & Panciatici, Patrick & Poor, H. Vincent, 2021. "Decision-making oriented clustering: Application to pricing and power consumption scheduling," Applied Energy, Elsevier, vol. 297(C).
    2. Xiong, Rui & Li, Zhengyang & Yang, Ruixin & Shen, Weixiang & Ma, Suxiao & Sun, Fengchun, 2022. "Fast self-heating battery with anti-aging awareness for freezing climates application," Applied Energy, Elsevier, vol. 324(C).
    3. Alejandro Pena-Bello & Edward Barbour & Marta C. Gonzalez & Selin Yilmaz & Martin K. Patel & David Parra, 2020. "How Does the Electricity Demand Profile Impact the Attractiveness of PV-Coupled Battery Systems Combining Applications?," Energies, MDPI, vol. 13(15), pages 1-19, August.
    4. Chreim, Bashar & Esseghir, Moez & Merghem-Boulahia, Leila, 2022. "LOSISH—LOad Scheduling In Smart Homes based on demand response: Application to smart grids," Applied Energy, Elsevier, vol. 323(C).
    5. Raghuvamsi, Y & Teeparthi, Kiran, 2023. "A review on distribution system state estimation uncertainty issues using deep learning approaches," Renewable and Sustainable Energy Reviews, Elsevier, vol. 187(C).
    6. Többen, Johannes & Schröder, Thomas, 2018. "A maximum entropy approach to the estimation of spatially and sectorally disaggregated electricity load curves," Applied Energy, Elsevier, vol. 225(C), pages 797-813.
    7. Zhong, Shengyuan & Wang, Xiaoyuan & Zhao, Jun & Li, Wenjia & Li, Hao & Wang, Yongzhen & Deng, Shuai & Zhu, Jiebei, 2021. "Deep reinforcement learning framework for dynamic pricing demand response of regenerative electric heating," Applied Energy, Elsevier, vol. 288(C).
    8. van Zoest, Vera & El Gohary, Fouad & Ngai, Edith C.H. & Bartusch, Cajsa, 2021. "Demand charges and user flexibility – Exploring differences in electricity consumer types and load patterns within the Swedish commercial sector," Applied Energy, Elsevier, vol. 302(C).
    9. Ruhang, Xu, 2020. "Efficient clustering for aggregate loads: An unsupervised pretraining based method," Energy, Elsevier, vol. 210(C).
    10. Fanidhar Dewangan & Almoataz Y. Abdelaziz & Monalisa Biswal, 2023. "Load Forecasting Models in Smart Grid Using Smart Meter Information: A Review," Energies, MDPI, vol. 16(3), pages 1-55, January.
    11. Kang, J. & Reiner, D., 2021. "Machine Learning on residential electricity consumption: Which households are more responsive to weather?," Cambridge Working Papers in Economics 2142, Faculty of Economics, University of Cambridge.
    12. Rongheng Lin & Budan Wu & Yun Su, 2018. "An Adaptive Weighted Pearson Similarity Measurement Method for Load Curve Clustering," Energies, MDPI, vol. 11(9), pages 1-17, September.
    13. Naderi, Shayan & Heslop, Simon & Chen, Dong & Watts, Scott & MacGill, Iain & Pignatta, Gloria & Sproul, Alistair, 2023. "Clustering based analysis of residential duck curve mitigation through solar pre-cooling: A case study of Australian housing stock," Renewable Energy, Elsevier, vol. 216(C).
    14. Thiago Eliandro de Oliveira Gomes & André Ross Borniatti & Vinícius Jacques Garcia & Laura Lisiane Callai dos Santos & Nelson Knak Neto & Rui Anderson Ferrarezi Garcia, 2023. "Clustering Electrical Customers with Source Power and Aggregation Constraints: A Reliability-Based Approach in Power Distribution Systems," Energies, MDPI, vol. 16(5), pages 1-20, March.
    15. Oscar Duarte & Javier E. Duarte & Javier Rosero-Garcia, 2024. "Data Imputation in Electricity Consumption Profiles through Shape Modeling with Autoencoders," Mathematics, MDPI, vol. 12(19), pages 1-19, September.
    16. Wang, Yingli & Duan, Jialong & Zhao, Yuanyuan & Yuan, Haiwen & He, Benlin & Tang, Qunwei, 2018. "Film-type rain energy converters from conductive polymer/PtCo hybrids," Applied Energy, Elsevier, vol. 218(C), pages 317-324.
    17. Emilio Ghiani & Alessandro Serpi & Virginia Pilloni & Giuliana Sias & Marco Simone & Gianluca Marcialis & Giuliano Armano & Paolo Attilio Pegoraro, 2018. "A Multidisciplinary Approach for the Development of Smart Distribution Networks," Energies, MDPI, vol. 11(10), pages 1-29, September.
    18. Rafik Nafkha & Krzysztof Gajowniczek & Tomasz Ząbkowski, 2018. "Do Customers Choose Proper Tariff? Empirical Analysis Based on Polish Data Using Unsupervised Techniques," Energies, MDPI, vol. 11(3), pages 1-17, February.
    19. Zhou, Huansheng & Zheng, J.H. & Li, Zhigang & Wu, Q.H. & Zhou, X.X., 2019. "Multi-stage contingency-constrained co-planning for electricity-gas systems interconnected with gas-fired units and power-to-gas plants using iterative Benders decomposition," Energy, Elsevier, vol. 180(C), pages 689-701.
    20. Abeysinghe, Sathsara & Wu, Jianzhong & Sooriyabandara, Mahesh & Abeysekera, Muditha & Xu, Tao & Wang, Chengshan, 2018. "Topological properties of medium voltage electricity distribution networks," Applied Energy, Elsevier, vol. 210(C), pages 1101-1112.
    21. Mitra, Somalee & Chakraborty, Basab & Mitra, Pabitra, 2024. "Smart meter data analytics applications for secure, reliable and robust grid system: Survey and future directions," Energy, Elsevier, vol. 289(C).
    22. Jingyuan Zhang & Jusheng Song & Zouyang Fan, 2023. "The Study of Historical Progression in the Distribution of Urban Commercial Space Locations—Example of Paris," Sustainability, MDPI, vol. 15(19), pages 1-23, October.
    23. Malin Lachmann & Jaime Maldonado & Wiebke Bergmann & Francesca Jung & Markus Weber & Christof Büskens, 2020. "Self-Learning Data-Based Models as Basis of a Universally Applicable Energy Management System," Energies, MDPI, vol. 13(8), pages 1-42, April.
    24. Elnozahy, Ahmed & Abdel-Salam, Mazen & Abo-Elyousr, Farag K., 2024. "Optimal techno-economic energy coordination of solar PV water pumping irrigation systems," Energy, Elsevier, vol. 288(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Al-Wakeel, Ali & Wu, Jianzhong & Jenkins, Nick, 2016. "State estimation of medium voltage distribution networks using smart meter measurements," Applied Energy, Elsevier, vol. 184(C), pages 207-218.
    2. Zhou, Kaile & Yang, Changhui & Shen, Jianxin, 2017. "Discovering residential electricity consumption patterns through smart-meter data mining: A case study from China," Utilities Policy, Elsevier, vol. 44(C), pages 73-84.
    3. Pfenninger, Stefan, 2017. "Dealing with multiple decades of hourly wind and PV time series in energy models: A comparison of methods to reduce time resolution and the planning implications of inter-annual variability," Applied Energy, Elsevier, vol. 197(C), pages 1-13.
    4. Hsu, David, 2015. "Comparison of integrated clustering methods for accurate and stable prediction of building energy consumption data," Applied Energy, Elsevier, vol. 160(C), pages 153-163.
    5. Wen, Hanguan & Liu, Xiufeng & Yang, Ming & Lei, Bo & Xu, Cheng & Chen, Zhe, 2024. "A novel approach for identifying customer groups for personalized demand-side management services using household socio-demographic data," Energy, Elsevier, vol. 286(C).
    6. Rongheng Lin & Budan Wu & Yun Su, 2018. "An Adaptive Weighted Pearson Similarity Measurement Method for Load Curve Clustering," Energies, MDPI, vol. 11(9), pages 1-17, September.
    7. Yildiz, B. & Bilbao, J.I. & Dore, J. & Sproul, A.B., 2017. "Recent advances in the analysis of residential electricity consumption and applications of smart meter data," Applied Energy, Elsevier, vol. 208(C), pages 402-427.
    8. Russo, Marianna & Bertsch, Valentin, 2020. "A looming revolution: Implications of self-generation for the risk exposure of retailers," Energy Economics, Elsevier, vol. 92(C).
    9. Emilio Ghiani & Alessandro Serpi & Virginia Pilloni & Giuliana Sias & Marco Simone & Gianluca Marcialis & Giuliano Armano & Paolo Attilio Pegoraro, 2018. "A Multidisciplinary Approach for the Development of Smart Distribution Networks," Energies, MDPI, vol. 11(10), pages 1-29, September.
    10. Alexander Tureczek & Per Sieverts Nielsen & Henrik Madsen, 2018. "Electricity Consumption Clustering Using Smart Meter Data," Energies, MDPI, vol. 11(4), pages 1-18, April.
    11. Qiu, Dawei & Wang, Yi & Wang, Junkai & Jiang, Chuanwen & Strbac, Goran, 2023. "Personalized retail pricing design for smart metering consumers in electricity market," Applied Energy, Elsevier, vol. 348(C).
    12. Satre-Meloy, Aven & Diakonova, Marina & Grünewald, Philipp, 2020. "Cluster analysis and prediction of residential peak demand profiles using occupant activity data," Applied Energy, Elsevier, vol. 260(C).
    13. Rajabi, Amin & Eskandari, Mohsen & Ghadi, Mojtaba Jabbari & Li, Li & Zhang, Jiangfeng & Siano, Pierluigi, 2020. "A comparative study of clustering techniques for electrical load pattern segmentation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 120(C).
    14. Li, Wenqiang & Gong, Guangcai & Fan, Houhua & Peng, Pei & Chun, Liang & Fang, Xi, 2021. "A clustering-based approach for “cross-scale” load prediction on building level in HVAC systems," Applied Energy, Elsevier, vol. 282(PB).
    15. Yang, Ting & Ren, Minglun & Zhou, Kaile, 2018. "Identifying household electricity consumption patterns: A case study of Kunshan, China," Renewable and Sustainable Energy Reviews, Elsevier, vol. 91(C), pages 861-868.
    16. Eunjung Lee & Jinho Kim & Dongsik Jang, 2020. "Load Profile Segmentation for Effective Residential Demand Response Program: Method and Evidence from Korean Pilot Study," Energies, MDPI, vol. 13(6), pages 1-18, March.
    17. Gerossier, Alexis & Barbier, Thibaut & Girard, Robin, 2017. "A novel method for decomposing electricity feeder load into elementary profiles from customer information," Applied Energy, Elsevier, vol. 203(C), pages 752-760.
    18. Hao, Ying & Dong, Lei & Liao, Xiaozhong & Liang, Jun & Wang, Lijie & Wang, Bo, 2019. "A novel clustering algorithm based on mathematical morphology for wind power generation prediction," Renewable Energy, Elsevier, vol. 136(C), pages 572-585.
    19. Luo, Xuan & Hong, Tianzhen & Chen, Yixing & Piette, Mary Ann, 2017. "Electric load shape benchmarking for small- and medium-sized commercial buildings," Applied Energy, Elsevier, vol. 204(C), pages 715-725.
    20. Trotta, Gianluca, 2020. "An empirical analysis of domestic electricity load profiles: Who consumes how much and when?," Applied Energy, Elsevier, vol. 275(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:194:y:2017:i:c:p:333-342. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.