IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v237y2019icp11-24.html
   My bibliography  Save this article

Clustering of residential electricity customers using load time series

Author

Listed:
  • Motlagh, Omid
  • Berry, Adam
  • O'Neil, Lachlan

Abstract

Clustering of electricity customers supports effective market segmentation and management. The literature suggests the clustering of residential customers by their load characteristics. The key challenge is the application of appropriate processes to reduce the extreme dimensionality of load time series to facilitate unique clusters. Time feature extraction is a potential remedy, however, it is limited by the type of noisy, patchy, and unequal time-series common in residential datasets. In this paper we propose a strategy to alleviate these limitations by converting any types of load time series into map models that can be readily clustered. This also results in higher cluster distinction and robustness against noise compared to a baseline feature-based approach. A large dataset of residential electricity customers is used to confirm the outcomes as measured by a number of analytical and industrial metrics. The experiment with 12 clusters results in around 61% distinction, improved coincidence factor by around 6.75% relative to a random grouping, and robustness of around 59% against the applied noise.

Suggested Citation

  • Motlagh, Omid & Berry, Adam & O'Neil, Lachlan, 2019. "Clustering of residential electricity customers using load time series," Applied Energy, Elsevier, vol. 237(C), pages 11-24.
  • Handle: RePEc:eee:appene:v:237:y:2019:i:c:p:11-24
    DOI: 10.1016/j.apenergy.2018.12.063
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261918318816
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2018.12.063?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Nahmmacher, Paul & Schmid, Eva & Hirth, Lion & Knopf, Brigitte, 2016. "Carpe diem: A novel approach to select representative days for long-term power system modeling," Energy, Elsevier, vol. 112(C), pages 430-442.
    2. Frederiks, Elisha R. & Stenner, Karen & Hobman, Elizabeth V., 2015. "Household energy use: Applying behavioural economics to understand consumer decision-making and behaviour," Renewable and Sustainable Energy Reviews, Elsevier, vol. 41(C), pages 1385-1394.
    3. Taylor, James W. & de Menezes, Lilian M. & McSharry, Patrick E., 2006. "A comparison of univariate methods for forecasting electricity demand up to a day ahead," International Journal of Forecasting, Elsevier, vol. 22(1), pages 1-16.
    4. McLoughlin, Fintan & Duffy, Aidan & Conlon, Michael, 2015. "A clustering approach to domestic electricity load profile characterisation using smart metering data," Applied Energy, Elsevier, vol. 141(C), pages 190-199.
    5. He, Yongxiu & Wang, Bing & Wang, Jianhui & Xiong, Wei & Xia, Tian, 2012. "Residential demand response behavior analysis based on Monte Carlo simulation: The case of Yinchuan in China," Energy, Elsevier, vol. 47(1), pages 230-236.
    6. Luis Hernández & Carlos Baladrón & Javier M. Aguiar & Belén Carro & Antonio Sánchez-Esguevillas, 2012. "Classification and Clustering of Electricity Demand Patterns in Industrial Parks," Energies, MDPI, vol. 5(12), pages 1-14, December.
    7. Motlagh, Omid & Paevere, Phillip & Hong, Tang Sai & Grozev, George, 2015. "Analysis of household electricity consumption behaviours: Impact of domestic electricity generation," Applied Mathematics and Computation, Elsevier, vol. 270(C), pages 165-178.
    8. Merrick, James H., 2016. "On representation of temporal variability in electricity capacity planning models," Energy Economics, Elsevier, vol. 59(C), pages 261-274.
    9. Rubén Pérez-Chacón & José M. Luna-Romera & Alicia Troncoso & Francisco Martínez-Álvarez & José C. Riquelme, 2018. "Big Data Analytics for Discovering Electricity Consumption Patterns in Smart Cities," Energies, MDPI, vol. 11(3), pages 1-19, March.
    10. Félix Iglesias & Wolfgang Kastner, 2013. "Analysis of Similarity Measures in Times Series Clustering for the Discovery of Building Energy Patterns," Energies, MDPI, vol. 6(2), pages 1-19, January.
    11. Chicco, Gianfranco, 2012. "Overview and performance assessment of the clustering methods for electrical load pattern grouping," Energy, Elsevier, vol. 42(1), pages 68-80.
    12. Swan, Lukas G. & Ugursal, V. Ismet, 2009. "Modeling of end-use energy consumption in the residential sector: A review of modeling techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 13(8), pages 1819-1835, October.
    13. Alexander Tureczek & Per Sieverts Nielsen & Henrik Madsen, 2018. "Electricity Consumption Clustering Using Smart Meter Data," Energies, MDPI, vol. 11(4), pages 1-18, April.
    14. Antimo Barbato & Antonio Capone, 2014. "Optimization Models and Methods for Demand-Side Management of Residential Users: A Survey," Energies, MDPI, vol. 7(9), pages 1-38, September.
    15. McLoughlin, Fintan & Duffy, Aidan & Conlon, Michael, 2013. "Evaluation of time series techniques to characterise domestic electricity demand," Energy, Elsevier, vol. 50(C), pages 120-130.
    16. Wen, Lulu & Zhou, Kaile & Yang, Shanlin & Li, Lanlan, 2018. "Compression of smart meter big data: A survey," Renewable and Sustainable Energy Reviews, Elsevier, vol. 91(C), pages 59-69.
    17. Hippert, H.S. & Bunn, D.W. & Souza, R.C., 2005. "Large neural networks for electricity load forecasting: Are they overfitted?," International Journal of Forecasting, Elsevier, vol. 21(3), pages 425-434.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Zhang, Chao & Lasaulce, Samson & Hennebel, Martin & Saludjian, Lucas & Panciatici, Patrick & Poor, H. Vincent, 2021. "Decision-making oriented clustering: Application to pricing and power consumption scheduling," Applied Energy, Elsevier, vol. 297(C).
    2. Valdes, Javier & Masip Macia, Yunesky & Dorner, Wolfgang & Ramirez Camargo, Luis, 2021. "Unsupervised grouping of industrial electricity demand profiles: Synthetic profiles for demand-side management applications," Energy, Elsevier, vol. 215(PA).
    3. Tanoto, Yusak & Haghdadi, Navid & Bruce, Anna & MacGill, Iain, 2020. "Clustering based assessment of cost, security and environmental tradeoffs with possible future electricity generation portfolios," Applied Energy, Elsevier, vol. 270(C).
    4. Giuseppe Ciaburro & Gino Iannace, 2021. "Machine Learning-Based Algorithms to Knowledge Extraction from Time Series Data: A Review," Data, MDPI, vol. 6(6), pages 1-30, May.
    5. Hampton, Harrison & Foley, Aoife, 2022. "A review of current analytical methods, modelling tools and development frameworks applicable for future retail electricity market design," Energy, Elsevier, vol. 260(C).
    6. Lin, Jin & Dong, Jun & Dou, Xihao & Liu, Yao & Yang, Peiwen & Ma, Tongtao, 2022. "Psychological insights for incentive-based demand response incorporating battery energy storage systems: A two-loop Stackelberg game approach," Energy, Elsevier, vol. 239(PC).
    7. Densing, Martin & Wan, Yi, 2022. "Low-dimensional scenario generation method of solar and wind availability for representative days in energy modeling," Applied Energy, Elsevier, vol. 306(PB).
    8. Chen, Xiao & Zanocco, Chad & Flora, June & Rajagopal, Ram, 2022. "Constructing dynamic residential energy lifestyles using Latent Dirichlet Allocation," Applied Energy, Elsevier, vol. 318(C).
    9. Shan, Rui & Kittner, Noah, 2024. "Allocation of policy resources for energy storage development considering the Inflation Reduction Act," Energy Policy, Elsevier, vol. 184(C).
    10. Ahir, Rajesh K. & Chakraborty, Basab, 2021. "A meta-analytic approach for determining the success factors for energy conservation," Energy, Elsevier, vol. 230(C).
    11. Heung-gu Son & Yunsun Kim & Sahm Kim, 2020. "Time Series Clustering of Electricity Demand for Industrial Areas on Smart Grid," Energies, MDPI, vol. 13(9), pages 1-14, May.
    12. Li, Wenqiang & Gong, Guangcai & Fan, Houhua & Peng, Pei & Chun, Liang & Fang, Xi, 2021. "A clustering-based approach for “cross-scale” load prediction on building level in HVAC systems," Applied Energy, Elsevier, vol. 282(PB).
    13. Guo, Zhifeng & O'Hanley, Jesse R. & Gibson, Stuart, 2022. "Predicting residential electricity consumption patterns based on smart meter and household data: A case study from the Republic of Ireland," Utilities Policy, Elsevier, vol. 79(C).
    14. Tang, Wenjun & Wang, Hao & Lee, Xian-Long & Yang, Hong-Tzer, 2022. "Machine learning approach to uncovering residential energy consumption patterns based on socioeconomic and smart meter data," Energy, Elsevier, vol. 240(C).
    15. Maximilian Hoffmann & Leander Kotzur & Detlef Stolten & Martin Robinius, 2020. "A Review on Time Series Aggregation Methods for Energy System Models," Energies, MDPI, vol. 13(3), pages 1-61, February.
    16. Ma, Shuaiyin & Huang, Yuming & Liu, Yang & Liu, Haizhou & Chen, Yanping & Wang, Jin & Xu, Jun, 2023. "Big data-driven correlation analysis based on clustering for energy-intensive manufacturing industries," Applied Energy, Elsevier, vol. 349(C).
    17. Hyun Cheol Jeong & Jaesung Jung & Byung O Kang, 2020. "Development of Operational Strategies of Energy Storage System Using Classification of Customer Load Profiles under Time-of-Use Tariffs in South Korea," Energies, MDPI, vol. 13(7), pages 1-17, April.
    18. Mishra, Kakuli & Basu, Srinka & Maulik, Ujjwal, 2022. "Load profile mining using directed weighted graphs with application towards demand response management," Applied Energy, Elsevier, vol. 311(C).
    19. Wen, Hanguan & Liu, Xiufeng & Yang, Ming & Lei, Bo & Cheng, Xu & Chen, Zhe, 2023. "An energy demand-side management and net metering decision framework," Energy, Elsevier, vol. 271(C).
    20. Das, Laya & Garg, Dinesh & Srinivasan, Babji, 2020. "NeuralCompression: A machine learning approach to compress high frequency measurements in smart grid," Applied Energy, Elsevier, vol. 257(C).
    21. Michalakopoulos, Vasilis & Sarmas, Elissaios & Papias, Ioannis & Skaloumpakas, Panagiotis & Marinakis, Vangelis & Doukas, Haris, 2024. "A machine learning-based framework for clustering residential electricity load profiles to enhance demand response programs," Applied Energy, Elsevier, vol. 361(C).
    22. Li, Lanlan & Ming, Huayang & Fu, Weizhong & Shi, Quan & Yu, Shiwei, 2021. "Exploring household natural gas consumption patterns and their influencing factors: An integrated clustering and econometric method," Energy, Elsevier, vol. 224(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Rongheng Lin & Budan Wu & Yun Su, 2018. "An Adaptive Weighted Pearson Similarity Measurement Method for Load Curve Clustering," Energies, MDPI, vol. 11(9), pages 1-17, September.
    2. Satre-Meloy, Aven & Diakonova, Marina & Grünewald, Philipp, 2020. "Cluster analysis and prediction of residential peak demand profiles using occupant activity data," Applied Energy, Elsevier, vol. 260(C).
    3. Li, Wenqiang & Gong, Guangcai & Fan, Houhua & Peng, Pei & Chun, Liang & Fang, Xi, 2021. "A clustering-based approach for “cross-scale” load prediction on building level in HVAC systems," Applied Energy, Elsevier, vol. 282(PB).
    4. Roberts, Mike B. & Haghdadi, Navid & Bruce, Anna & MacGill, Iain, 2019. "Characterisation of Australian apartment electricity demand and its implications for low-carbon cities," Energy, Elsevier, vol. 180(C), pages 242-257.
    5. Trotta, Gianluca, 2020. "An empirical analysis of domestic electricity load profiles: Who consumes how much and when?," Applied Energy, Elsevier, vol. 275(C).
    6. Yildiz, B. & Bilbao, J.I. & Dore, J. & Sproul, A.B., 2017. "Recent advances in the analysis of residential electricity consumption and applications of smart meter data," Applied Energy, Elsevier, vol. 208(C), pages 402-427.
    7. Valdes, Javier & Masip Macia, Yunesky & Dorner, Wolfgang & Ramirez Camargo, Luis, 2021. "Unsupervised grouping of industrial electricity demand profiles: Synthetic profiles for demand-side management applications," Energy, Elsevier, vol. 215(PA).
    8. Robbert Claeys & Hakim Azaioud & Rémy Cleenwerck & Jos Knockaert & Jan Desmet, 2020. "A Novel Feature Set for Low-Voltage Consumers, Based on the Temporal Dependence of Consumption and Peak Demands," Energies, MDPI, vol. 14(1), pages 1-24, December.
    9. Zhan, Sicheng & Liu, Zhaoru & Chong, Adrian & Yan, Da, 2020. "Building categorization revisited: A clustering-based approach to using smart meter data for building energy benchmarking," Applied Energy, Elsevier, vol. 269(C).
    10. Tang, Rui & Yildiz, Baran & Leong, Philip H.W. & Vassallo, Anthony & Dore, Jonathon, 2019. "Residential battery sizing model using net meter energy data clustering," Applied Energy, Elsevier, vol. 251(C), pages 1-1.
    11. Giasemidis, Georgios & Haben, Stephen & Lee, Tamsin & Singleton, Colin & Grindrod, Peter, 2017. "A genetic algorithm approach for modelling low voltage network demands," Applied Energy, Elsevier, vol. 203(C), pages 463-473.
    12. Jimyung Kang & Jee-Hyong Lee, 2015. "Electricity Customer Clustering Following Experts’ Principle for Demand Response Applications," Energies, MDPI, vol. 8(10), pages 1-24, October.
    13. Simona-Vasilica Oprea & Adela Bâra & Dan Preoțescu, 2019. "NoSQL Data Storage and Clustering Large Volume of Data from Smart Metering Systems with Impact on Electricity Consumption Peak and Tariff Settings," Ovidius University Annals, Economic Sciences Series, Ovidius University of Constantza, Faculty of Economic Sciences, vol. 0(2), pages 327-333, December.
    14. Kittel, Martin & Hobbie, Hannes & Dierstein, Constantin, 2022. "Temporal aggregation of time series to identify typical hourly electricity system states: A systematic assessment of relevant cluster algorithms," Energy, Elsevier, vol. 247(C).
    15. Zhang, Xiaohai & Ramírez-Mendiola, José Luis & Li, Mingtao & Guo, Liejin, 2022. "Electricity consumption pattern analysis beyond traditional clustering methods: A novel self-adapting semi-supervised clustering method and application case study," Applied Energy, Elsevier, vol. 308(C).
    16. Shimoda, Yoshiyuki & Yamaguchi, Yohei & Iwafune, Yumiko & Hidaka, Kazuyoshi & Meier, Alan & Yagita, Yoshie & Kawamoto, Hisaki & Nishikiori, Soichi, 2020. "Energy demand science for a decarbonized society in the context of the residential sector," Renewable and Sustainable Energy Reviews, Elsevier, vol. 132(C).
    17. Domínguez, R. & Vitali, S., 2021. "Multi-chronological hierarchical clustering to solve capacity expansion problems with renewable sources," Energy, Elsevier, vol. 227(C).
    18. Barrow, Devon & Kourentzes, Nikolaos, 2018. "The impact of special days in call arrivals forecasting: A neural network approach to modelling special days," European Journal of Operational Research, Elsevier, vol. 264(3), pages 967-977.
    19. Kenjiro Yagi & Ramteen Sioshansi, 2023. "Simplifying capacity planning for electricity systems with hydroelectric and renewable generation," Computational Management Science, Springer, vol. 20(1), pages 1-28, December.
    20. Evelina Di Corso & Tania Cerquitelli & Daniele Apiletti, 2018. "METATECH: METeorological Data Analysis for Thermal Energy CHaracterization by Means of Self-Learning Transparent Models," Energies, MDPI, vol. 11(6), pages 1-24, May.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:237:y:2019:i:c:p:11-24. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.