IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v15y2022i20p7557-d941265.html
   My bibliography  Save this article

Data Preparation and Visualization of Electricity Consumption for Load Profiling

Author

Listed:
  • Oscar G. Duarte

    (Facultad de Ingeniería, Universidad Nacional de Colombia, Bogotá 111321, Colombia
    These authors contributed equally to this work.)

  • Javier A. Rosero

    (Facultad de Ingeniería, Universidad Nacional de Colombia, Bogotá 111321, Colombia
    These authors contributed equally to this work.)

  • María del Carmen Pegalajar

    (Escuela Técnica Superior de Ingenierías Informática y de Telecomunicaciones, Universidad de Granada, 18014 Granada, Spain
    These authors contributed equally to this work.)

Abstract

The construction of daily electricity consumption profiles is a common practice for user characterization and segmentation tasks. As in any data analysis project, to obtain these load profiles, a stage of data preparation is necessary. This article explores to what extent does the selection of the data preparation technique impacts load profiling. The techniques discussed are used in the following tasks: standardization, construction of data, dimensionality reduction and data enrichment. The analysis reveals a great incidence of the data preparation on the result. The need to make the data preparation process explicit in each report is identified. In particular, it is highlighted that the most usual default standardization process, column standardization, is not adequate in the preparation of energy consumption profiles.

Suggested Citation

  • Oscar G. Duarte & Javier A. Rosero & María del Carmen Pegalajar, 2022. "Data Preparation and Visualization of Electricity Consumption for Load Profiling," Energies, MDPI, vol. 15(20), pages 1-30, October.
    • Handle: RePEc:gam:jeners:v:15:y:2022:i:20:p:7557-:d:941265
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/15/20/7557/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/15/20/7557/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jong-Il Park & Chang-Hyun Park, 2022. "Harmonic Contribution Assessment Based on the Random Sample Consensus and Recursive Least Square Methods," Energies, MDPI, vol. 15(17), pages 1-18, September.
    2. Jun-Hao Chen & Kuang-Hsiung Tan & Yih-Der Lee, 2022. "Intelligent Controlled DSTATCOM for Power Quality Enhancement," Energies, MDPI, vol. 15(11), pages 1-19, May.
    3. Ioannidis, Filippos & Kosmidou, Kyriaki & Savva, Christos & Theodossiou, Panayiotis, 2021. "Electricity pricing using a periodic GARCH model with conditional skewness and kurtosis components," Energy Economics, Elsevier, vol. 95(C).
    4. Yi-Hung Liao & Yen-Lun Lin, 2022. "An Improved Down-Scale Evaluation System for Capacitors Utilized in High-Power Three-Phase Inverters under Balanced and Unbalanced Load Conditions," Energies, MDPI, vol. 15(19), pages 1-14, September.
    5. Guodong Liu & Maximiliano F. Ferrari & Thomas B. Ollis & Kevin Tomsovic, 2022. "An MILP-Based Distributed Energy Management for Coordination of Networked Microgrids," Energies, MDPI, vol. 15(19), pages 1-20, September.
    6. Yankun Xia & Wenzhang Tang, 2022. "Study on Harmonic Impedance Estimation Based on Gaussian Mixture Regression Using Railway Power Supply Loads," Energies, MDPI, vol. 15(19), pages 1-18, September.
    7. Mohammad Mujahid Irfan & Sushama Malaji & Chandrashekhar Patsa & Shriram S. Rangarajan & S. M. Suhail Hussain, 2022. "Control of DSTATCOM Using ANN-BP Algorithm for the Grid Connected Wind Energy System," Energies, MDPI, vol. 15(19), pages 1-14, September.
    8. Edgardo Cayon & Julio Sarmiento, 2022. "The Impact of Coskewness and Cokurtosis as Augmentation Factors in Modeling Colombian Electricity Price Returns," Energies, MDPI, vol. 15(19), pages 1-8, September.
    9. Arash Moradzadeh & Omid Sadeghian & Kazem Pourhossein & Behnam Mohammadi-Ivatloo & Amjad Anvari-Moghaddam, 2020. "Improving Residential Load Disaggregation for Sustainable Development of Energy via Principal Component Analysis," Sustainability, MDPI, vol. 12(8), pages 1-14, April.
    10. Arman Goudarzi & Farzad Ghayoor & Muhammad Waseem & Shah Fahad & Issa Traore, 2022. "A Survey on IoT-Enabled Smart Grids: Emerging, Applications, Challenges, and Outlook," Energies, MDPI, vol. 15(19), pages 1-32, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Muhammad Waseem & Muhammad Adnan Khan & Arman Goudarzi & Shah Fahad & Intisar Ali Sajjad & Pierluigi Siano, 2023. "Incorporation of Blockchain Technology for Different Smart Grid Applications: Architecture, Prospects, and Challenges," Energies, MDPI, vol. 16(2), pages 1-29, January.
    2. İsmail Hakkı Çavdar & Vahit Feryad, 2021. "Efficient Design of Energy Disaggregation Model with BERT-NILM Trained by AdaX Optimization Method for Smart Grid," Energies, MDPI, vol. 14(15), pages 1-21, July.
    3. Ines Ortega-Fernandez & Francesco Liberati, 2023. "A Review of Denial of Service Attack and Mitigation in the Smart Grid Using Reinforcement Learning," Energies, MDPI, vol. 16(2), pages 1-15, January.
    4. Sheeraz Kirmani & Abdul Mazid & Irfan Ahmad Khan & Manaullah Abid, 2022. "A Survey on IoT-Enabled Smart Grids: Technologies, Architectures, Applications, and Challenges," Sustainability, MDPI, vol. 15(1), pages 1-26, December.
    5. Arash Moradzadeh & Sahar Zakeri & Maryam Shoaran & Behnam Mohammadi-Ivatloo & Fazel Mohammadi, 2020. "Short-Term Load Forecasting of Microgrid via Hybrid Support Vector Regression and Long Short-Term Memory Algorithms," Sustainability, MDPI, vol. 12(17), pages 1-17, August.
    6. Edgardo Cayon & Julio Sarmiento, 2022. "The Impact of Coskewness and Cokurtosis as Augmentation Factors in Modeling Colombian Electricity Price Returns," Energies, MDPI, vol. 15(19), pages 1-8, September.
    7. Ehsani, Behdad & Pineau, Pierre-Olivier & Charlin, Laurent, 2024. "Price forecasting in the Ontario electricity market via TriConvGRU hybrid model: Univariate vs. multivariate frameworks," Applied Energy, Elsevier, vol. 359(C).
    8. Angelos Patsidis & Adam Dyśko & Campbell Booth & Anastasios Oulis Rousis & Polyxeni Kalliga & Dimitrios Tzelepis, 2023. "Digital Architecture for Monitoring and Operational Analytics of Multi-Vector Microgrids Utilizing Cloud Computing, Advanced Virtualization Techniques, and Data Analytics Methods," Energies, MDPI, vol. 16(16), pages 1-19, August.
    9. Nametala, Ciniro Aparecido Leite & Faria, Wandry Rodrigues & Lage, Guilherme Guimarães & Pereira, Benvindo Rodrigues, 2023. "Analysis of hourly price granularity implementation in the Brazilian deregulated electricity contracting environment," Utilities Policy, Elsevier, vol. 81(C).
    10. Rassi, Samin & Kanamura, Takashi, 2023. "Electricity price spike formation and LNG prices effect under gross bidding scheme in JEPX," Energy Policy, Elsevier, vol. 177(C).
    11. Stefani Freitas & Luis Carlos Oliveira & Priscila Oliveira & Bruno Exposto & José Gabriel Pinto & Joao L. Afonso, 2023. "New Topology of a Hybrid, Three-Phase, Four-Wire Shunt Active Power Filter," Energies, MDPI, vol. 16(3), pages 1-28, January.
    12. Nagaraj Naik & Biju R. Mohan, 2021. "Stock Price Volatility Estimation Using Regime Switching Technique-Empirical Study on the Indian Stock Market," Mathematics, MDPI, vol. 9(14), pages 1-18, July.
    13. Kh Md Nahiduzzaman & Abdullatif Said Abdallah & Arash Moradzadeh & Amin Mohammadpour Shotorbani & Kasun Hewage & Rehan Sadiq, 2023. "Impacts of Tariffs on Energy Conscious Behavior with Respect to Household Attributes in Saudi Arabia," Energies, MDPI, vol. 16(3), pages 1-24, February.
    14. Leandro José Duarte & Alan Petrônio Pinheiro & Daniel Oliveira Ferreira, 2022. "A Real-Time Method to Estimate the Operational Condition of Distribution Transformers," Energies, MDPI, vol. 15(22), pages 1-20, November.
    15. Sherzod N. Tashpulatov, 2022. "Modeling Electricity Price Dynamics Using Flexible Distributions," Mathematics, MDPI, vol. 10(10), pages 1-15, May.
    16. Zehui Yuan & Zheng Liao & Haiyan Tu & Yuxin Tu & Wei Li, 2022. "Analysis of Wide-Frequency Dense Signals Based on Fast Minimization Algorithm," Energies, MDPI, vol. 15(15), pages 1-18, August.
    17. Mohammad Kamrul Hasan & AKM Ahasan Habib & Shayla Islam & Mohammed Balfaqih & Khaled M. Alfawaz & Dalbir Singh, 2023. "Smart Grid Communication Networks for Electric Vehicles Empowering Distributed Energy Generation: Constraints, Challenges, and Recommendations," Energies, MDPI, vol. 16(3), pages 1-20, January.
    18. Raad Salih Jawad & Hafedh Abid, 2023. "HVDC Fault Detection and Classification with Artificial Neural Network Based on ACO-DWT Method," Energies, MDPI, vol. 16(3), pages 1-18, January.
    19. Wu, Han & Liang, Yan & Gao, Xiao-Zhi & Du, Pei, 2024. "Auditory-circuit-motivated deep network with application to short-term electricity price forecasting," Energy, Elsevier, vol. 288(C).
    20. Carles Manera & Eloi Serrano & José Pérez-Montiel & Màrian Buil-Fabregà, 2021. "Construction of Biophysical Indicators for the Catalan Economy: Building a New Conceptual Framework," Sustainability, MDPI, vol. 13(13), pages 1-20, July.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:15:y:2022:i:20:p:7557-:d:941265. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.