IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v18y2025i4p944-d1592420.html
   My bibliography  Save this article

Electricity Data Quality Enhancement Strategy Based on Low-Rank Matrix Recovery

Author

Listed:
  • Guo Xu

    (School of Electrical Engineering and Information, Northeast Petroleum University, Ranghu Road, Daqing 163318, China)

  • Xinliang Teng

    (School of Electrical Engineering and Information, Northeast Petroleum University, Ranghu Road, Daqing 163318, China)

  • Lei Zhang

    (College of Electronic Engineering, Nanjing Xiaozhuang University, Hongjing Avenue, Nanjing 211171, China)

  • Jianjun Xu

    (School of Electrical Engineering and Information, Northeast Petroleum University, Ranghu Road, Daqing 163318, China)

Abstract

Electricity consumption data form the foundation for the efficient and reliable operation of smart grids and are a critical component for ensuring effective data mining. However, due to factors such as meter failures and extreme weather conditions, anomalies frequently occur in the data, which adversely impact the performance of data-driven applications. Given the near full-rank nature of low-voltage distribution area electricity consumption data, this paper employs clustering to enhance the low-rank property of the data. Addressing common issues such as missing data, sparse noise, and Gaussian noise in electricity consumption data, this paper proposes a multi-norm optimization model based on low-rank matrix theory. Specifically, the truncated nuclear norm is used as an approximation of matrix rank, while the L 1 -norm and F -norm are employed to constrain sparse noise and Gaussian noise, respectively. The model is solved using the Alternating Direction Method of Multipliers (ADMM), achieving a unified framework for handling missing data and noise processing within the model construction. Comparative experiments on both synthetic and real-world datasets demonstrate that the proposed method can accurately recover measurement data under various noise contamination scenarios and different distributions of missing data. Moreover, it effectively separates principal components of the data from noise contamination.

Suggested Citation

  • Guo Xu & Xinliang Teng & Lei Zhang & Jianjun Xu, 2025. "Electricity Data Quality Enhancement Strategy Based on Low-Rank Matrix Recovery," Energies, MDPI, vol. 18(4), pages 1-24, February.
  • Handle: RePEc:gam:jeners:v:18:y:2025:i:4:p:944-:d:1592420
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/18/4/944/pdf
    Download Restriction: no

    File URL: https://www.mdpi.com/1996-1073/18/4/944/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Al-Wakeel, Ali & Wu, Jianzhong & Jenkins, Nick, 2017. "k-means based load estimation of domestic smart meter measurements," Applied Energy, Elsevier, vol. 194(C), pages 333-342.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Ruhang, Xu, 2020. "Efficient clustering for aggregate loads: An unsupervised pretraining based method," Energy, Elsevier, vol. 210(C).
    2. Rongheng Lin & Budan Wu & Yun Su, 2018. "An Adaptive Weighted Pearson Similarity Measurement Method for Load Curve Clustering," Energies, MDPI, vol. 11(9), pages 1-17, September.
    3. Zhong, Shengyuan & Wang, Xiaoyuan & Zhao, Jun & Li, Wenjia & Li, Hao & Wang, Yongzhen & Deng, Shuai & Zhu, Jiebei, 2021. "Deep reinforcement learning framework for dynamic pricing demand response of regenerative electric heating," Applied Energy, Elsevier, vol. 288(C).
    4. Jieyi Kang & David Reiner, 2021. "Machine Learning on residential electricity consumption: Which households are more responsive to weather?," Working Papers EPRG2113, Energy Policy Research Group, Cambridge Judge Business School, University of Cambridge.
    5. Emilio Ghiani & Alessandro Serpi & Virginia Pilloni & Giuliana Sias & Marco Simone & Gianluca Marcialis & Giuliano Armano & Paolo Attilio Pegoraro, 2018. "A Multidisciplinary Approach for the Development of Smart Distribution Networks," Energies, MDPI, vol. 11(10), pages 1-29, September.
    6. Zhou, Huansheng & Zheng, J.H. & Li, Zhigang & Wu, Q.H. & Zhou, X.X., 2019. "Multi-stage contingency-constrained co-planning for electricity-gas systems interconnected with gas-fired units and power-to-gas plants using iterative Benders decomposition," Energy, Elsevier, vol. 180(C), pages 689-701.
    7. Mitra, Somalee & Chakraborty, Basab & Mitra, Pabitra, 2024. "Smart meter data analytics applications for secure, reliable and robust grid system: Survey and future directions," Energy, Elsevier, vol. 289(C).
    8. Elnozahy, Ahmed & Abdel-Salam, Mazen & Abo-Elyousr, Farag K., 2024. "Optimal techno-economic energy coordination of solar PV water pumping irrigation systems," Energy, Elsevier, vol. 288(C).
    9. Alejandro Pena-Bello & Edward Barbour & Marta C. Gonzalez & Selin Yilmaz & Martin K. Patel & David Parra, 2020. "How Does the Electricity Demand Profile Impact the Attractiveness of PV-Coupled Battery Systems Combining Applications?," Energies, MDPI, vol. 13(15), pages 1-19, August.
    10. Raghuvamsi, Y & Teeparthi, Kiran, 2023. "A review on distribution system state estimation uncertainty issues using deep learning approaches," Renewable and Sustainable Energy Reviews, Elsevier, vol. 187(C).
    11. Oscar Duarte & Javier E. Duarte & Javier Rosero-Garcia, 2024. "Data Imputation in Electricity Consumption Profiles through Shape Modeling with Autoencoders," Mathematics, MDPI, vol. 12(19), pages 1-19, September.
    12. van Zoest, Vera & El Gohary, Fouad & Ngai, Edith C.H. & Bartusch, Cajsa, 2021. "Demand charges and user flexibility – Exploring differences in electricity consumer types and load patterns within the Swedish commercial sector," Applied Energy, Elsevier, vol. 302(C).
    13. Naderi, Shayan & Heslop, Simon & Chen, Dong & Watts, Scott & MacGill, Iain & Pignatta, Gloria & Sproul, Alistair, 2023. "Clustering based analysis of residential duck curve mitigation through solar pre-cooling: A case study of Australian housing stock," Renewable Energy, Elsevier, vol. 216(C).
    14. Wang, Yingli & Duan, Jialong & Zhao, Yuanyuan & Yuan, Haiwen & He, Benlin & Tang, Qunwei, 2018. "Film-type rain energy converters from conductive polymer/PtCo hybrids," Applied Energy, Elsevier, vol. 218(C), pages 317-324.
    15. Fanidhar Dewangan & Almoataz Y. Abdelaziz & Monalisa Biswal, 2023. "Load Forecasting Models in Smart Grid Using Smart Meter Information: A Review," Energies, MDPI, vol. 16(3), pages 1-55, January.
    16. Malin Lachmann & Jaime Maldonado & Wiebke Bergmann & Francesca Jung & Markus Weber & Christof Büskens, 2020. "Self-Learning Data-Based Models as Basis of a Universally Applicable Energy Management System," Energies, MDPI, vol. 13(8), pages 1-42, April.
    17. Zhang, Chao & Lasaulce, Samson & Hennebel, Martin & Saludjian, Lucas & Panciatici, Patrick & Poor, H. Vincent, 2021. "Decision-making oriented clustering: Application to pricing and power consumption scheduling," Applied Energy, Elsevier, vol. 297(C).
    18. Rafik Nafkha & Krzysztof Gajowniczek & Tomasz Ząbkowski, 2018. "Do Customers Choose Proper Tariff? Empirical Analysis Based on Polish Data Using Unsupervised Techniques," Energies, MDPI, vol. 11(3), pages 1-17, February.
    19. Abeysinghe, Sathsara & Wu, Jianzhong & Sooriyabandara, Mahesh & Abeysekera, Muditha & Xu, Tao & Wang, Chengshan, 2018. "Topological properties of medium voltage electricity distribution networks," Applied Energy, Elsevier, vol. 210(C), pages 1101-1112.
    20. Jingyuan Zhang & Jusheng Song & Zouyang Fan, 2023. "The Study of Historical Progression in the Distribution of Urban Commercial Space Locations—Example of Paris," Sustainability, MDPI, vol. 15(19), pages 1-23, October.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:18:y:2025:i:4:p:944-:d:1592420. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.