IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v334y2023ics030626192300065x.html
   My bibliography  Save this article

Augmenting energy time-series for data-efficient imputation of missing values

Author

Listed:
  • Liguori, Antonio
  • Markovic, Romana
  • Ferrando, Martina
  • Frisch, Jérôme
  • Causone, Francesco
  • van Treeck, Christoph

Abstract

This study explores the applicability of data augmentation techniques for reconstructing missing energy time-series in limited data regimes. In particular, multiple synthetic copies of a relatively small training dataset are stacked together with pseudo-random noise. First, an existing convolutional denoising autoencoder is selected from a previous work, as the base imputation model of this study. Then, an optimal augmentation rate, which minimizes the training set of the model, is chosen based on the preliminary results obtained from one building. The results proved that, augmenting 80 times a nine days-long training set could reduce the initial average root mean squared error (RMSE) by 37% and 48%, for continuous and random missing scenarios. Additionally, the augmented model outperformed the benchmark methods with 23% and 12% lower average RMSE. No additional tuning or calibration costs were required for the existing base imputation model. Therefore, the presented data augmentation technique could significantly reduce the expensive computational costs associated with deep learning models.

Suggested Citation

  • Liguori, Antonio & Markovic, Romana & Ferrando, Martina & Frisch, Jérôme & Causone, Francesco & van Treeck, Christoph, 2023. "Augmenting energy time-series for data-efficient imputation of missing values," Applied Energy, Elsevier, vol. 334(C).
  • Handle: RePEc:eee:appene:v:334:y:2023:i:c:s030626192300065x
    DOI: 10.1016/j.apenergy.2023.120701
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S030626192300065X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.apenergy.2023.120701?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Lu, Yakai & Tian, Zhe & Zhang, Qiang & Zhou, Ruoyu & Chu, Chengshan, 2021. "Data augmentation strategy for short-term heating load prediction model of residential building," Energy, Elsevier, vol. 235(C).
    2. Mohamed Lotfi & Mohammad Javadi & Gerardo J. Osório & Cláudio Monteiro & João P. S. Catalão, 2020. "A Novel Ensemble Algorithm for Solar Power Forecasting Based on Kernel Density Estimation," Energies, MDPI, vol. 13(1), pages 1-19, January.
    3. Fan, Cheng & Xiao, Fu & Zhao, Yang & Wang, Jiayuan, 2018. "Analytical investigation of autoencoder-based methods for unsupervised anomaly detection in building energy data," Applied Energy, Elsevier, vol. 211(C), pages 1123-1135.
    4. Jeong, Dongyeon & Park, Chiwoo & Ko, Young Myoung, 2021. "Missing data imputation using mixture factor analysis for building electric load data," Applied Energy, Elsevier, vol. 304(C).
    5. Qian, Fanyue & Gao, Weijun & Yang, Yongwen & Yu, Dan, 2020. "Potential analysis of the transfer learning model in short and medium-term forecasting of building HVAC energy consumption," Energy, Elsevier, vol. 193(C).
    6. Charles R. Harris & K. Jarrod Millman & Stéfan J. Walt & Ralf Gommers & Pauli Virtanen & David Cournapeau & Eric Wieser & Julian Taylor & Sebastian Berg & Nathaniel J. Smith & Robert Kern & Matti Picu, 2020. "Array programming with NumPy," Nature, Nature, vol. 585(7825), pages 357-362, September.
    7. Francesco Simmini & Marco Agostini & Massimiliano Coppo & Tommaso Caldognetto & Andrea Cervi & Fabio Lain & Ruggero Carli & Roberto Turri & Paolo Tenti, 2020. "Leveraging Demand Flexibility by Exploiting Prosumer Response to Price Signals in Microgrids," Energies, MDPI, vol. 13(12), pages 1-19, June.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Chen, Siliang & Ge, Wei & Liang, Xinbin & Jin, Xinqiao & Du, Zhimin, 2024. "Lifelong learning with deep conditional generative replay for dynamic and adaptive modeling towards net zero emissions target in building energy system," Applied Energy, Elsevier, vol. 353(PB).
    2. Chen, Fan & Yu, Lan & Mao, Jinqi & Yang, Qing & Wang, Delu & Yu, Chenghao, 2024. "A novel data-characteristic-driven modeling approach for imputing missing value in industrial statistics: A case study of China electricity statistics," Applied Energy, Elsevier, vol. 373(C).
    3. Chen, Yaoran & Cai, Candong & Cao, Leilei & Zhang, Dan & Kuang, Limin & Peng, Yan & Pu, Huayan & Wu, Chuhan & Zhou, Dai & Cao, Yong, 2024. "WindFix: Harnessing the power of self-supervised learning for versatile imputation of offshore wind speed time series," Energy, Elsevier, vol. 287(C).
    4. Jeon, Jihun & Cheon, Hojin & Jung, Byungil & Kim, Hongseok, 2024. "ProADD: Proactive battery anomaly dual detection leveraging denoising convolutional autoencoder and incremental voltage analysis," Applied Energy, Elsevier, vol. 373(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Fan, Cheng & Chen, Ruikun & Mo, Jinhan & Liao, Longhui, 2024. "Personalized federated learning for cross-building energy knowledge sharing: Cost-effective strategies and model architectures," Applied Energy, Elsevier, vol. 362(C).
    2. Li, Jiangkuan & Lin, Meng & Li, Yankai & Wang, Xu, 2022. "Transfer learning network for nuclear power plant fault diagnosis with unlabeled data under varying operating conditions," Energy, Elsevier, vol. 254(PB).
    3. Tan Wang & L. Jeff Hong, 2023. "Large-Scale Inventory Optimization: A Recurrent Neural Networks–Inspired Simulation Approach," INFORMS Journal on Computing, INFORMS, vol. 35(1), pages 196-215, January.
    4. Geeraert, Joke & Rocha, Luis E.C. & Vandeviver, Christophe, 2024. "The impact of violent behavior on co-offender selection: Evidence of behavioral homophily," Journal of Criminal Justice, Elsevier, vol. 94(C).
    5. Léon Faure & Bastien Mollet & Wolfram Liebermeister & Jean-Loup Faulon, 2023. "A neural-mechanistic hybrid approach improving the predictive power of genome-scale metabolic models," Nature Communications, Nature, vol. 14(1), pages 1-14, December.
    6. Claudia Quinteros-Cartaya & Guillermo Solorio-Magaña & Francisco Javier Núñez-Cornú & Felipe de Jesús Escalona-Alcázar & Diana Núñez, 2023. "Microearthquakes in the Guadalajara Metropolitan Zone, Mexico: evidence from buried active faults in Tesistán Valley, Zapopan," Natural Hazards: Journal of the International Society for the Prevention and Mitigation of Natural Hazards, Springer;International Society for the Prevention and Mitigation of Natural Hazards, vol. 116(3), pages 2797-2818, April.
    7. Simona-Vasilica Oprea & Adela Bâra & Florina Camelia Puican & Ioan Cosmin Radu, 2021. "Anomaly Detection with Machine Learning Algorithms and Big Data in Electricity Consumption," Sustainability, MDPI, vol. 13(19), pages 1-20, October.
    8. Furqan Dar & Samuel R. Cohen & Diana M. Mitrea & Aaron H. Phillips & Gergely Nagy & Wellington C. Leite & Christopher B. Stanley & Jeong-Mo Choi & Richard W. Kriwacki & Rohit V. Pappu, 2024. "Biomolecular condensates form spatially inhomogeneous network fluids," Nature Communications, Nature, vol. 15(1), pages 1-17, December.
    9. Chen, Zhelun & O’Neill, Zheng & Wen, Jin & Pradhan, Ojas & Yang, Tao & Lu, Xing & Lin, Guanjing & Miyata, Shohei & Lee, Seungjae & Shen, Chou & Chiosa, Roberto & Piscitelli, Marco Savino & Capozzoli, , 2023. "A review of data-driven fault detection and diagnostics for building HVAC systems," Applied Energy, Elsevier, vol. 339(C).
    10. Fan, Cheng & Sun, Yongjun & Zhao, Yang & Song, Mengjie & Wang, Jiayuan, 2019. "Deep learning-based feature engineering methods for improved building energy prediction," Applied Energy, Elsevier, vol. 240(C), pages 35-45.
    11. Xinghua Wang & Fucheng Zhong & Yilin Xu & Xixian Liu & Zezhong Li & Jianan Liu & Zhuoli Zhao, 2023. "Extraction and Joint Method of PV–Load Typical Scenes Considering Temporal and Spatial Distribution Characteristics," Energies, MDPI, vol. 16(18), pages 1-19, September.
    12. Nina Tiel & Fabian Fopp & Philipp Brun & Johan Hoogen & Dirk Nikolaus Karger & Cecilia M. Casadei & Lisha Lyu & Devis Tuia & Niklaus E. Zimmermann & Thomas W. Crowther & Loïc Pellissier, 2024. "Regional uniqueness of tree species composition and response to forest loss and climate change," Nature Communications, Nature, vol. 15(1), pages 1-12, December.
    13. López Pérez, Mario & Mansilla Corona, Ricardo, 2022. "Ordinal synchronization and typical states in high-frequency digital markets," Physica A: Statistical Mechanics and its Applications, Elsevier, vol. 598(C).
    14. Xavier Serrano-Guerrero & Guillermo Escrivá-Escrivá & Santiago Luna-Romero & Jean-Michel Clairand, 2020. "A Time-Series Treatment Method to Obtain Electrical Consumption Patterns for Anomalies Detection Improvement in Electrical Consumption Profiles," Energies, MDPI, vol. 13(5), pages 1-23, February.
    15. Netzah Calamaro & Yuval Beck & Ran Ben Melech & Doron Shmilovitz, 2021. "An Energy-Fraud Detection-System Capable of Distinguishing Frauds from Other Energy Flow Anomalies in an Urban Environment," Sustainability, MDPI, vol. 13(19), pages 1-38, September.
    16. Jessica M. Vanslambrouck & Sean B. Wilson & Ker Sin Tan & Ella Groenewegen & Rajeev Rudraraju & Jessica Neil & Kynan T. Lawlor & Sophia Mah & Michelle Scurr & Sara E. Howden & Kanta Subbarao & Melissa, 2022. "Enhanced metanephric specification to functional proximal tubule enables toxicity screening and infectious disease modelling in kidney organoids," Nature Communications, Nature, vol. 13(1), pages 1-23, December.
    17. Kiran Krishnamachari & Dylan Lu & Alexander Swift-Scott & Anuar Yeraliyev & Kayla Lee & Weitai Huang & Sim Ngak Leng & Anders Jacobsen Skanderup, 2022. "Accurate somatic variant detection using weakly supervised deep learning," Nature Communications, Nature, vol. 13(1), pages 1-8, December.
    18. Larissa Samaan & Leonie Klock & Sandra Weber & Mirjam Reidick & Leonie Ascone & Simone Kühn, 2024. "Low-Level Visual Features of Window Views Contribute to Perceived Naturalness and Mental Health Outcomes," IJERPH, MDPI, vol. 21(5), pages 1-35, May.
    19. Dennis Bontempi & Leonard Nuernberg & Suraj Pai & Deepa Krishnaswamy & Vamsi Thiriveedhi & Ahmed Hosny & Raymond H. Mak & Keyvan Farahani & Ron Kikinis & Andrey Fedorov & Hugo J. W. L. Aerts, 2024. "End-to-end reproducible AI pipelines in radiology using the cloud," Nature Communications, Nature, vol. 15(1), pages 1-9, December.
    20. Lauren L. Porter & Allen K. Kim & Swechha Rimal & Loren L. Looger & Ananya Majumdar & Brett D. Mensh & Mary R. Starich & Marie-Paule Strub, 2022. "Many dissimilar NusG protein domains switch between α-helix and β-sheet folds," Nature Communications, Nature, vol. 13(1), pages 1-12, December.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:334:y:2023:i:c:s030626192300065x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.