IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v14y2021i5p1481-d513031.html
   My bibliography  Save this article

Uncertainty Matters: Bayesian Probabilistic Forecasting for Residential Smart Meter Prediction, Segmentation, and Behavioral Measurement and Verification

Author

Listed:
  • Jonathan Roth

    (Building and Urban Data Science (BUDS) Lab, National University of Singapore, Singapore 119007, Singapore
    Stanford Urban Informatics Lab, Civil, and Environmental Engineering, Stanford University, Stanford, CA 94305, USA)

  • Jayashree Chadalawada

    (Building and Urban Data Science (BUDS) Lab, National University of Singapore, Singapore 119007, Singapore
    Civil and Environmental Engineering, National University of Singapore, Singapore 119007, Singapore)

  • Rishee K. Jain

    (Stanford Urban Informatics Lab, Civil, and Environmental Engineering, Stanford University, Stanford, CA 94305, USA)

  • Clayton Miller

    (Building and Urban Data Science (BUDS) Lab, National University of Singapore, Singapore 119007, Singapore)

Abstract

As new grid edge technologies emerge—such as rooftop solar panels, battery storage, and controllable water heaters—quantifying the uncertainties of building load forecasts is becoming more critical. The recent adoption of smart meter infrastructures provided new granular data streams, largely unavailable just ten years ago, that can be utilized to better forecast building-level demand. This paper uses Bayesian Structural Time Series for probabilistic load forecasting at the residential building level to capture uncertainties in forecasting. We use sub-hourly electrical submeter data from 120 residential apartments in Singapore that were part of a behavioral intervention study. The proposed model addresses several fundamental limitations through its flexibility to handle univariate and multivariate scenarios, perform feature selection, and include either static or dynamic effects, as well as its inherent applicability for measurement and verification. We highlight the benefits of this process in three main application areas: (1) Probabilistic Load Forecasting for Apartment-Level Hourly Loads; (2) Submeter Load Forecasting and Segmentation; (3) Measurement and Verification for Behavioral Demand Response. Results show the model achieves a similar performance to ARIMA, another popular time series model, when predicting individual apartment loads, and superior performance when predicting aggregate loads. Furthermore, we show that the model robustly captures uncertainties in the forecasts while providing interpretable results, indicating the importance of, for example, temperature data in its predictions. Finally, our estimates for a behavioral demand response program indicate that it achieved energy savings; however, the confidence interval provided by the probabilistic model is wide. Overall, this probabilistic forecasting model accurately measures uncertainties in forecasts and provides interpretable results that can support building managers and policymakers with the goal of reducing energy use.

Suggested Citation

  • Jonathan Roth & Jayashree Chadalawada & Rishee K. Jain & Clayton Miller, 2021. "Uncertainty Matters: Bayesian Probabilistic Forecasting for Residential Smart Meter Prediction, Segmentation, and Behavioral Measurement and Verification," Energies, MDPI, vol. 14(5), pages 1-22, March.
    • Handle: RePEc:gam:jeners:v:14:y:2021:i:5:p:1481-:d:513031
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/14/5/1481/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/14/5/1481/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Zhang, Yao & Wang, Jianxue & Wang, Xifan, 2014. "Review on probabilistic forecasting of wind power generation," Renewable and Sustainable Energy Reviews, Elsevier, vol. 32(C), pages 255-270.
    2. Zhao, Hai-xiang & Magoulès, Frédéric, 2012. "A review on the prediction of building energy consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 16(6), pages 3586-3592.
    3. Wang, Yi & Gan, Dahua & Sun, Mingyang & Zhang, Ning & Lu, Zongxiang & Kang, Chongqing, 2019. "Probabilistic individual load forecasting using pinball loss guided LSTM," Applied Energy, Elsevier, vol. 235(C), pages 10-20.
    4. Hyndman, Rob J. & Khandakar, Yeasmin, 2008. "Automatic Time Series Forecasting: The forecast Package for R," Journal of Statistical Software, Foundation for Open Access Statistics, vol. 27(i03).
    5. Wang, Endong & Alp, Neslihan & Shi, Jonathan & Wang, Chao & Zhang, Xiaodong & Chen, Hong, 2017. "Multi-criteria building energy performance benchmarking through variable clustering based compromise TOPSIS with objective entropy weighting," Energy, Elsevier, vol. 125(C), pages 197-210.
    6. Christoph Flath & David Nicolay & Tobias Conte & Clemens Dinther & Lilia Filipova-Neumann, 2012. "Cluster Analysis of Smart Metering Data," Business & Information Systems Engineering: The International Journal of WIRTSCHAFTSINFORMATIK, Springer;Gesellschaft für Informatik e.V. (GI), vol. 4(1), pages 31-39, February.
    7. Rishee K. Jain & Junjie Qin & Ram Rajagopal, 2017. "Data-driven planning of distributed energy resources amidst socio-technical complexities," Nature Energy, Nature, vol. 2(8), pages 1-11, August.
    8. Yang, Yandong & Li, Shufang & Li, Wenqi & Qu, Meijun, 2018. "Power load probability density forecasting using Gaussian process quantile regression," Applied Energy, Elsevier, vol. 213(C), pages 499-509.
    9. Jain, Rishee K. & Smith, Kevin M. & Culligan, Patricia J. & Taylor, John E., 2014. "Forecasting energy consumption of multi-family residential buildings using support vector regression: Investigating the impact of temporal and spatial monitoring granularity on performance accuracy," Applied Energy, Elsevier, vol. 123(C), pages 168-178.
    10. Hong, Tao & Pinson, Pierre & Fan, Shu, 2014. "Global Energy Forecasting Competition 2012," International Journal of Forecasting, Elsevier, vol. 30(2), pages 357-363.
    11. Tao Hong & Pierre Pinson & Yi Wang & Rafal Weron & Dazhi Yang & Hamidreza Zareipour, 2020. "Energy forecasting: A review and outlook," WORking papers in Management Science (WORMS) WORMS/20/08, Department of Operations Research and Business Intelligence, Wroclaw University of Science and Technology.
    12. Nilsson, Anders & Lazarevic, David & Brandt, Nils & Kordas, Olga, 2018. "Household responsiveness to residential demand response strategies: Results and policy implications from a Swedish field study," Energy Policy, Elsevier, vol. 122(C), pages 273-286.
    13. Arora, Siddharth & Taylor, James W., 2016. "Forecasting electricity smart meter data using conditional kernel density estimation," Omega, Elsevier, vol. 59(PA), pages 47-59.
    14. Jakub Nowotarski & Rafał Weron, 2015. "Computing electricity spot price prediction intervals using quantile regression and forecast averaging," Computational Statistics, Springer, vol. 30(3), pages 791-803, September.
    15. Herman Carstens & Xiaohua Xia & Sarma Yadavalli, 2018. "Bayesian Energy Measurement and Verification Analysis," Energies, MDPI, vol. 11(2), pages 1-20, February.
    16. Roth, Jonathan & Rajagopal, Ram, 2018. "Benchmarking building energy efficiency using quantile regression," Energy, Elsevier, vol. 152(C), pages 866-876.
    17. Yang, Yandong & Hong, Weijun & Li, Shufang, 2019. "Deep ensemble learning based probabilistic load forecasting in smart grids," Energy, Elsevier, vol. 189(C).
    18. Hong, Tao & Fan, Shu, 2016. "Probabilistic electric load forecasting: A tutorial review," International Journal of Forecasting, Elsevier, vol. 32(3), pages 914-938.
    19. Miller, Clayton & Nagy, Zoltán & Schlueter, Arno, 2018. "A review of unsupervised statistical learning and visual analytics techniques applied to performance analysis of non-residential buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 81(P1), pages 1365-1377.
    20. Roth, Jonathan & Martin, Amory & Miller, Clayton & Jain, Rishee K., 2020. "SynCity: Using open data to create a synthetic city of hourly building energy estimates by integrating data-driven and physics-based methods," Applied Energy, Elsevier, vol. 280(C).
    21. Chang-Jin Kim & Charles R. Nelson, 1999. "State-Space Models with Regime Switching: Classical and Gibbs-Sampling Approaches with Applications," MIT Press Books, The MIT Press, edition 1, volume 1, number 0262112388, April.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. João Victor Jales Melo & George Rossany Soares Lira & Edson Guedes Costa & Antonio F. Leite Neto & Iago B. Oliveira, 2022. "Short-Term Load Forecasting on Individual Consumers," Energies, MDPI, vol. 15(16), pages 1-16, August.
    2. Fanidhar Dewangan & Almoataz Y. Abdelaziz & Monalisa Biswal, 2023. "Load Forecasting Models in Smart Grid Using Smart Meter Information: A Review," Energies, MDPI, vol. 16(3), pages 1-55, January.
    3. Mohamed S. Abdalzaher & Mostafa M. Fouda & Mohamed I. Ibrahem, 2022. "Data Privacy Preservation and Security in Smart Metering Systems," Energies, MDPI, vol. 15(19), pages 1-19, October.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Roth, Jonathan & Martin, Amory & Miller, Clayton & Jain, Rishee K., 2020. "SynCity: Using open data to create a synthetic city of hourly building energy estimates by integrating data-driven and physics-based methods," Applied Energy, Elsevier, vol. 280(C).
    2. Petropoulos, Fotios & Apiletti, Daniele & Assimakopoulos, Vassilios & Babai, Mohamed Zied & Barrow, Devon K. & Ben Taieb, Souhaib & Bergmeir, Christoph & Bessa, Ricardo J. & Bijak, Jakub & Boylan, Joh, 2022. "Forecasting: theory and practice," International Journal of Forecasting, Elsevier, vol. 38(3), pages 705-871.
      • Fotios Petropoulos & Daniele Apiletti & Vassilios Assimakopoulos & Mohamed Zied Babai & Devon K. Barrow & Souhaib Ben Taieb & Christoph Bergmeir & Ricardo J. Bessa & Jakub Bijak & John E. Boylan & Jet, 2020. "Forecasting: theory and practice," Papers 2012.03854, arXiv.org, revised Jan 2022.
    3. Haben, Stephen & Arora, Siddharth & Giasemidis, Georgios & Voss, Marcus & Vukadinović Greetham, Danica, 2021. "Review of low voltage load forecasting: Methods, applications, and recommendations," Applied Energy, Elsevier, vol. 304(C).
    4. de Hoog, Julian & Abdulla, Khalid, 2019. "Data visualization and forecast combination for probabilistic load forecasting in GEFCom2017 final match," International Journal of Forecasting, Elsevier, vol. 35(4), pages 1451-1459.
    5. Aslam, Sheraz & Herodotou, Herodotos & Mohsin, Syed Muhammad & Javaid, Nadeem & Ashraf, Nouman & Aslam, Shahzad, 2021. "A survey on deep learning methods for power load and renewable energy forecasting in smart microgrids," Renewable and Sustainable Energy Reviews, Elsevier, vol. 144(C).
    6. Sharifzadeh, Mahdi & Sikinioti-Lock, Alexandra & Shah, Nilay, 2019. "Machine-learning methods for integrated renewable power generation: A comparative study of artificial neural networks, support vector regression, and Gaussian Process Regression," Renewable and Sustainable Energy Reviews, Elsevier, vol. 108(C), pages 513-538.
    7. Bartosz Uniejewski, 2023. "Smoothing Quantile Regression Averaging: A new approach to probabilistic forecasting of electricity prices," Papers 2302.00411, arXiv.org, revised Nov 2024.
    8. Brusaferri, Alessandro & Matteucci, Matteo & Spinelli, Stefano & Vitali, Andrea, 2022. "Probabilistic electric load forecasting through Bayesian Mixture Density Networks," Applied Energy, Elsevier, vol. 309(C).
    9. Voyant, Cyril & Notton, Gilles & Duchaud, Jean-Laurent & Gutiérrez, Luis Antonio García & Bright, Jamie M. & Yang, Dazhi, 2022. "Benchmarks for solar radiation time series forecasting," Renewable Energy, Elsevier, vol. 191(C), pages 747-762.
    10. van der Meer, D.W. & Shepero, M. & Svensson, A. & Widén, J. & Munkhammar, J., 2018. "Probabilistic forecasting of electricity consumption, photovoltaic power generation and net demand of an individual building using Gaussian Processes," Applied Energy, Elsevier, vol. 213(C), pages 195-207.
    11. Stefano Bianchi & Allegra De Filippo & Sandro Magnani & Gabriele Mosaico & Federico Silvestro, 2021. "VIRTUS Project: A Scalable Aggregation Platform for the Intelligent Virtual Management of Distributed Energy Resources," Energies, MDPI, vol. 14(12), pages 1-31, June.
    12. Xu, Xiuqin & Chen, Ying & Goude, Yannig & Yao, Qiwei, 2021. "Day-ahead probabilistic forecasting for French half-hourly electricity loads and quantiles for curve-to-curve regression," Applied Energy, Elsevier, vol. 301(C).
    13. Gde Dharma Nugraha & Ardiansyah Musa & Jaiyoung Cho & Kishik Park & Deokjai Choi, 2018. "Lambda-Based Data Processing Architecture for Two-Level Load Forecasting in Residential Buildings," Energies, MDPI, vol. 11(4), pages 1-20, March.
    14. Hong, Tao & Pinson, Pierre & Fan, Shu & Zareipour, Hamidreza & Troccoli, Alberto & Hyndman, Rob J., 2016. "Probabilistic energy forecasting: Global Energy Forecasting Competition 2014 and beyond," International Journal of Forecasting, Elsevier, vol. 32(3), pages 896-913.
    15. Xiao, Tong & Xu, Peng & He, Ruikai & Sha, Huajing, 2022. "Status quo and opportunities for building energy prediction in limited data Context—Overview from a competition," Applied Energy, Elsevier, vol. 305(C).
    16. Zhang, Shu & Wang, Yi & Zhang, Yutian & Wang, Dan & Zhang, Ning, 2020. "Load probability density forecasting by transforming and combining quantile forecasts," Applied Energy, Elsevier, vol. 277(C).
    17. Orosz, Matthew & Altes-Buch, Queralt & Mueller, Amy & Lemort, Vincent, 2018. "Experimental validation of an electrical and thermal energy demand model for rapid assessment of rural health centers in sub-Saharan Africa," Applied Energy, Elsevier, vol. 218(C), pages 382-390.
    18. Park, Jungyeon & Alvarenga, Estêvão & Jeon, Jooyoung & Li, Ran & Petropoulos, Fotios & Kim, Hokyun & Ahn, Kwangwon, 2024. "Probabilistic forecast-based portfolio optimization of electricity demand at low aggregation levels," Applied Energy, Elsevier, vol. 353(PB).
    19. He Jiang & Weihua Zheng, 2022. "Deep learning with regularized robust long‐ and short‐term memory network for probabilistic short‐term load forecasting," Journal of Forecasting, John Wiley & Sons, Ltd., vol. 41(6), pages 1201-1216, September.
    20. Zhang, Wenjie & Quan, Hao & Srinivasan, Dipti, 2018. "Parallel and reliable probabilistic load forecasting via quantile regression forest and quantile determination," Energy, Elsevier, vol. 160(C), pages 810-819.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:14:y:2021:i:5:p:1481-:d:513031. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.