IDEAS home Printed from https://ideas.repec.org/a/eee/rensus/v130y2020ics136403212030191x.html
   My bibliography  Save this article

Artificial intelligence and machine learning approaches to energy demand-side response: A systematic review

Author

Listed:
  • Antonopoulos, Ioannis
  • Robu, Valentin
  • Couraud, Benoit
  • Kirli, Desen
  • Norbu, Sonam
  • Kiprakis, Aristides
  • Flynn, David
  • Elizondo-Gonzalez, Sergio
  • Wattam, Steve

Abstract

Recent years have seen an increasing interest in Demand Response (DR) as a means to provide flexibility, and hence improve the reliability of energy systems in a cost-effective way. Yet, the high complexity of the tasks associated with DR, combined with their use of large-scale data and the frequent need for near real-time decisions, means that Artificial Intelligence (AI) and Machine Learning (ML) — a branch of AI — have recently emerged as key technologies for enabling demand-side response. AI methods can be used to tackle various challenges, ranging from selecting the optimal set of consumers to respond, learning their attributes and preferences, dynamic pricing, scheduling and control of devices, learning how to incentivise participants in the DR schemes and how to reward them in a fair and economically efficient way. This work provides an overview of AI methods utilised for DR applications, based on a systematic review of over 160 papers, 40 companies and commercial initiatives, and 21 large-scale projects. The papers are classified with regards to both the AI/ML algorithm(s) used and the application area in energy DR. Next, commercial initiatives are presented (including both start-ups and established companies) and large-scale innovation projects, where AI methods have been used for energy DR. The paper concludes with a discussion of advantages and potential limitations of reviewed AI techniques for different DR tasks, and outlines directions for future research in this fast-growing area.

Suggested Citation

  • Antonopoulos, Ioannis & Robu, Valentin & Couraud, Benoit & Kirli, Desen & Norbu, Sonam & Kiprakis, Aristides & Flynn, David & Elizondo-Gonzalez, Sergio & Wattam, Steve, 2020. "Artificial intelligence and machine learning approaches to energy demand-side response: A systematic review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 130(C).
    • Handle: RePEc:eee:rensus:v:130:y:2020:i:c:s136403212030191x
    DOI: 10.1016/j.rser.2020.109899
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S136403212030191X
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.rser.2020.109899?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Alessio R. Lomuscio & Michael Wooldridge & Nicholas R. Jennings, 2003. "A Classification Scheme for Negotiation in Electronic Commerce," Group Decision and Negotiation, Springer, vol. 12(1), pages 31-56, January.
    2. Jordehi, A. Rezaee, 2019. "Optimisation of demand response in electric power systems, a review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 103(C), pages 308-319.
    3. Iria, José & Soares, Filipe & Matos, Manuel, 2019. "Optimal bidding strategy for an aggregator of prosumers in energy and secondary reserve markets," Applied Energy, Elsevier, vol. 238(C), pages 1361-1372.
    4. Dehghanpour, Kaveh & Afsharnia, Saeed, 2015. "Electrical demand side contribution to frequency control in power systems: a review on technical aspects," Renewable and Sustainable Energy Reviews, Elsevier, vol. 41(C), pages 1267-1276.
    5. Yu, Mengmeng & Hong, Seung Ho, 2017. "Incentive-based demand response considering hierarchical electricity market: A Stackelberg game approach," Applied Energy, Elsevier, vol. 203(C), pages 267-279.
    6. Kuriqi, Alban & Pinheiro, António N. & Sordo-Ward, Alvaro & Garrote, Luis, 2019. "Flow regime aspects in determining environmental flows and maximising energy production at run-of-river hydropower plants," Applied Energy, Elsevier, vol. 256(C).
    7. Vázquez-Canteli, José R. & Nagy, Zoltán, 2019. "Reinforcement learning for demand response: A review of algorithms and modeling techniques," Applied Energy, Elsevier, vol. 235(C), pages 1072-1089.
    8. Chen, Yongbao & Xu, Peng & Chu, Yiyi & Li, Weilin & Wu, Yuntao & Ni, Lizhou & Bao, Yi & Wang, Kun, 2017. "Short-term electrical load forecasting using the Support Vector Regression (SVR) model to calculate the demand response baseline for office buildings," Applied Energy, Elsevier, vol. 195(C), pages 659-670.
    9. Lu, Renzhi & Hong, Seung Ho & Zhang, Xiongfeng, 2018. "A Dynamic pricing demand response algorithm for smart grid: Reinforcement learning approach," Applied Energy, Elsevier, vol. 220(C), pages 220-230.
    10. Jason Grant & Moataz Eltoukhy & Shihab Asfour, 2014. "Short-Term Electrical Peak Demand Forecasting in a Large Government Building Using Artificial Neural Networks," Energies, MDPI, vol. 7(4), pages 1-19, March.
    11. Cortés-Arcos, Tomás & Bernal-Agustín, José L. & Dufo-López, Rodolfo & Lujano-Rojas, Juan M. & Contreras, Javier, 2017. "Multi-objective demand response to real-time prices (RTP) using a task scheduling methodology," Energy, Elsevier, vol. 138(C), pages 19-31.
    12. Luo, Zhe & Hong, SeungHo & Ding, YueMin, 2019. "A data mining-driven incentive-based demand response scheme for a virtual power plant," Applied Energy, Elsevier, vol. 239(C), pages 549-559.
    13. Bo Lin & Shuhui Li & Yang Xiao, 2017. "Optimal and Learning-Based Demand Response Mechanism for Electric Water Heater System," Energies, MDPI, vol. 10(11), pages 1-17, October.
    14. Khan, Ahsan Raza & Mahmood, Anzar & Safdar, Awais & Khan, Zafar A. & Khan, Naveed Ahmed, 2016. "Load forecasting, dynamic pricing and DSM in smart grid: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 54(C), pages 1311-1322.
    15. Steven Tadelis, 2009. "Auctions Versus Negotiations in Procurement: An Empirical Analysis," The Journal of Law, Economics, and Organization, Oxford University Press, vol. 25(2), pages 372-399, October.
    16. Zhang, Guoqiang & Eddy Patuwo, B. & Y. Hu, Michael, 1998. "Forecasting with artificial neural networks:: The state of the art," International Journal of Forecasting, Elsevier, vol. 14(1), pages 35-62, March.
    17. Robert Tibshirani & Guenther Walther & Trevor Hastie, 2001. "Estimating the number of clusters in a data set via the gap statistic," Journal of the Royal Statistical Society Series B, Royal Statistical Society, vol. 63(2), pages 411-423.
    18. Fotouhi Ghazvini, Mohammad Ali & Soares, João & Horta, Nuno & Neves, Rui & Castro, Rui & Vale, Zita, 2015. "A multi-objective model for scheduling of short-term incentive-based demand response programs offered by electricity retailers," Applied Energy, Elsevier, vol. 151(C), pages 102-118.
    19. Chris Ogwumike & Michael Short & Fathi Abugchem, 2015. "Heuristic Optimization of Consumer Electricity Costs Using a Generic Cost Model," Energies, MDPI, vol. 9(1), pages 1-21, December.
    20. Tomi Medved & Gašper Artač & Andrej F. Gubina, 2018. "The use of intelligent aggregator agents for advanced control of demand response," Wiley Interdisciplinary Reviews: Energy and Environment, Wiley Blackwell, vol. 7(3), May.
    21. Howell, Shaun & Rezgui, Yacine & Hippolyte, Jean-Laurent & Jayan, Bejay & Li, Haijiang, 2017. "Towards the next generation of smart grids: Semantic and holonic multi-agent management of distributed energy resources," Renewable and Sustainable Energy Reviews, Elsevier, vol. 77(C), pages 193-214.
    22. Andoni, Merlinda & Robu, Valentin & Flynn, David & Abram, Simone & Geach, Dale & Jenkins, David & McCallum, Peter & Peacock, Andrew, 2019. "Blockchain technology in the energy sector: A systematic review of challenges and opportunities," Renewable and Sustainable Energy Reviews, Elsevier, vol. 100(C), pages 143-174.
    23. O׳Connell, Niamh & Pinson, Pierre & Madsen, Henrik & O׳Malley, Mark, 2014. "Benefits and challenges of electrical demand response: A critical review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 39(C), pages 686-699.
    24. Rahman, Aowabin & Srikumar, Vivek & Smith, Amanda D., 2018. "Predicting electricity consumption for commercial and residential buildings using deep recurrent neural networks," Applied Energy, Elsevier, vol. 212(C), pages 372-385.
    25. Raza, Muhammad Qamar & Khosravi, Abbas, 2015. "A review on artificial intelligence based load demand forecasting techniques for smart grid and buildings," Renewable and Sustainable Energy Reviews, Elsevier, vol. 50(C), pages 1352-1372.
    26. Wang, Qi & Zhang, Chunyu & Ding, Yi & Xydis, George & Wang, Jianhui & Østergaard, Jacob, 2015. "Review of real-time electricity markets for integrating Distributed Energy Resources and Demand Response," Applied Energy, Elsevier, vol. 138(C), pages 695-706.
    27. Pamela MacDougall & Bob Ran & George B. Huitema & Geert Deconinck, 2017. "Performance Assessment of Black Box Capacity Forecasting for Multi-Market Trade Application," Energies, MDPI, vol. 10(10), pages 1-19, October.
    28. Javed, Fahad & Arshad, Naveed & Wallin, Fredrik & Vassileva, Iana & Dahlquist, Erik, 2012. "Forecasting for demand response in smart grids: An analysis on use of anthropologic and structural data and short term multiple loads forecasting," Applied Energy, Elsevier, vol. 96(C), pages 150-160.
    29. Ioannis Panapakidis & Nikolaos Asimopoulos & Athanasios Dagoumas & Georgios C. Christoforidis, 2017. "An Improved Fuzzy C-Means Algorithm for the Implementation of Demand Side Management Measures," Energies, MDPI, vol. 10(9), pages 1-42, September.
    30. Lu, Qing & Yu, Hao & Zhao, Kangli & Leng, Yajun & Hou, Jianchao & Xie, Pinjie, 2019. "Residential demand response considering distributed PV consumption: A model based on China's PV policy," Energy, Elsevier, vol. 172(C), pages 443-456.
    31. Luo, Xing & Wang, Jihong & Dooner, Mark & Clarke, Jonathan, 2015. "Overview of current development in electrical energy storage technologies and the application potential in power system operation," Applied Energy, Elsevier, vol. 137(C), pages 511-536.
    32. Lu, Renzhi & Hong, Seung Ho, 2019. "Incentive-based demand response for smart grid with reinforcement learning and deep neural network," Applied Energy, Elsevier, vol. 236(C), pages 937-949.
    33. David Silver & Julian Schrittwieser & Karen Simonyan & Ioannis Antonoglou & Aja Huang & Arthur Guez & Thomas Hubert & Lucas Baker & Matthew Lai & Adrian Bolton & Yutian Chen & Timothy Lillicrap & Fan , 2017. "Mastering the game of Go without human knowledge," Nature, Nature, vol. 550(7676), pages 354-359, October.
    34. Behl, Madhur & Smarra, Francesco & Mangharam, Rahul, 2016. "DR-Advisor: A data-driven demand response recommender system," Applied Energy, Elsevier, vol. 170(C), pages 30-46.
    35. Christian Giovanelli & Seppo Sierla & Ryutaro Ichise & Valeriy Vyatkin, 2018. "Exploiting Artificial Neural Networks for the Prediction of Ancillary Energy Market Prices," Energies, MDPI, vol. 11(7), pages 1-22, July.
    36. Volodymyr Mnih & Koray Kavukcuoglu & David Silver & Andrei A. Rusu & Joel Veness & Marc G. Bellemare & Alex Graves & Martin Riedmiller & Andreas K. Fidjeland & Georg Ostrovski & Stig Petersen & Charle, 2015. "Human-level control through deep reinforcement learning," Nature, Nature, vol. 518(7540), pages 529-533, February.
    37. Valentin Robu & Meritxell Vinyals & Alex Rogers & Nicholas B. Jennings, 2018. "Efficient Buyer Groups With Prediction-of-Use Electricity Tariffs," Post-Print cea-01917811, HAL.
    38. Cherrelle Eid & Paul Codani & Yannick Perez & Javier Reneses & Rudi Hakvoort, 2016. "Managing electric flexibility from Distributed Energy Resources: A review of incentives for market design," Post-Print hal-01792419, HAL.
    39. Haider, Haider Tarish & See, Ong Hang & Elmenreich, Wilfried, 2016. "A review of residential demand response of smart grid," Renewable and Sustainable Energy Reviews, Elsevier, vol. 59(C), pages 166-178.
    40. Xiong, Yingqi & Wang, Bin & Chu, Chi-cheng & Gadh, Rajit, 2018. "Vehicle grid integration for demand response with mixture user model and decentralized optimization," Applied Energy, Elsevier, vol. 231(C), pages 481-493.
    41. Kim, Jin-Ho & Shcherbakova, Anastasia, 2011. "Common failures of demand response," Energy, Elsevier, vol. 36(2), pages 873-880.
    42. Eid, Cherrelle & Codani, Paul & Perez, Yannick & Reneses, Javier & Hakvoort, Rudi, 2016. "Managing electric flexibility from Distributed Energy Resources: A review of incentives for market design," Renewable and Sustainable Energy Reviews, Elsevier, vol. 64(C), pages 237-247.
    43. Dusparic, Ivana & Taylor, Adam & Marinescu, Andrei & Golpayegani, Fatemeh & Clarke, Siobhan, 2017. "Residential demand response: Experimental evaluation and comparison of self-organizing techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 80(C), pages 1528-1536.
    44. Wang, Jianxiao & Zhong, Haiwang & Ma, Ziming & Xia, Qing & Kang, Chongqing, 2017. "Review and prospect of integrated demand response in the multi-energy system," Applied Energy, Elsevier, vol. 202(C), pages 772-782.
    45. Saehong Park & Seunghyoung Ryu & Yohwan Choi & Jihyo Kim & Hongseok Kim, 2015. "Data-Driven Baseline Estimation of Residential Buildings for Demand Response," Energies, MDPI, vol. 8(9), pages 1-21, September.
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Tsaousoglou, Georgios & Giraldo, Juan S. & Paterakis, Nikolaos G., 2022. "Market Mechanisms for Local Electricity Markets: A review of models, solution concepts and algorithmic techniques," Renewable and Sustainable Energy Reviews, Elsevier, vol. 156(C).
    2. Ibrahim, Muhammad Sohail & Dong, Wei & Yang, Qiang, 2020. "Machine learning driven smart electric power systems: Current trends and new perspectives," Applied Energy, Elsevier, vol. 272(C).
    3. Ottavia Valentini & Nikoleta Andreadou & Paolo Bertoldi & Alexandre Lucas & Iolanda Saviuc & Evangelos Kotsakis, 2022. "Demand Response Impact Evaluation: A Review of Methods for Estimating the Customer Baseline Load," Energies, MDPI, vol. 15(14), pages 1-36, July.
    4. Liu, Zhengguang & Guo, Zhiling & Chen, Qi & Song, Chenchen & Shang, Wenlong & Yuan, Meng & Zhang, Haoran, 2023. "A review of data-driven smart building-integrated photovoltaic systems: Challenges and objectives," Energy, Elsevier, vol. 263(PE).
    5. Wen, Lulu & Zhou, Kaile & Li, Jun & Wang, Shanyong, 2020. "Modified deep learning and reinforcement learning for an incentive-based demand response model," Energy, Elsevier, vol. 205(C).
    6. Zeng, Huibin & Shao, Bilin & Dai, Hongbin & Tian, Ning & Zhao, Wei, 2023. "Incentive-based demand response strategies for natural gas considering carbon emissions and load volatility," Applied Energy, Elsevier, vol. 348(C).
    7. Okur, Özge & Heijnen, Petra & Lukszo, Zofia, 2021. "Aggregator’s business models in residential and service sectors: A review of operational and financial aspects," Renewable and Sustainable Energy Reviews, Elsevier, vol. 139(C).
    8. Charbonnier, Flora & Morstyn, Thomas & McCulloch, Malcolm D., 2022. "Coordination of resources at the edge of the electricity grid: Systematic review and taxonomy," Applied Energy, Elsevier, vol. 318(C).
    9. Perera, A.T.D. & Kamalaruban, Parameswaran, 2021. "Applications of reinforcement learning in energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 137(C).
    10. Lu, Renzhi & Li, Yi-Chang & Li, Yuting & Jiang, Junhui & Ding, Yuemin, 2020. "Multi-agent deep reinforcement learning based demand response for discrete manufacturing systems energy management," Applied Energy, Elsevier, vol. 276(C).
    11. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    12. Boza, Pal & Evgeniou, Theodoros, 2021. "Artificial intelligence to support the integration of variable renewable energy sources to the power system," Applied Energy, Elsevier, vol. 290(C).
    13. Kong, Xiangyu & Kong, Deqian & Yao, Jingtao & Bai, Linquan & Xiao, Jie, 2020. "Online pricing of demand response based on long short-term memory and reinforcement learning," Applied Energy, Elsevier, vol. 271(C).
    14. Lu, Renzhi & Hong, Seung Ho, 2019. "Incentive-based demand response for smart grid with reinforcement learning and deep neural network," Applied Energy, Elsevier, vol. 236(C), pages 937-949.
    15. Barja-Martinez, Sara & Aragüés-Peñalba, Mònica & Munné-Collado, Íngrid & Lloret-Gallego, Pau & Bullich-Massagué, Eduard & Villafafila-Robles, Roberto, 2021. "Artificial intelligence techniques for enabling Big Data services in distribution networks: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 150(C).
    16. Xu, Fangyuan & Zhu, Weidong & Wang, Yi Fei & Lai, Chun Sing & Yuan, Haoliang & Zhao, Yujia & Guo, Siming & Fu, Zhengxin, 2022. "A new deregulated demand response scheme for load over-shifting city in regulated power market," Applied Energy, Elsevier, vol. 311(C).
    17. Freitas Gomes, Icaro Silvestre & Perez, Yannick & Suomalainen, Emilia, 2020. "Coupling small batteries and PV generation: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 126(C).
    18. Cai, Qiran & Xu, Qingyang & Qing, Jing & Shi, Gang & Liang, Qiao-Mei, 2022. "Promoting wind and photovoltaics renewable energy integration through demand response: Dynamic pricing mechanism design and economic analysis for smart residential communities," Energy, Elsevier, vol. 261(PB).
    19. Park, Keonwoo & Moon, Ilkyeong, 2022. "Multi-agent deep reinforcement learning approach for EV charging scheduling in a smart grid," Applied Energy, Elsevier, vol. 328(C).
    20. Ma, Siyu & Liu, Hui & Wang, Ni & Huang, Lidong & Goh, Hui Hwang, 2023. "Incentive-based demand response under incomplete information based on the deep deterministic policy gradient," Applied Energy, Elsevier, vol. 351(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:rensus:v:130:y:2020:i:c:s136403212030191x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/600126/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.