IDEAS home Printed from https://ideas.repec.org/a/gam/jeners/v16y2023i5p2456-d1087725.html
   My bibliography  Save this article

Applications of Agent-Based Methods in Multi-Energy Systems—A Systematic Literature Review

Author

Listed:
  • Ruiqiu Yao

    (Department of Civil, Environmental & Geomatic Engineering, University College London, London WC1E 6BT, UK)

  • Yukun Hu

    (Department of Civil, Environmental & Geomatic Engineering, University College London, London WC1E 6BT, UK)

  • Liz Varga

    (Department of Civil, Environmental & Geomatic Engineering, University College London, London WC1E 6BT, UK)

Abstract

The need for a greener and more sustainable energy system evokes a need for more extensive energy system transition research. The penetration of distributed energy resources and Internet of Things technologies facilitate energy system transition towards the next generation of energy system concepts. The next generation of energy system concepts include “integrated energy system”, “multi-energy system”, or “smart energy system”. These concepts reveal that future energy systems can integrate multiple energy carriers with autonomous intelligent decision making. There are noticeable trends in using the agent-based method in research of energy systems, including multi-energy system transition simulation with agent-based modeling (ABM) and multi-energy system management with multi-agent system (MAS) modeling. The need for a comprehensive review of the applications of the agent-based method motivates this review article. Thus, this article aims to systematically review the ABM and MAS applications in multi-energy systems with publications from 2007 to the end of 2021. The articles were sorted into MAS and ABM applications based on the details of agent implementations. MAS application papers in building energy systems, district energy systems, and regional energy systems are reviewed with regard to energy carriers, agent control architecture, optimization algorithms, and agent development environments. ABM application papers in behavior simulation and policy-making are reviewed with regard to the agent decision-making details and model objectives. In addition, the potential future research directions in reinforcement learning implementation and agent control synchronization are highlighted. The review shows that the agent-based method has great potential to contribute to energy transition studies with its plug-and-play ability and distributed decision-making process.

Suggested Citation

  • Ruiqiu Yao & Yukun Hu & Liz Varga, 2023. "Applications of Agent-Based Methods in Multi-Energy Systems—A Systematic Literature Review," Energies, MDPI, vol. 16(5), pages 1-36, March.
    • Handle: RePEc:gam:jeners:v:16:y:2023:i:5:p:2456-:d:1087725
    as

    Download full text from publisher

    File URL: https://www.mdpi.com/1996-1073/16/5/2456/pdf
    Download Restriction: no
    File URL: https://www.mdpi.com/1996-1073/16/5/2456/
    Download Restriction: no
    ---><---

    References listed on IDEAS

    as
    1. Jackson, Jerry, 2007. "Are US utility standby rates inhibiting diffusion of customer-owned generating systems?," Energy Policy, Elsevier, vol. 35(3), pages 1896-1908, March.
    2. Deb, Chirag & Zhang, Fan & Yang, Junjing & Lee, Siew Eang & Shah, Kwok Wei, 2017. "A review on time series forecasting techniques for building energy consumption," Renewable and Sustainable Energy Reviews, Elsevier, vol. 74(C), pages 902-924.
    3. Nils Loose & Christian Thommessen & Jan Mehlich & Christian Derksen & Stefan Eicker, 2020. "Unified Energy Agents for Combined District Heating and Electrical Network Simulation," Sustainability, MDPI, vol. 12(21), pages 1-15, November.
    4. Mancarella, Pierluigi, 2014. "MES (multi-energy systems): An overview of concepts and evaluation models," Energy, Elsevier, vol. 65(C), pages 1-17.
    5. Mohamed, Mohamed A. & Jin, Tao & Su, Wencong, 2020. "Multi-agent energy management of smart islands using primal-dual method of multipliers," Energy, Elsevier, vol. 208(C).
    6. Daniel Then & Patrick Hein & Tanja M. Kneiske & Martin Braun, 2020. "Analysis of Dependencies between Gas and Electricity Distribution Grid Planning and Building Energy Retrofit Decisions," Sustainability, MDPI, vol. 12(13), pages 1-42, July.
    7. Lin, Haiyang & Liu, Yiling & Sun, Qie & Xiong, Rui & Li, Hailong & Wennersten, Ronald, 2018. "The impact of electric vehicle penetration and charging patterns on the management of energy hub – A multi-agent system simulation," Applied Energy, Elsevier, vol. 230(C), pages 189-206.
    8. Vázquez-Canteli, José R. & Nagy, Zoltán, 2019. "Reinforcement learning for demand response: A review of algorithms and modeling techniques," Applied Energy, Elsevier, vol. 235(C), pages 1072-1089.
    9. Wang, Chengshan & Lv, Chaoxian & Li, Peng & Song, Guanyu & Li, Shuquan & Xu, Xiandong & Wu, Jianzhong, 2018. "Modeling and optimal operation of community integrated energy systems: A case study from China," Applied Energy, Elsevier, vol. 230(C), pages 1242-1254.
    10. Eguaras-Martínez, María & Vidaurre-Arbizu, Marina & Martín-Gómez, César, 2014. "Simulation and evaluation of Building Information Modeling in a real pilot site," Applied Energy, Elsevier, vol. 114(C), pages 475-484.
    11. Xiang, Yue & Cai, Hanhu & Gu, Chenghong & Shen, Xiaodong, 2020. "Cost-benefit analysis of integrated energy system planning considering demand response," Energy, Elsevier, vol. 192(C).
    12. Kou, Yu & Bie, Zhaohong & Li, Gengfeng & Liu, Fan & Jiang, Jiangfeng, 2021. "Reliability evaluation of multi-agent integrated energy systems with fully distributed communication," Energy, Elsevier, vol. 224(C).
    13. Christos-Spyridon Karavas & Konstantinos Arvanitis & George Papadakis, 2017. "A Game Theory Approach to Multi-Agent Decentralized Energy Management of Autonomous Polygeneration Microgrids," Energies, MDPI, vol. 10(11), pages 1-22, November.
    14. Chang, Miguel & Thellufsen, Jakob Zink & Zakeri, Behnam & Pickering, Bryn & Pfenninger, Stefan & Lund, Henrik & Østergaard, Poul Alberg, 2021. "Trends in tools and approaches for modelling the energy transition," Applied Energy, Elsevier, vol. 290(C).
    15. Nikmehr, Nima & Najafi-Ravadanegh, Sajad & Khodaei, Amin, 2017. "Probabilistic optimal scheduling of networked microgrids considering time-based demand response programs under uncertainty," Applied Energy, Elsevier, vol. 198(C), pages 267-279.
    16. Vanhoudt, D. & Geysen, D. & Claessens, B. & Leemans, F. & Jespers, L. & Van Bael, J., 2014. "An actively controlled residential heat pump: Potential on peak shaving and maximization of self-consumption of renewable energy," Renewable Energy, Elsevier, vol. 63(C), pages 531-543.
    17. Chakrabarti, Auyon & Proeglhoef, Rafael & Turu, Gonzalo Bustos & Lambert, Romain & Mariaud, Arthur & Acha, Salvador & Markides, Christos N. & Shah, Nilay, 2019. "Optimisation and analysis of system integration between electric vehicles and UK decentralised energy schemes," Energy, Elsevier, vol. 176(C), pages 805-815.
    18. Jisong Zhu & Zhaoxia Jing & Tianyao Ji & Nauman Ali Larik, 2020. "Energy–Economy Coupled Simulation Approach and Simulator Based on Invididual-Based Model," Energies, MDPI, vol. 13(11), pages 1-18, June.
    19. Babatunde, Kazeem Alasinrin & Begum, Rawshan Ara & Said, Fathin Faizah, 2017. "Application of computable general equilibrium (CGE) to climate change mitigation policy: A systematic review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 78(C), pages 61-71.
    20. Ringler, Philipp & Keles, Dogan & Fichtner, Wolf, 2016. "Agent-based modelling and simulation of smart electricity grids and markets – A literature review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 57(C), pages 205-215.
    21. Li, Gengfeng & Bie, Zhaohong & Kou, Yu & Jiang, Jiangfeng & Bettinelli, Mattia, 2016. "Reliability evaluation of integrated energy systems based on smart agent communication," Applied Energy, Elsevier, vol. 167(C), pages 397-406.
    22. Anvari-Moghaddam, Amjad & Rahimi-Kian, Ashkan & Mirian, Maryam S. & Guerrero, Josep M., 2017. "A multi-agent based energy management solution for integrated buildings and microgrid system," Applied Energy, Elsevier, vol. 203(C), pages 41-56.
    23. Edmunds, Calum & Galloway, Stuart & Dixon, James & Bukhsh, Waqquas & Elders, Ian, 2021. "Hosting capacity assessment of heat pumps and optimised electric vehicle charging on low voltage networks," Applied Energy, Elsevier, vol. 298(C).
    24. Zheng Ma & Mette Jessen Schultz & Kristoffer Christensen & Magnus Værbak & Yves Demazeau & Bo Nørregaard Jørgensen, 2019. "The Application of Ontologies in Multi-Agent Systems in the Energy Sector: A Scoping Review," Energies, MDPI, vol. 12(16), pages 1-31, August.
    25. Christian Schnuelle & Kasper Kisjes & Torben Stuehrmann & Pablo Thier & Igor Nikolic & Arnim von Gleich & Stefan Goessling-Reisemann, 2020. "From Niche to Market—An Agent-Based Modeling Approach for the Economic Uptake of Electro-Fuels (Power-to-Fuel) in the German Energy System," Energies, MDPI, vol. 13(20), pages 1-24, October.
    26. Lund, Henrik & Andersen, Anders N. & Østergaard, Poul Alberg & Mathiesen, Brian Vad & Connolly, David, 2012. "From electricity smart grids to smart energy systems – A market operation based approach and understanding," Energy, Elsevier, vol. 42(1), pages 96-102.
    27. Faber, Albert & Valente, Marco & Janssen, Peter, 2010. "Exploring domestic micro-cogeneration in the Netherlands: An agent-based demand model for technology diffusion," Energy Policy, Elsevier, vol. 38(6), pages 2763-2775, June.
    28. Lund, Henrik & Østergaard, Poul Alberg & Connolly, David & Mathiesen, Brian Vad, 2017. "Smart energy and smart energy systems," Energy, Elsevier, vol. 137(C), pages 556-565.
    29. Wang, Haiyang & Zhang, Chenghui & Li, Ke & Ma, Xin, 2021. "Game theory-based multi-agent capacity optimization for integrated energy systems with compressed air energy storage," Energy, Elsevier, vol. 221(C).
    30. Coelho, Vitor N. & Weiss Cohen, Miri & Coelho, Igor M. & Liu, Nian & Guimarães, Frederico Gadelha, 2017. "Multi-agent systems applied for energy systems integration: State-of-the-art applications and trends in microgrids," Applied Energy, Elsevier, vol. 187(C), pages 820-832.
    31. Bünning, Felix & Wetter, Michael & Fuchs, Marcus & Müller, Dirk, 2018. "Bidirectional low temperature district energy systems with agent-based control: Performance comparison and operation optimization," Applied Energy, Elsevier, vol. 209(C), pages 502-515.
    32. Kyriakarakos, George & Piromalis, Dimitrios D. & Dounis, Anastasios I. & Arvanitis, Konstantinos G. & Papadakis, George, 2013. "Intelligent demand side energy management system for autonomous polygeneration microgrids," Applied Energy, Elsevier, vol. 103(C), pages 39-51.
    33. Behboodi, Sahand & Chassin, David P. & Djilali, Ned & Crawford, Curran, 2018. "Transactive control of fast-acting demand response based on thermostatic loads in real-time retail electricity markets," Applied Energy, Elsevier, vol. 210(C), pages 1310-1320.
    34. Chengyu Zeng & Yuechun Jiang & Yuqing Liu & Zuoyun Tan & Zhongnan He & Shuhong Wu, 2019. "Optimal Dispatch of Integrated Energy System Considering Energy Hub Technology and Multi-Agent Interest Balance," Energies, MDPI, vol. 12(16), pages 1-17, August.
    35. Walzberg, Julien & Dandres, Thomas & Merveille, Nicolas & Cheriet, Mohamed & Samson, Réjean, 2020. "Should we fear the rebound effect in smart homes?," Renewable and Sustainable Energy Reviews, Elsevier, vol. 125(C).
    36. Skarvelis-Kazakos, Spyros & Papadopoulos, Panagiotis & Grau Unda, Iñaki & Gorman, Terry & Belaidi, Abdelhafid & Zigan, Stefan, 2016. "Multiple energy carrier optimisation with intelligent agents," Applied Energy, Elsevier, vol. 167(C), pages 323-335.
    37. Sorda, G. & Sunak, Y. & Madlener, R., 2013. "An agent-based spatial simulation to evaluate the promotion of electricity from agricultural biogas plants in Germany," Ecological Economics, Elsevier, vol. 89(C), pages 43-60.
    38. Ishaq, H. & Dincer, I., 2019. "Exergy analysis and performance evaluation of a newly developed integrated energy system for quenchable generation," Energy, Elsevier, vol. 179(C), pages 1191-1204.
    39. Mischa Ahrens & Fabian Kern & Hartmut Schmeck, 2021. "Strategies for an Adaptive Control System to Improve Power Grid Resilience with Smart Buildings," Energies, MDPI, vol. 14(15), pages 1-29, July.
    40. Guelpa, Elisa & Bischi, Aldo & Verda, Vittorio & Chertkov, Michael & Lund, Henrik, 2019. "Towards future infrastructures for sustainable multi-energy systems: A review," Energy, Elsevier, vol. 184(C), pages 2-21.
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Yang, Chengying & Wu, Zhixin & Li, Xuetao & Fars, Ashk, 2024. "Risk-constrained stochastic scheduling for energy hub: Integrating renewables, demand response, and electric vehicles," Energy, Elsevier, vol. 288(C).
    2. Fatih Soygazi, 2023. "Multi-Agent Systems and Machine Learning for Wind Turbine Power Prediction from an Educational Perspective," Sustainability, MDPI, vol. 15(23), pages 1-19, November.

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Lin, Haiyang & Liu, Yiling & Sun, Qie & Xiong, Rui & Li, Hailong & Wennersten, Ronald, 2018. "The impact of electric vehicle penetration and charging patterns on the management of energy hub – A multi-agent system simulation," Applied Energy, Elsevier, vol. 230(C), pages 189-206.
    2. Østergaard, P.A. & Lund, H. & Thellufsen, J.Z. & Sorknæs, P. & Mathiesen, B.V., 2022. "Review and validation of EnergyPLAN," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    3. Lasemi, Mohammad Ali & Arabkoohsar, Ahmad & Hajizadeh, Amin & Mohammadi-ivatloo, Behnam, 2022. "A comprehensive review on optimization challenges of smart energy hubs under uncertainty factors," Renewable and Sustainable Energy Reviews, Elsevier, vol. 160(C).
    4. Kofinas, P. & Dounis, A.I. & Vouros, G.A., 2018. "Fuzzy Q-Learning for multi-agent decentralized energy management in microgrids," Applied Energy, Elsevier, vol. 219(C), pages 53-67.
    5. Lund, Henrik & Thellufsen, Jakob Zinck & Sorknæs, Peter & Mathiesen, Brian Vad & Chang, Miguel & Madsen, Poul Thøis & Kany, Mikkel Strunge & Skov, Iva Ridjan, 2022. "Smart energy Denmark. A consistent and detailed strategy for a fully decarbonized society," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    6. Guo, Yurun & Wang, Shugang & Wang, Jihong & Zhang, Tengfei & Ma, Zhenjun & Jiang, Shuang, 2024. "Key district heating technologies for building energy flexibility: A review," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    7. Ahmadi, Seyed Ehsan & Sadeghi, Delnia & Marzband, Mousa & Abusorrah, Abdullah & Sedraoui, Khaled, 2022. "Decentralized bi-level stochastic optimization approach for multi-agent multi-energy networked micro-grids with multi-energy storage technologies," Energy, Elsevier, vol. 245(C).
    8. David Drysdale & Brian Vad Mathiesen & Henrik Lund, 2019. "From Carbon Calculators to Energy System Analysis in Cities," Energies, MDPI, vol. 12(12), pages 1-21, June.
    9. Wirtz, Marco, 2023. "nPro: A web-based planning tool for designing district energy systems and thermal networks," Energy, Elsevier, vol. 268(C).
    10. Fridgen, Gilbert & Keller, Robert & Körner, Marc-Fabian & Schöpf, Michael, 2020. "A holistic view on sector coupling," Energy Policy, Elsevier, vol. 147(C).
    11. Jolando M. Kisse & Martin Braun & Simon Letzgus & Tanja M. Kneiske, 2020. "A GIS-Based Planning Approach for Urban Power and Natural Gas Distribution Grids with Different Heat Pump Scenarios," Energies, MDPI, vol. 13(16), pages 1-31, August.
    12. Jasmine Ramsebner & Reinhard Haas & Amela Ajanovic & Martin Wietschel, 2021. "The sector coupling concept: A critical review," Wiley Interdisciplinary Reviews: Energy and Environment, Wiley Blackwell, vol. 10(4), July.
    13. Saletti, Costanza & Morini, Mirko & Gambarotta, Agostino, 2022. "Smart management of integrated energy systems through co-optimization with long and short horizons," Energy, Elsevier, vol. 250(C).
    14. Wang, Jiawei & You, Shi & Zong, Yi & Træholt, Chresten & Dong, Zhao Yang & Zhou, You, 2019. "Flexibility of combined heat and power plants: A review of technologies and operation strategies," Applied Energy, Elsevier, vol. 252(C), pages 1-1.
    15. Bartolini, Andrea & Mazzoni, Stefano & Comodi, Gabriele & Romagnoli, Alessandro, 2021. "Impact of carbon pricing on distributed energy systems planning," Applied Energy, Elsevier, vol. 301(C).
    16. Miriam Benedetti & Francesca Bonfà & Vito Introna & Annalisa Santolamazza & Stefano Ubertini, 2019. "Real Time Energy Performance Control for Industrial Compressed Air Systems: Methodology and Applications," Energies, MDPI, vol. 12(20), pages 1-28, October.
    17. Zheng, Zhuang & Shafique, Muhammad & Luo, Xiaowei & Wang, Shengwei, 2024. "A systematic review towards integrative energy management of smart grids and urban energy systems," Renewable and Sustainable Energy Reviews, Elsevier, vol. 189(PB).
    18. Guelpa, Elisa & Verda, Vittorio, 2021. "Demand response and other demand side management techniques for district heating: A review," Energy, Elsevier, vol. 219(C).
    19. Trinadh Pamulapati & Muhammed Cavus & Ishioma Odigwe & Adib Allahham & Sara Walker & Damian Giaouris, 2022. "A Review of Microgrid Energy Management Strategies from the Energy Trilemma Perspective," Energies, MDPI, vol. 16(1), pages 1-34, December.
    20. Leitner, Benedikt & Widl, Edmund & Gawlik, Wolfgang & Hofmann, René, 2020. "Control assessment in coupled local district heating and electrical distribution grids: Model predictive control of electric booster heaters," Energy, Elsevier, vol. 210(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:gam:jeners:v:16:y:2023:i:5:p:2456-:d:1087725. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: MDPI Indexing Manager (email available below). General contact details of provider: https://www.mdpi.com .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.