IDEAS home Printed from https://ideas.repec.org/a/eee/energy/v309y2024ics036054422402841x.html
   My bibliography  Save this article

Assessment of the broader applicability of a smart agent in peer-to-peer energy trading: A full factorial analysis of a multi-agent reinforcement learning solution

Author

Listed:
  • May, Ross
  • Carling, Kenneth
  • Huang, Pei

Abstract

To realise the clean energy transition, peer-to-peer (P2P) renewable energy sharing markets have been proposed as one possible solution for achieving such a goal and are recognised as a potential path to achieving other goals such as affordable and reliable energy. Existing studies have shown that coordination at the micro level can be achieved by employing such P2P market structures. A pressing question concerns how to set the trade price such that the community coordinates in a way that maximises social welfare. A solution to this question based on multi-agent reinforcement learning (MARL) has been provided as a proof-of-concept in a single environment. However, various factors such as climate and community scale have been shown to affect the collective performance in such energy-sharing communities. In this work, to test the wider applicability of the proposed solution, a full factorial experiment based on the factors of climate, community scale, and price mechanism, is conducted to ascertain the response of the community w.r.t. the outputs: community self-sufficiency, total net-loss, and income equality. In short, we find that a community stands an odds of 2 to 1 in higher savings by adopting a smart agent.

Suggested Citation

  • May, Ross & Carling, Kenneth & Huang, Pei, 2024. "Assessment of the broader applicability of a smart agent in peer-to-peer energy trading: A full factorial analysis of a multi-agent reinforcement learning solution," Energy, Elsevier, vol. 309(C).
  • Handle: RePEc:eee:energy:v:309:y:2024:i:c:s036054422402841x
    DOI: 10.1016/j.energy.2024.133066
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S036054422402841X
    Download Restriction: Full text for ScienceDirect subscribers only

    File URL: https://libkey.io/10.1016/j.energy.2024.133066?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. May, Ross & Huang, Pei, 2023. "A multi-agent reinforcement learning approach for investigating and optimising peer-to-peer prosumer energy markets," Applied Energy, Elsevier, vol. 334(C).
    2. Labandeira, Xavier & Labeaga, José M. & López-Otero, Xiral, 2017. "A meta-analysis on the price elasticity of energy demand," Energy Policy, Elsevier, vol. 102(C), pages 549-568.
    3. Rodrigo Verschae & Takekazu Kato & Takashi Matsuyama, 2016. "Energy Management in Prosumer Communities: A Coordinated Approach," Energies, MDPI, vol. 9(7), pages 1-27, July.
    4. Huang, Pei & Sun, Yongjun, 2019. "A clustering based grouping method of nearly zero energy buildings for performance improvements," Applied Energy, Elsevier, vol. 235(C), pages 43-55.
    5. Hu, Maomao & Xiao, Fu & Wang, Shengwei, 2021. "Neighborhood-level coordination and negotiation techniques for managing demand-side flexibility in residential microgrids," Renewable and Sustainable Energy Reviews, Elsevier, vol. 135(C).
    6. Zheng, Siqian & Jin, Xin & Huang, Gongsheng & Lai, Alvin CK., 2022. "Coordination of commercial prosumers with distributed demand-side flexibility in energy sharing and management system," Energy, Elsevier, vol. 248(C).
    7. Alejandro Pena-Bello & David Parra & Mario Herberz & Verena Tiefenbeck & Martin K. Patel & Ulf J. J. Hahnel, 2022. "Integration of prosumer peer-to-peer trading decisions into energy community modelling," Nature Energy, Nature, vol. 7(1), pages 74-82, January.
    8. Zhang, Chenghua & Wu, Jianzhong & Zhou, Yue & Cheng, Meng & Long, Chao, 2018. "Peer-to-Peer energy trading in a Microgrid," Applied Energy, Elsevier, vol. 220(C), pages 1-12.
    9. Stephan Zheng & Alexander Trott & Sunil Srinivasa & Nikhil Naik & Melvin Gruesbeck & David C. Parkes & Richard Socher, 2020. "The AI Economist: Improving Equality and Productivity with AI-Driven Tax Policies," Papers 2004.13332, arXiv.org.
    10. Huang, Pei & Han, Mengjie & Zhang, Xingxing & Hussain, Syed Asad & Jayprakash Bhagat, Rohit & Hogarehalli Kumar, Deepu, 2022. "Characterization and optimization of energy sharing performances in energy-sharing communities in Sweden, Canada and Germany," Applied Energy, Elsevier, vol. 326(C).
    11. Charbonnier, Flora & Morstyn, Thomas & McCulloch, Malcolm D., 2022. "Coordination of resources at the edge of the electricity grid: Systematic review and taxonomy," Applied Energy, Elsevier, vol. 318(C).
    12. Li, Xianshan & Lu, Mingfang & Li, Fei & Xiong, Wei & Li, Zhenxing, 2022. "Prosumer energy-storage trading feasibility evaluation and price bundling," Energy, Elsevier, vol. 239(PB).
    13. Jing, Rui & Xie, Mei Na & Wang, Feng Xiang & Chen, Long Xiang, 2020. "Fair P2P energy trading between residential and commercial multi-energy systems enabling integrated demand-side management," Applied Energy, Elsevier, vol. 262(C).
    Full references (including those not matched with items on IDEAS)

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. May, Ross & Huang, Pei, 2023. "A multi-agent reinforcement learning approach for investigating and optimising peer-to-peer prosumer energy markets," Applied Energy, Elsevier, vol. 334(C).
    2. Wang, Juan & Zheng, Junjun & Yu, Liukai & Goh, Mark & Tang, Yunying & Huang, Yongchao, 2023. "Distributed Reputation-Distance iterative auction system for Peer-To-Peer power trading," Applied Energy, Elsevier, vol. 345(C).
    3. Jing, Rui & Hua, Weiqi & Lin, Jian & Lin, Jianyi & Zhao, Yingru & Zhou, Yue & Wu, Jianzhong, 2022. "Cost-efficient decarbonization of local energy systems by whole-system based design optimization," Applied Energy, Elsevier, vol. 326(C).
    4. Zhaonian Ye & Yongzhen Wang & Kai Han & Changlu Zhao & Juntao Han & Yilin Zhu, 2023. "Bi-Objective Optimization and Emergy Analysis of Multi-Distributed Energy System Considering Shared Energy Storage," Sustainability, MDPI, vol. 15(2), pages 1-23, January.
    5. Vinyals, Meritxell, 2021. "Scalable multi-agent local energy trading — Meeting regulatory compliance and validation in the Cardiff grid," Applied Energy, Elsevier, vol. 298(C).
    6. Soto, Esteban A. & Bosman, Lisa B. & Wollega, Ebisa & Leon-Salas, Walter D., 2021. "Peer-to-peer energy trading: A review of the literature," Applied Energy, Elsevier, vol. 283(C).
    7. Capper, Timothy & Gorbatcheva, Anna & Mustafa, Mustafa A. & Bahloul, Mohamed & Schwidtal, Jan Marc & Chitchyan, Ruzanna & Andoni, Merlinda & Robu, Valentin & Montakhabi, Mehdi & Scott, Ian J. & Franci, 2022. "Peer-to-peer, community self-consumption, and transactive energy: A systematic literature review of local energy market models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 162(C).
    8. Wu, Haochi & Qiu, Dawei & Zhang, Liyu & Sun, Mingyang, 2024. "Adaptive multi-agent reinforcement learning for flexible resource management in a virtual power plant with dynamic participating multi-energy buildings," Applied Energy, Elsevier, vol. 374(C).
    9. Xia, Yuanxing & Xu, Qingshan & Li, Fangxing, 2023. "Grid-friendly pricing mechanism for peer-to-peer energy sharing market diffusion in communities," Applied Energy, Elsevier, vol. 334(C).
    10. Nizami, Sohrab & Tushar, Wayes & Hossain, M.J. & Yuen, Chau & Saha, Tapan & Poor, H. Vincent, 2022. "Transactive energy for low voltage residential networks: A review," Applied Energy, Elsevier, vol. 323(C).
    11. Schwidtal, J.M. & Piccini, P. & Troncia, M. & Chitchyan, R. & Montakhabi, M. & Francis, C. & Gorbatcheva, A. & Capper, T. & Mustafa, M.A. & Andoni, M. & Robu, V. & Bahloul, M. & Scott, I.J. & Mbavarir, 2023. "Emerging business models in local energy markets: A systematic review of peer-to-peer, community self-consumption, and transactive energy models," Renewable and Sustainable Energy Reviews, Elsevier, vol. 179(C).
    12. Faia, Ricardo & Lezama, Fernando & Soares, João & Pinto, Tiago & Vale, Zita, 2024. "Local electricity markets: A review on benefits, barriers, current trends and future perspectives," Renewable and Sustainable Energy Reviews, Elsevier, vol. 190(PA).
    13. Kanakadhurga, Dharmaraj & Prabaharan, Natarajan, 2022. "Peer-to-Peer trading with Demand Response using proposed smart bidding strategy," Applied Energy, Elsevier, vol. 327(C).
    14. Gjorgievski, Vladimir Z. & Cundeva, Snezana & Markovska, Natasa & Georghiou, George E., 2022. "Virtual net-billing: A fair energy sharing method for collective self-consumption," Energy, Elsevier, vol. 254(PB).
    15. Zheng, Siqian & Jin, Xin & Huang, Gongsheng & Lai, Alvin CK., 2022. "Coordination of commercial prosumers with distributed demand-side flexibility in energy sharing and management system," Energy, Elsevier, vol. 248(C).
    16. Meritxell Domènech Monfort & César De Jesús & Natapon Wanapinit & Niklas Hartmann, 2022. "A Review of Peer-to-Peer Energy Trading with Standard Terminology Proposal and a Techno-Economic Characterisation Matrix," Energies, MDPI, vol. 15(23), pages 1-29, November.
    17. Arnob Das & Susmita Datta Peu & Md. Abdul Mannan Akanda & Abu Reza Md. Towfiqul Islam, 2023. "Peer-to-Peer Energy Trading Pricing Mechanisms: Towards a Comprehensive Analysis of Energy and Network Service Pricing (NSP) Mechanisms to Get Sustainable Enviro-Economical Energy Sector," Energies, MDPI, vol. 16(5), pages 1-27, February.
    18. Tushar, Wayes & Yuen, Chau & Saha, Tapan K. & Morstyn, Thomas & Chapman, Archie C. & Alam, M. Jan E. & Hanif, Sarmad & Poor, H. Vincent, 2021. "Peer-to-peer energy systems for connected communities: A review of recent advances and emerging challenges," Applied Energy, Elsevier, vol. 282(PA).
    19. Lee, Minwoo & Han, Changho & Kwon, Soonbum & Kim, Yongchan, 2023. "Energy and cost savings through heat trading between two massive prosumers using solar and ground energy systems connected to district heating networks," Energy, Elsevier, vol. 284(C).
    20. Gržanić, M. & Capuder, T. & Zhang, N. & Huang, W., 2022. "Prosumers as active market participants: A systematic review of evolution of opportunities, models and challenges," Renewable and Sustainable Energy Reviews, Elsevier, vol. 154(C).

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:energy:v:309:y:2024:i:c:s036054422402841x. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.journals.elsevier.com/energy .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.