IDEAS home Printed from https://ideas.repec.org/a/eee/appene/v355y2024ics0306261923017130.html
   My bibliography  Save this article

Energy management for demand response in networked greenhouses with multi-agent deep reinforcement learning

Author

Listed:
  • Ajagekar, Akshay
  • Decardi-Nelson, Benjamin
  • You, Fengqi

Abstract

Greenhouses are key to ensuring food security and realizing a sustainable future for agriculture. However, to ensure crop growth efficiency, greenhouses consume a significant amount of energy, primarily through climate control and artificial lighting systems. Owing to this high energy consumption, a network of greenhouses exhibits immense potential to participate in demand response programs for power grid stability. In this work, a multi-agent deep reinforcement learning (MADRL) control framework utilizing an actor-critic algorithm with a shared attention mechanism is proposed for energy management in networked greenhouses. A network of renewable energy integrated greenhouses is constructed to interact with the power grid, when necessary, to address the fluctuations associated with renewable energy generation and dynamic electricity prices. The viability and scalability of this multi-agent approach is demonstrated by evaluating its capabilities for a network of five greenhouses of varying capacities. The proposed MADRL-based control approach for demand-side energy management in networked greenhouses demonstrates efficiency in maintaining indoor climate in all greenhouses while ensuring a 28% reduction in net load demand as compared to well-known algorithms.

Suggested Citation

  • Ajagekar, Akshay & Decardi-Nelson, Benjamin & You, Fengqi, 2024. "Energy management for demand response in networked greenhouses with multi-agent deep reinforcement learning," Applied Energy, Elsevier, vol. 355(C).
    • Handle: RePEc:eee:appene:v:355:y:2024:i:c:s0306261923017130
    DOI: 10.1016/j.apenergy.2023.122349
    as

    Download full text from publisher

    File URL: http://www.sciencedirect.com/science/article/pii/S0306261923017130
    Download Restriction: Full text for ScienceDirect subscribers only
    File URL: https://libkey.io/10.1016/j.apenergy.2023.122349?utm_source=ideas
    LibKey link: if access is restricted and if your library uses this service, LibKey will redirect you to where you can use your library subscription to access this item
    ---><---

    As the access to this document is restricted, you may want to search for a different version of it.

    References listed on IDEAS

    as
    1. Singh, Devesh & Basu, Chandrajit & Meinhardt-Wollweber, Merve & Roth, Bernhard, 2015. "LEDs for energy efficient greenhouse lighting," Renewable and Sustainable Energy Reviews, Elsevier, vol. 49(C), pages 139-147.
    2. Lu, Renzhi & Li, Yi-Chang & Li, Yuting & Jiang, Junhui & Ding, Yuemin, 2020. "Multi-agent deep reinforcement learning based demand response for discrete manufacturing systems energy management," Applied Energy, Elsevier, vol. 276(C).
    3. Vázquez-Canteli, José R. & Nagy, Zoltán, 2019. "Reinforcement learning for demand response: A review of algorithms and modeling techniques," Applied Energy, Elsevier, vol. 235(C), pages 1072-1089.
    4. Chen, Jiaoliao & Xu, Fang & Tan, Dapeng & Shen, Zheng & Zhang, Libin & Ai, Qinglin, 2015. "A control method for agricultural greenhouses heating based on computational fluid dynamics and energy prediction model," Applied Energy, Elsevier, vol. 141(C), pages 106-118.
    5. van Beveren, P.J.M. & Bontsema, J. & van Straten, G. & van Henten, E.J., 2015. "Optimal control of greenhouse climate using minimal energy and grower defined bounds," Applied Energy, Elsevier, vol. 159(C), pages 509-519.
    6. Yang, Shiyu & Oliver Gao, H. & You, Fengqi, 2022. "Model predictive control for Demand- and Market-Responsive building energy management by leveraging active latent heat storage," Applied Energy, Elsevier, vol. 327(C).
    7. Yang, Shiyu & Oliver Gao, H. & You, Fengqi, 2022. "Model predictive control in phase-change-material-wallboard-enhanced building energy management considering electricity price dynamics," Applied Energy, Elsevier, vol. 326(C).
    8. Babonneau, Frédéric & Caramanis, Michael & Haurie, Alain, 2016. "A linear programming model for power distribution with demand response and variable renewable energy," Applied Energy, Elsevier, vol. 181(C), pages 83-95.
    9. Xie, Jiahan & Ajagekar, Akshay & You, Fengqi, 2023. "Multi-Agent attention-based deep reinforcement learning for demand response in grid-responsive buildings," Applied Energy, Elsevier, vol. 342(C).
    10. Niu, Jide & Tian, Zhe & Lu, Yakai & Zhao, Hongfang, 2019. "Flexible dispatch of a building energy system using building thermal storage and battery energy storage," Applied Energy, Elsevier, vol. 243(C), pages 274-287.
    11. Hu, Guoqing & You, Fengqi, 2022. "Renewable energy-powered semi-closed greenhouse for sustainable crop production using model predictive control and machine learning for energy management," Renewable and Sustainable Energy Reviews, Elsevier, vol. 168(C).
    12. Sengupta, Manajit & Xie, Yu & Lopez, Anthony & Habte, Aron & Maclaurin, Galen & Shelby, James, 2018. "The National Solar Radiation Data Base (NSRDB)," Renewable and Sustainable Energy Reviews, Elsevier, vol. 89(C), pages 51-60.
    13. Lu, Renzhi & Hong, Seung Ho, 2019. "Incentive-based demand response for smart grid with reinforcement learning and deep neural network," Applied Energy, Elsevier, vol. 236(C), pages 937-949.
    14. Filippos Bantis & Athanasios Koukounaras, 2023. "Impact of Light on Horticultural Crops," Agriculture, MDPI, vol. 13(4), pages 1-4, April.
    15. Chen, Wei-Han & Mattson, Neil S. & You, Fengqi, 2022. "Intelligent control and energy optimization in controlled environment agriculture via nonlinear model predictive control of semi-closed greenhouse," Applied Energy, Elsevier, vol. 320(C).
    Full references (including those not matched with items on IDEAS)

    Citations

    Citations are extracted by the CitEc Project, subscribe to its RSS feed for this item.
    as


    Cited by:

    1. Hu, Guoqing & You, Fengqi, 2024. "AI-enabled cyber-physical-biological systems for smart energy management and sustainable food production in a plant factory," Applied Energy, Elsevier, vol. 356(C).
    2. Shao, Yunfei & Fan, Shuai & Meng, Yuhang & Jia, Kunqi & He, Guangyu, 2024. "Personalized demand response based on sub-CDL considering energy consumption characteristics of customers," Applied Energy, Elsevier, vol. 374(C).

    Most related items

    These are the items that most often cite the same works as this one and are cited by the same works as this one.
    1. Chen, Wei-Han & You, Fengqi, 2024. "Sustainable energy management and control for Decarbonization of complex multi-zone buildings with renewable solar and geothermal energies using machine learning, robust optimization, and predictive c," Applied Energy, Elsevier, vol. 372(C).
    2. Xie, Jiahan & Ajagekar, Akshay & You, Fengqi, 2023. "Multi-Agent attention-based deep reinforcement learning for demand response in grid-responsive buildings," Applied Energy, Elsevier, vol. 342(C).
    3. Hu, Guoqing & You, Fengqi, 2023. "An AI framework integrating physics-informed neural network with predictive control for energy-efficient food production in the built environment," Applied Energy, Elsevier, vol. 348(C).
    4. Xiao, Tianqi & You, Fengqi, 2023. "Building thermal modeling and model predictive control with physically consistent deep learning for decarbonization and energy optimization," Applied Energy, Elsevier, vol. 342(C).
    5. Lin, Dong & Dong, Yun & Ren, Zhiling & Zhang, Lijun & Fan, Yuling, 2024. "Hierarchical optimization for the energy management of a greenhouse integrated with grid-tied photovoltaic–battery systems," Applied Energy, Elsevier, vol. 374(C).
    6. Omar Al-Ani & Sanjoy Das, 2022. "Reinforcement Learning: Theory and Applications in HEMS," Energies, MDPI, vol. 15(17), pages 1-37, September.
    7. Zeng, Lanting & Qiu, Dawei & Sun, Mingyang, 2022. "Resilience enhancement of multi-agent reinforcement learning-based demand response against adversarial attacks," Applied Energy, Elsevier, vol. 324(C).
    8. Eduardo J. Salazar & Mauro Jurado & Mauricio E. Samper, 2023. "Reinforcement Learning-Based Pricing and Incentive Strategy for Demand Response in Smart Grids," Energies, MDPI, vol. 16(3), pages 1-33, February.
    9. Hu, Guoqing & You, Fengqi, 2024. "AI-enabled cyber-physical-biological systems for smart energy management and sustainable food production in a plant factory," Applied Energy, Elsevier, vol. 356(C).
    10. Correa-Jullian, Camila & López Droguett, Enrique & Cardemil, José Miguel, 2020. "Operation scheduling in a solar thermal system: A reinforcement learning-based framework," Applied Energy, Elsevier, vol. 268(C).
    11. Yang, Shiyu & Oliver Gao, H. & You, Fengqi, 2022. "Model predictive control for Demand- and Market-Responsive building energy management by leveraging active latent heat storage," Applied Energy, Elsevier, vol. 327(C).
    12. Ibrahim, Muhammad Sohail & Dong, Wei & Yang, Qiang, 2020. "Machine learning driven smart electric power systems: Current trends and new perspectives," Applied Energy, Elsevier, vol. 272(C).
    13. Pinto, Giuseppe & Piscitelli, Marco Savino & Vázquez-Canteli, José Ramón & Nagy, Zoltán & Capozzoli, Alfonso, 2021. "Coordinated energy management for a cluster of buildings through deep reinforcement learning," Energy, Elsevier, vol. 229(C).
    14. Wen, Lulu & Zhou, Kaile & Li, Jun & Wang, Shanyong, 2020. "Modified deep learning and reinforcement learning for an incentive-based demand response model," Energy, Elsevier, vol. 205(C).
    15. Pallonetto, Fabiano & De Rosa, Mattia & Milano, Federico & Finn, Donal P., 2019. "Demand response algorithms for smart-grid ready residential buildings using machine learning models," Applied Energy, Elsevier, vol. 239(C), pages 1265-1282.
    16. Pinto, Giuseppe & Deltetto, Davide & Capozzoli, Alfonso, 2021. "Data-driven district energy management with surrogate models and deep reinforcement learning," Applied Energy, Elsevier, vol. 304(C).
    17. Lu, Renzhi & Bai, Ruichang & Ding, Yuemin & Wei, Min & Jiang, Junhui & Sun, Mingyang & Xiao, Feng & Zhang, Hai-Tao, 2021. "A hybrid deep learning-based online energy management scheme for industrial microgrid," Applied Energy, Elsevier, vol. 304(C).
    18. Seongwoo Lee & Joonho Seon & Byungsun Hwang & Soohyun Kim & Youngghyu Sun & Jinyoung Kim, 2024. "Recent Trends and Issues of Energy Management Systems Using Machine Learning," Energies, MDPI, vol. 17(3), pages 1-24, January.
    19. Pinto, Giuseppe & Kathirgamanathan, Anjukan & Mangina, Eleni & Finn, Donal P. & Capozzoli, Alfonso, 2022. "Enhancing energy management in grid-interactive buildings: A comparison among cooperative and coordinated architectures," Applied Energy, Elsevier, vol. 310(C).
    20. Chao-Chung Hsu & Bi-Hai Jiang & Chun-Cheng Lin, 2023. "A Survey on Recent Applications of Artificial Intelligence and Optimization for Smart Grids in Smart Manufacturing," Energies, MDPI, vol. 16(22), pages 1-15, November.

    Corrections

    All material on this site has been provided by the respective publishers and authors. You can help correct errors and omissions. When requesting a correction, please mention this item's handle: RePEc:eee:appene:v:355:y:2024:i:c:s0306261923017130. See general information about how to correct material in RePEc.

    If you have authored this item and are not yet registered with RePEc, we encourage you to do it here. This allows to link your profile to this item. It also allows you to accept potential citations to this item that we are uncertain about.

    If CitEc recognized a bibliographic reference but did not link an item in RePEc to it, you can help with this form .

    If you know of missing items citing this one, you can help us creating those links by adding the relevant references in the same way as above, for each refering item. If you are a registered author of this item, you may also want to check the "citations" tab in your RePEc Author Service profile, as there may be some citations waiting for confirmation.

    For technical questions regarding this item, or to correct its authors, title, abstract, bibliographic or download information, contact: Catherine Liu (email available below). General contact details of provider: http://www.elsevier.com/wps/find/journaldescription.cws_home/405891/description#description .

    Please note that corrections may take a couple of weeks to filter through the various RePEc services.

    IDEAS is a RePEc service. RePEc uses bibliographic data supplied by the respective publishers.